-- Logs begin at Fri 2022-10-14 12:21:44 UTC, end at Fri 2022-10-14 13:23:58 UTC. -- Oct 14 12:46:41.725907 dv-cinder-820994-7-smb systemd[1]: Starting Devstack devstack@keystone.service... Oct 14 12:46:41.734079 dv-cinder-820994-7-smb devstack@keystone.service[81424]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Oct 14 12:46:41.737252 dv-cinder-820994-7-smb devstack@keystone.service[81424]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Oct 14 12:46:41 2022] *** Oct 14 12:46:41.737252 dv-cinder-820994-7-smb devstack@keystone.service[81424]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 14 12:46:41.737252 dv-cinder-820994-7-smb devstack@keystone.service[81424]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 14 12:46:41.737252 dv-cinder-820994-7-smb devstack@keystone.service[81424]: nodename: dv-cinder-820994-7-smb Oct 14 12:46:41.737252 dv-cinder-820994-7-smb devstack@keystone.service[81424]: machine: x86_64 Oct 14 12:46:41.737252 dv-cinder-820994-7-smb devstack@keystone.service[81424]: clock source: unix Oct 14 12:46:41.737252 dv-cinder-820994-7-smb devstack@keystone.service[81424]: pcre jit disabled Oct 14 12:46:41.737252 dv-cinder-820994-7-smb devstack@keystone.service[81424]: detected number of CPU cores: 4 Oct 14 12:46:41.737252 dv-cinder-820994-7-smb devstack@keystone.service[81424]: current working directory: / Oct 14 12:46:41.737252 dv-cinder-820994-7-smb devstack@keystone.service[81424]: detected binary path: /usr/bin/uwsgi-core Oct 14 12:46:41.737252 dv-cinder-820994-7-smb devstack@keystone.service[81424]: your processes number limit is 47680 Oct 14 12:46:41.737252 dv-cinder-820994-7-smb devstack@keystone.service[81424]: your memory page size is 4096 bytes Oct 14 12:46:41.737252 dv-cinder-820994-7-smb devstack@keystone.service[81424]: detected max file descriptor number: 2048 Oct 14 12:46:41.737932 dv-cinder-820994-7-smb devstack@keystone.service[81424]: lock engine: pthread robust mutexes Oct 14 12:46:41.737932 dv-cinder-820994-7-smb devstack@keystone.service[81424]: thunder lock: enabled Oct 14 12:46:41.737932 dv-cinder-820994-7-smb devstack@keystone.service[81424]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Oct 14 12:46:41.737932 dv-cinder-820994-7-smb devstack@keystone.service[81424]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 14 12:46:41.777558 dv-cinder-820994-7-smb devstack@keystone.service[81424]: Python main interpreter initialized at 0x55b9fc5c69c0 Oct 14 12:46:41.777558 dv-cinder-820994-7-smb devstack@keystone.service[81424]: python threads support enabled Oct 14 12:46:41.777558 dv-cinder-820994-7-smb devstack@keystone.service[81424]: your server socket listen backlog is limited to 100 connections Oct 14 12:46:41.777558 dv-cinder-820994-7-smb devstack@keystone.service[81424]: your mercy for graceful operations on workers is 90 seconds Oct 14 12:46:41.777987 dv-cinder-820994-7-smb devstack@keystone.service[81424]: mapped 403077 bytes (393 KB) for 2 cores Oct 14 12:46:41.777987 dv-cinder-820994-7-smb devstack@keystone.service[81424]: *** Operational MODE: preforking *** Oct 14 12:46:41.778301 dv-cinder-820994-7-smb devstack@keystone.service[81424]: *** uWSGI is running in multiple interpreter mode *** Oct 14 12:46:41.778301 dv-cinder-820994-7-smb devstack@keystone.service[81424]: spawned uWSGI master process (pid: 81424) Oct 14 12:46:41.778509 dv-cinder-820994-7-smb systemd[1]: Started Devstack devstack@keystone.service. Oct 14 12:46:41.780826 dv-cinder-820994-7-smb devstack@keystone.service[81424]: spawned uWSGI worker 1 (pid: 81438, cores: 1) Oct 14 12:46:41.780826 dv-cinder-820994-7-smb devstack@keystone.service[81424]: spawned uWSGI worker 2 (pid: 81439, cores: 1) Oct 14 12:46:41.780826 dv-cinder-820994-7-smb devstack@keystone.service[81424]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 14 12:46:46.153047 dv-cinder-820994-7-smb devstack@keystone.service[81438]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 14 12:46:46.153047 dv-cinder-820994-7-smb devstack@keystone.service[81438]: from cryptography.utils import int_from_bytes Oct 14 12:46:46.153847 dv-cinder-820994-7-smb devstack@keystone.service[81438]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 14 12:46:46.153847 dv-cinder-820994-7-smb devstack@keystone.service[81438]: from cryptography.utils import int_from_bytes Oct 14 12:46:46.153992 dv-cinder-820994-7-smb devstack@keystone.service[81439]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 14 12:46:46.153992 dv-cinder-820994-7-smb devstack@keystone.service[81439]: from cryptography.utils import int_from_bytes Oct 14 12:46:46.153992 dv-cinder-820994-7-smb devstack@keystone.service[81439]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 14 12:46:46.153992 dv-cinder-820994-7-smb devstack@keystone.service[81439]: from cryptography.utils import int_from_bytes Oct 14 12:46:46.205483 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 14 12:46:46.205702 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 14 12:46:46.205796 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 14 12:46:46.205904 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 14 12:46:46.205985 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] command line args: [] {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 14 12:46:46.206068 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] command line args: [] {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 14 12:46:46.206174 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 14 12:46:46.206259 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 14 12:46:46.206331 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] ================================================================================ {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 14 12:46:46.206399 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] ================================================================================ {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 14 12:46:46.206540 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] admin_token = **** {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:46:46.206673 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] admin_token = **** {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:46:46.206827 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] config_dir = [] {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:46:46.206921 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] config_dir = [] {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:46:46.206992 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:46:46.207061 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:46:46.207137 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] config_source = [] {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:46:46.207213 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] config_source = [] {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:46:46.207389 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] debug = True {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:46:46.207488 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] debug = True {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:46:46.207567 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:46:46.207804 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:46:46.207898 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:46:46.207963 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:46:46.208021 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:46:46.208077 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:46:46.208264 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:46:46.208353 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:46:46.208765 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:46:46.208845 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:46:46.208911 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] list_limit = None {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:46:46.208974 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] list_limit = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:46:46.209033 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] log_config_append = None {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:46:46.209098 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] log_config_append = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:46:46.209156 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:46:46.209212 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:46:46.209273 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] log_dir = None {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:46:46.209553 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] log_dir = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:46:46.209698 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] log_file = None {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:46:46.209828 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] log_file = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:46:46.209910 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:46:46.210028 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:46:46.210107 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:46:46.210216 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:46:46.210341 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:46:46.210427 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:46:46.210499 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:46:46.210623 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:46:46.210706 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:46:46.210785 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:46:46.210909 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:46:46.210991 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:46:46.211062 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:46:46.211133 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:46:46.211202 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:46:46.211329 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:46:46.211469 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:46:46.211558 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:46:46.211679 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:46:46.211767 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:46:46.211905 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:46:46.211984 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:46:46.212143 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:46:46.212222 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:46:46.212396 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:46:46.212488 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:46:46.212645 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:46:46.212773 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:46:46.212924 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:46:46.213046 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:46:46.213430 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.17/identity {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:46:46.213514 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.17/identity {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:46:46.213597 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] publish_errors = False {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:46:46.213672 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] publish_errors = False {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:46:46.213834 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:46:46.213916 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:46:46.214066 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:46:46.214166 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:46:46.214270 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:46:46.214390 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:46:46.214519 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:46:46.214618 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:46:46.214744 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:46:46.214819 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:46:46.214975 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] standard_threads = False {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:46:46.215051 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] standard_threads = False {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:46:46.215208 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:46:46.215290 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:46:46.215454 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:46:46.215530 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:46:46.215630 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:46:46.215711 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:46:46.215847 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] use_journal = False {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:46:46.215920 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] use_journal = False {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:46:46.215989 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] use_json = False {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:46:46.216053 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] use_json = False {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:46:46.216122 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] use_stderr = False {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:46:46.216190 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] use_stderr = False {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:46:46.216286 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] use_syslog = False {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:46:46.216370 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] use_syslog = False {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:46:46.216518 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:46:46.216596 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:46:46.216778 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.216859 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.217016 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.217093 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.217277 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.217367 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.217518 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.217596 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.217767 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.217850 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.218005 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.218087 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.218293 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.218386 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.218515 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.218602 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.218762 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.218838 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.219008 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.219084 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.219259 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.219337 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.219493 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.219576 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.219741 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.219824 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.219977 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.220061 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.220224 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.220315 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.220470 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.220553 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.220709 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.220791 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.220961 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.221036 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.221212 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.221364 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.221445 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.221515 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.221685 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.221760 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.221937 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.222021 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.222222 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.222302 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.222476 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.222566 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.222725 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.222809 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.222955 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.223032 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.223186 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.223262 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.223416 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.223499 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.223655 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.223736 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.223904 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.224112 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.224192 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.224310 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.224445 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.224563 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.224689 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.224817 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.224943 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.225064 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.225141 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.225210 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.225314 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.225391 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.225561 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.225646 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.225794 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.225870 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.226032 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.226202 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.226281 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.226359 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.226506 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.226583 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.226736 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.226814 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.226969 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.227120 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.227194 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.227268 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.227422 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.227505 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.227668 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.227746 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.227898 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.227970 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.228132 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.228199 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.228362 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.228437 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.228595 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.228662 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.228833 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.228904 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.229078 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.229151 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.229311 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.229376 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.229590 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.229678 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.229780 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.229856 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.230107 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.230231 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.230345 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.230414 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.230480 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.230545 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.230708 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.230775 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.230974 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.231047 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.231192 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.231260 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.231504 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.231586 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.231645 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.231807 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.231897 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.232066 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.232159 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.232252 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.232663 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.232834 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.232968 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.233100 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.233231 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.233355 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.233474 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.233605 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.233686 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.233828 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.233964 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.234088 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.234290 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.234411 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.234532 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.234651 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.234651 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.234898 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.235019 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.235146 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.235268 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.235388 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.235530 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.235659 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.235788 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.235909 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.236031 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.236153 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.236283 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.236405 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.236533 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.236655 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.236782 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.236908 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.237037 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.237163 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.237298 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.237422 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.237548 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.237677 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.237812 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.237942 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.238068 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.238216 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.238342 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.238467 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.238603 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.238730 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.238857 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.238984 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.239121 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.239254 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.239455 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.239584 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.240255 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.240427 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.240612 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.240827 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.241027 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.241183 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.241307 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.241434 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.241560 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.241716 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.241842 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.241976 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.242103 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.242280 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.242416 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.242543 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.242669 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.242805 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.242933 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.243059 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.243185 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.243310 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.243435 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.243580 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.243706 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.243833 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.243959 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.243959 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.244202 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.244360 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] auth.external = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.244499 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.244633 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.244759 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] auth.external = None {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.244886 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.245015 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.245147 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.245284 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.245419 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] auth.password = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.245419 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] auth.token = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.245657 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.245783 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.245909 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] auth.password = None {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.246036 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.246186 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] auth.token = None {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.246311 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.246438 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.246559 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.246686 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.246813 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.246949 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.247087 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.247214 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.247340 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.247467 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.247601 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] credential.caching = True {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.247734 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.247861 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.247988 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.248116 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.248242 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] credential.caching = True {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.248368 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.248501 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.248627 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.248763 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.248890 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.249022 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.249155 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.249289 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.249416 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.249542 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.249668 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.249749 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.249810 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.249877 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.249937 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.249995 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.250053 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.250110 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.250206 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.250278 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.250340 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.250340 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.250443 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.250501 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.250558 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.250624 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] federation.caching = True {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.250683 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.250741 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.250804 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.250863 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.250926 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.250993 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.251052 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] federation.caching = True {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.251109 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.251166 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.251222 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.251287 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.251528 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.251607 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.251863 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.251991 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.252117 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.252252 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.252379 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.252515 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.252642 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.252766 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.252891 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.253024 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.253155 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] identity.caching = True {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.253283 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.253409 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.253532 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.253658 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.253861 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.253989 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.254130 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] identity.caching = True {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.254270 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.254399 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.254525 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.254662 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.254795 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.254929 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.255062 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.255189 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.255349 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.256072 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.256254 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.256254 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.256620 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.256793 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.256932 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.257068 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.257193 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.257193 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.257427 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.257551 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.257675 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.257806 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.257806 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.258037 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.258211 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.258337 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.258466 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.258615 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.258745 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.258871 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.258998 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.259122 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.259122 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.259324 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.259458 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.259579 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.259706 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.259832 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.259958 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.260092 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.260219 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.260355 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.260480 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.260607 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.260739 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.260876 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.261004 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.261126 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.261254 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.261381 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.261516 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.261644 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.261770 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.261896 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.262023 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.262172 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.262307 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.262431 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.262554 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.262677 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.262759 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.262869 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.263001 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.263001 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.263232 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.263354 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.263476 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.263598 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.263738 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.263861 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.263983 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.264107 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.264230 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.264230 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.264467 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.264590 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.264712 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.264836 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.264958 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.265081 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.265212 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.265212 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.265451 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.265573 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.265696 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.265819 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.265949 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.266072 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.266263 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.266390 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.266523 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.266650 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.266785 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.266866 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.user = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.267033 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.267156 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.267292 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.267419 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.267554 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.267680 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.267813 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.267940 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.268065 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] ldap.user = None {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.268191 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.268274 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.268337 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.268395 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.268519 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.268640 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.268775 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.268911 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.269039 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.269167 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.269292 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.269418 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.269543 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.269683 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.269809 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.269935 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.270063 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.270063 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.270325 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.270458 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.270591 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.270714 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.270841 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.270964 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.271115 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.271322 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.271521 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.271699 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.271826 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.271950 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.272072 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.272205 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.272205 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.272454 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.272578 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.272701 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.272823 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.272952 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.272952 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.273190 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.273313 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.273436 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.273578 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.273662 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.273828 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.273950 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.274072 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.274233 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.274361 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.274499 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.274625 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.274746 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.274874 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.275000 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.275126 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.275261 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.275389 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.275516 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.275642 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.275767 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.275894 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.276040 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.276167 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.276295 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] resource.caching = True {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.276416 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.276546 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.276675 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.276810 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.276937 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.277063 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.277188 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.277314 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.277440 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.277575 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.277702 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] resource.caching = True {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.277837 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.277964 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.278096 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.278247 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.278376 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.278503 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.278631 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.278758 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.278885 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] role.caching = True {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.279088 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.279217 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] role.driver = sql {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.279344 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.279472 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.279608 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.279737 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.279872 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.280000 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.280128 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.280255 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.280382 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] role.caching = True {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.280509 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.280644 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] role.driver = sql {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.280777 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.280898 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.281025 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.281152 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.281278 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.281422 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.281551 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.281678 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.281806 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.281895 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.282012 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.282160 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.282294 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.282419 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.282542 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.282665 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.282788 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.282925 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.283064 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.283187 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.283310 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.283432 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.283555 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.283686 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.283809 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.283932 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.284056 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.284178 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.284300 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.284300 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.284539 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.284677 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.284801 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.284923 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.285054 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.285136 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.285297 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.285420 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.285542 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.285664 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.285795 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.285918 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.286041 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.286215 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.286349 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.286477 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.286605 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.286749 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.286929 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.287112 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.287246 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.287502 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.287643 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.287772 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.287901 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.288027 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] token.caching = True {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.288154 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.288280 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.288426 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.288554 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.288680 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.288806 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.288934 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.289060 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.289195 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.289320 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.289448 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.289574 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.289700 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] token.caching = True {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.289826 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.289961 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.290097 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.290237 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.290361 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.290361 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.290592 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.290726 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.290854 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.290854 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.291085 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.291208 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.291336 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.291473 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.291602 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.291724 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.291856 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.291988 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.292120 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.292243 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.292374 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.292498 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.292620 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] database.connection = **** {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.292744 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.292867 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.292989 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.293126 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.293250 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.293373 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.293496 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.293637 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.293768 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.293891 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.293891 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.294199 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.294325 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.294452 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] database.connection = **** {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.294589 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.294716 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.294842 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.294980 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.295108 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.295236 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.295362 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.295499 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.295627 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.295762 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.295889 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.296015 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.296141 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.296268 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.296395 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.296485 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.296549 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.296607 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.296666 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.296724 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.296782 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.296854 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.296915 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 14 12:46:46.296974 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.296974 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.296974 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.296974 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.296974 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.296974 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.296974 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:46:46.296974 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81439) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 14 12:46:46.323755 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81438) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 12:46:46.324058 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81438) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 12:46:46.324209 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81438) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 12:46:46.324632 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81439) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 12:46:46.324871 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81439) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 12:46:46.325097 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81439) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 12:46:46.332569 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81438) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 12:46:46.333533 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81439) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 12:46:46.361538 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81438) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 12:46:46.361780 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81438) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 12:46:46.363177 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81439) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 12:46:46.363415 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81439) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 12:46:46.417764 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81438) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 12:46:46.418055 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81439) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 12:46:46.469403 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81438) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 12:46:46.469690 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81438) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 12:46:46.470898 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81439) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 12:46:46.471135 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81439) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 12:46:46.634872 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81439) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 12:46:46.635130 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81439) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 12:46:46.635274 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81439) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 12:46:46.635405 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81438) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 12:46:46.635553 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81439) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 12:46:46.635695 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81438) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 12:46:46.635779 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81439) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 12:46:46.635842 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81438) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 12:46:46.635902 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81439) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 12:46:46.636033 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81438) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 12:46:46.636251 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81438) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 12:46:46.636463 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81438) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 12:46:46.660396 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81439) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 12:46:46.660701 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81438) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 12:46:46.660910 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81439) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 12:46:46.661126 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81438) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 12:46:46.661301 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81439) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 12:46:46.661969 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81438) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 12:46:46.662165 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81439) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 12:46:46.662300 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81438) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 12:46:46.662441 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81439) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 12:46:46.662567 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81438) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 12:46:46.662693 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81439) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 12:46:46.662818 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81438) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 12:46:46.662943 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81439) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 12:46:46.663076 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81438) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 12:46:46.673999 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81438) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 12:46:46.674668 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81439) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 12:46:46.688682 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81439) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 12:46:46.689024 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81439) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 12:46:46.689237 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81439) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 12:46:46.689471 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81439) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 12:46:46.689610 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81439) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 12:46:46.689768 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81439) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 12:46:46.689993 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81439) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 12:46:46.691565 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81438) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 12:46:46.691782 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81438) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 12:46:46.692000 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81438) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 12:46:46.692218 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81438) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 12:46:46.692432 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81438) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 12:46:46.692644 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81438) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 12:46:46.692889 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81438) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 12:46:46.707568 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:46.707838 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 14 12:46:46.708116 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:46.708249 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:46.708885 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 14 12:46:46.709036 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 14 12:46:46.709179 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:46.709367 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:46.709495 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:46.709626 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 14 12:46:46.709764 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:46.709892 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:46.710021 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:46.710178 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:46.710406 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:46.710715 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:46.719902 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:46.720194 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:46.720470 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:46.720761 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:46.721145 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:46.721440 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:46.721713 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:46.721997 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:46.728870 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81439) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 14 12:46:46.730856 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81438) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 14 12:46:46.731817 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81439) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 14 12:46:46.732105 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:46.732665 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:46.732949 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:46.733236 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:46.733499 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:46.733771 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:46.734054 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:46.734354 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:46.734634 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:46.734902 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:46.735688 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81438) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 14 12:46:46.736503 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:46.736886 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:46.737182 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:46.737471 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:46.737735 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:46.738009 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:46.738309 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:46.738584 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:46.738862 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:46.739132 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:46.759244 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:46.760758 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81439) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 14 12:46:46.761049 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:46.763396 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:46.764992 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81438) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 14 12:46:46.765279 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:46.765781 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81439) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 14 12:46:46.766083 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:46.766418 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:46.770226 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81438) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 14 12:46:46.770512 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:46.771381 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:46.773588 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81439) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 14 12:46:46.773887 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:46.780426 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81439) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 14 12:46:46.780730 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:46.781031 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:46.781270 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81438) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 14 12:46:46.781412 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:46.781577 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:46.781707 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:46.781849 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:46.782146 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:46.782430 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:46.788762 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81438) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 14 12:46:46.789065 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:46.789362 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:46.789645 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:46.789924 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:46.790228 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:46.790507 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:46.790782 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:46.799065 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:46.799361 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:46.803550 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81439) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 14 12:46:46.807012 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:46.807314 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:46.807552 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:46.807802 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:46.811821 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81438) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 14 12:46:46.812185 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81439) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 14 12:46:46.815269 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81439) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 14 12:46:46.816104 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:46.816405 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:46.818640 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:46.818963 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:46.819251 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:46.819536 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:46.819812 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:46.820094 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:46.822873 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81438) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 14 12:46:46.826388 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81438) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 14 12:46:46.829701 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:46.829999 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:46.830315 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:46.830599 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:46.830934 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:46.831262 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:46.837027 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81439) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 14 12:46:46.837338 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:46.837614 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:46.837885 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:46.845011 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:46.846612 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:46.848004 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81438) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 14 12:46:46.848163 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:46.848300 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:46.848421 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:46.848547 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:46.848813 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:46.852082 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81439) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 14 12:46:46.852367 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:46.852658 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:46.852946 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:46.853364 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:46.856539 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:46.858368 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:46.859992 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:46.860269 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:46.863433 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81438) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 14 12:46:46.864150 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:46.864150 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:46.864544 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:46.864674 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:46.865203 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81439) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 14 12:46:46.865509 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:46.865805 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:46.866164 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:46.866565 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:46.866851 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:46.867135 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:46.877575 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81438) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 14 12:46:46.877877 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:46.878191 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:46.878598 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:46.878947 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:46.879371 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:46.879680 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:46.883041 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81439) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 14 12:46:46.886046 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81439) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 14 12:46:46.888931 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:46.890399 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:46.892195 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81439) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 14 12:46:46.892484 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:46.892903 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:46.895687 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81438) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 14 12:46:46.899201 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81438) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 14 12:46:46.899988 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:46.901487 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81439) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 14 12:46:46.902097 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:46.903558 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:46.904389 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:46.904798 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:46.905053 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81438) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 14 12:46:46.905134 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:46.905338 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:46.905419 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:46.905749 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:46.912917 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:46.914436 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81438) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 14 12:46:46.918675 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81439) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 14 12:46:46.918675 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:46.918675 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:46.918974 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:46.918974 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:46.918974 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:46.919165 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:46.922900 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81439) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 14 12:46:46.923193 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:46.923478 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:46.923757 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:46.924036 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:46.924320 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:46.924596 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:46.924884 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:46.925167 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:46.925444 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:46.925770 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:46.926277 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:46.926716 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:46.926910 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81438) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 14 12:46:46.927210 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81439) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:46.927352 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:46.927532 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:46.934494 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81438) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 14 12:46:46.934786 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:46.935072 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:46.935361 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:46.935638 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:46.935917 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:46.936195 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:46.936484 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:46.936759 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:46.937041 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:46.937321 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:46.937594 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:46.937861 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:46.938154 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81438) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 12:46:46.964887 dv-cinder-820994-7-smb devstack@keystone.service[81439]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55b9fc5c69c0 pid: 81439 (default app) Oct 14 12:46:46.968480 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8d5a5c-93b2-4fb4-94d6-cd24a78ee7f2 None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:46.968768 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8d5a5c-93b2-4fb4-94d6-cd24a78ee7f2 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:46.969047 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8d5a5c-93b2-4fb4-94d6-cd24a78ee7f2 None None] PATH_INFO: `/v3` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:46.973571 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1/1] 10.222.0.17 () {50 vars in 791 bytes} [Fri Oct 14 12:46:46 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:46:46.976579 dv-cinder-820994-7-smb devstack@keystone.service[81438]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55b9fc5c69c0 pid: 81438 (default app) Oct 14 12:46:53.942278 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b146164-2d8f-4e34-a162-7c9a2b74e540 None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:53.942915 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b146164-2d8f-4e34-a162-7c9a2b74e540 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:53.942915 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b146164-2d8f-4e34-a162-7c9a2b74e540 None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:53.944118 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 2/2] 10.222.0.17 () {54 vars in 927 bytes} [Fri Oct 14 12:46:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 14 12:46:53.951956 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc022992-f8f6-4078-b566-2ef2cbaca484 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:53.952466 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc022992-f8f6-4078-b566-2ef2cbaca484 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:53.952559 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc022992-f8f6-4078-b566-2ef2cbaca484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:54.025796 dv-cinder-820994-7-smb devstack@keystone.service[81438]: INFO dbcounter [None req-bc022992-f8f6-4078-b566-2ef2cbaca484 None None] Registered counter for database keystone Oct 14 12:46:54.045534 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG oslo_db.sqlalchemy.engines [None req-bc022992-f8f6-4078-b566-2ef2cbaca484 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81438) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 14 12:46:54.053540 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writer thread running {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 14 12:46:54.241542 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG passlib.handlers.bcrypt [None req-bc022992-f8f6-4078-b566-2ef2cbaca484 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81438) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 14 12:46:54.241843 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG passlib.handlers.bcrypt [None req-bc022992-f8f6-4078-b566-2ef2cbaca484 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81438) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 14 12:46:54.301054 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-bc022992-f8f6-4078-b566-2ef2cbaca484 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:46:54.302849 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-bc022992-f8f6-4078-b566-2ef2cbaca484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:46:54.437164 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1/3] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Oct 14 12:46:53 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 488 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 14 12:46:54.908739 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b146164-2d8f-4e34-a162-7c9a2b74e540 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:46:54.978789 dv-cinder-820994-7-smb devstack@keystone.service[81439]: INFO dbcounter [None req-1b146164-2d8f-4e34-a162-7c9a2b74e540 None None] Registered counter for database keystone Oct 14 12:46:55.001446 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG oslo_db.sqlalchemy.engines [None req-1b146164-2d8f-4e34-a162-7c9a2b74e540 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81439) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 14 12:46:55.009019 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writer thread running {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 14 12:46:55.127817 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b146164-2d8f-4e34-a162-7c9a2b74e540 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:46:55.132840 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c98fbd-04d9-4f5a-93f7-ab305c8e70cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:46:55.133483 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c98fbd-04d9-4f5a-93f7-ab305c8e70cf admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:55.133766 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c98fbd-04d9-4f5a-93f7-ab305c8e70cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:55.134041 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c98fbd-04d9-4f5a-93f7-ab305c8e70cf admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:55.142963 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c98fbd-04d9-4f5a-93f7-ab305c8e70cf admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:46:55.195857 dv-cinder-820994-7-smb devstack@keystone.service[81439]: WARNING keystone.common.rbac_enforcer.enforcer [None req-a2c98fbd-04d9-4f5a-93f7-ab305c8e70cf admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 14 12:46:55.196127 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c98fbd-04d9-4f5a-93f7-ab305c8e70cf admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:46:55.206459 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 3/4] 10.222.0.17 () {58 vars in 1324 bytes} [Fri Oct 14 12:46:54 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 14 12:46:55.212644 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc022992-f8f6-4078-b566-2ef2cbaca484 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:46:55.229941 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc022992-f8f6-4078-b566-2ef2cbaca484 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:46:55.234732 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3661ea8-45c1-4d07-95e8-9793d45f24fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:46:55.236014 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3661ea8-45c1-4d07-95e8-9793d45f24fc admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:55.236296 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3661ea8-45c1-4d07-95e8-9793d45f24fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:55.236574 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3661ea8-45c1-4d07-95e8-9793d45f24fc admin admin] PATH_INFO: `/v3/projects/fd0b9855003d4ec7b5e5abb80be13578` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:55.238005 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3661ea8-45c1-4d07-95e8-9793d45f24fc admin admin] RBAC: Authorizing `identity:get_project(project_id=fd0b9855003d4ec7b5e5abb80be13578)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:46:55.291718 dv-cinder-820994-7-smb devstack@keystone.service[81438]: WARNING keystone.common.rbac_enforcer.enforcer [None req-c3661ea8-45c1-4d07-95e8-9793d45f24fc admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 14 12:46:55.292083 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3661ea8-45c1-4d07-95e8-9793d45f24fc admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:46:55.296795 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 2/5] 10.222.0.17 () {56 vars in 1207 bytes} [Fri Oct 14 12:46:55 2022] GET /identity/v3/projects/fd0b9855003d4ec7b5e5abb80be13578 => generated 344 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 12:46:57.495368 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95644b52-39aa-43c9-b9eb-c2f65028bce7 None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:57.495903 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95644b52-39aa-43c9-b9eb-c2f65028bce7 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:57.495903 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95644b52-39aa-43c9-b9eb-c2f65028bce7 None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:57.500135 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 4/6] 10.222.0.17 () {54 vars in 927 bytes} [Fri Oct 14 12:46:57 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:46:57.506733 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2d1554-83e3-4104-a5de-1d3f88fb84aa None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:57.507243 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2d1554-83e3-4104-a5de-1d3f88fb84aa None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:57.507335 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2d1554-83e3-4104-a5de-1d3f88fb84aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:57.527896 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-6d2d1554-83e3-4104-a5de-1d3f88fb84aa None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:46:57.529438 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-6d2d1554-83e3-4104-a5de-1d3f88fb84aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:46:57.537265 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 3/7] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Oct 14 12:46:57 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 14 12:46:57.806873 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95644b52-39aa-43c9-b9eb-c2f65028bce7 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:46:57.823661 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95644b52-39aa-43c9-b9eb-c2f65028bce7 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:46:57.828060 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1229107d-6949-494e-aff2-34f4a8f22f18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:46:57.828672 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1229107d-6949-494e-aff2-34f4a8f22f18 admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:57.828954 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1229107d-6949-494e-aff2-34f4a8f22f18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:57.829229 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1229107d-6949-494e-aff2-34f4a8f22f18 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:57.838379 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1229107d-6949-494e-aff2-34f4a8f22f18 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:46:57.840175 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1229107d-6949-494e-aff2-34f4a8f22f18 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:46:57.849274 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 5/8] 10.222.0.17 () {58 vars in 1324 bytes} [Fri Oct 14 12:46:57 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 14 12:46:57.855080 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2d1554-83e3-4104-a5de-1d3f88fb84aa None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:46:57.864495 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2d1554-83e3-4104-a5de-1d3f88fb84aa None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:46:57.868866 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febe0e7a-c8e2-440d-a0f5-4b948a8d031f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:46:57.869497 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febe0e7a-c8e2-440d-a0f5-4b948a8d031f admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:46:57.869775 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febe0e7a-c8e2-440d-a0f5-4b948a8d031f admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:46:57.870046 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febe0e7a-c8e2-440d-a0f5-4b948a8d031f admin admin] PATH_INFO: `/v3/users/c832b4bdd0c849fb8bef8d4ac39a8dd6` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:46:57.871388 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febe0e7a-c8e2-440d-a0f5-4b948a8d031f admin admin] RBAC: Authorizing `identity:get_user(user_id=c832b4bdd0c849fb8bef8d4ac39a8dd6)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:46:57.873213 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febe0e7a-c8e2-440d-a0f5-4b948a8d031f admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:46:57.874797 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 4/9] 10.222.0.17 () {56 vars in 1198 bytes} [Fri Oct 14 12:46:57 2022] GET /identity/v3/users/c832b4bdd0c849fb8bef8d4ac39a8dd6 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:00.129626 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d602ab7-3af1-41fe-a50f-637920c1fe67 None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:00.130351 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d602ab7-3af1-41fe-a50f-637920c1fe67 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:00.130351 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d602ab7-3af1-41fe-a50f-637920c1fe67 None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:00.131566 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 6/10] 10.222.0.17 () {54 vars in 927 bytes} [Fri Oct 14 12:47:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:47:00.138503 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5d595f-e17f-4c91-9eba-04068250670e None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:00.138503 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5d595f-e17f-4c91-9eba-04068250670e None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:00.139081 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5d595f-e17f-4c91-9eba-04068250670e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:00.157563 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-5d5d595f-e17f-4c91-9eba-04068250670e None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:47:00.159149 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-5d5d595f-e17f-4c91-9eba-04068250670e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:47:00.197930 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b48abe4-4914-4c1c-ab43-281209dbf0e4 None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:00.198247 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b48abe4-4914-4c1c-ab43-281209dbf0e4 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:00.198527 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b48abe4-4914-4c1c-ab43-281209dbf0e4 None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:00.199940 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 7/11] 10.222.0.17 () {54 vars in 927 bytes} [Fri Oct 14 12:47:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 14 12:47:00.205271 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a80cba-938d-4614-a577-6c3e777b5618 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:00.205558 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a80cba-938d-4614-a577-6c3e777b5618 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:00.205838 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a80cba-938d-4614-a577-6c3e777b5618 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:00.249661 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG passlib.handlers.bcrypt [None req-a1a80cba-938d-4614-a577-6c3e777b5618 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81439) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 14 12:47:00.250047 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG passlib.handlers.bcrypt [None req-a1a80cba-938d-4614-a577-6c3e777b5618 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81439) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 14 12:47:00.257620 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 5/12] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Oct 14 12:47:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 12:47:00.299559 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-a1a80cba-938d-4614-a577-6c3e777b5618 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:47:00.301171 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-a1a80cba-938d-4614-a577-6c3e777b5618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:47:00.406523 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 8/13] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Oct 14 12:47:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 14 12:47:00.531561 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5d595f-e17f-4c91-9eba-04068250670e None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:00.558562 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:00.641583 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5d595f-e17f-4c91-9eba-04068250670e None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:00.677790 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f253a89-b7e6-4d67-b38c-d6ff8584ca2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:00.678976 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f253a89-b7e6-4d67-b38c-d6ff8584ca2f None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:00.679256 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f253a89-b7e6-4d67-b38c-d6ff8584ca2f None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:00.679362 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a80cba-938d-4614-a577-6c3e777b5618 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:00.679531 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f253a89-b7e6-4d67-b38c-d6ff8584ca2f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:00.691065 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f253a89-b7e6-4d67-b38c-d6ff8584ca2f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 12:47:00.700283 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-7f253a89-b7e6-4d67-b38c-d6ff8584ca2f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 14 12:47:00.700283 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:47:00.700283 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:47:00.700283 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:47:00.700283 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:47:00.700283 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:47:00.700283 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:47:00.700283 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:47:00.700283 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:47:00.700283 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:47:00.700283 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:47:00.700283 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:47:00.700283 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 12:47:00.700283 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 12:47:00.700283 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 12:47:00.700283 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 12:47:00.701333 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 12:47:00.701333 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 12:47:00.701333 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 12:47:00.701333 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 12:47:00.701333 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:47:00.701333 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:47:00.701333 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:47:00.701333 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:47:00.701333 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:47:00.701333 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:47:00.701333 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:47:00.701333 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 14 12:47:00.701333 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:47:00.701333 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:47:00.701333 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:47:00.701333 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:47:00.702206 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:47:00.702206 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:47:00.702206 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:47:00.702206 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:47:00.702206 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 12:47:00.702206 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 12:47:00.702206 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 12:47:00.702206 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 12:47:00.702206 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 12:47:00.702206 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 12:47:00.702206 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 14 12:47:00.702206 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 14 12:47:00.702206 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 6/14] 10.222.0.17 () {56 vars in 1096 bytes} [Fri Oct 14 12:47:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:47:00.707515 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f253a89-b7e6-4d67-b38c-d6ff8584ca2f None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:00.787896 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a80cba-938d-4614-a577-6c3e777b5618 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:00.790855 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:00.795839 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:00.815540 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f253a89-b7e6-4d67-b38c-d6ff8584ca2f None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:00.831600 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64a0468-e6a0-43ff-bf09-8f26bd582b30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:00.832483 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64a0468-e6a0-43ff-bf09-8f26bd582b30 None admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:00.832773 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64a0468-e6a0-43ff-bf09-8f26bd582b30 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:00.833037 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64a0468-e6a0-43ff-bf09-8f26bd582b30 None admin] PATH_INFO: `/v3/domains` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:00.834984 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64a0468-e6a0-43ff-bf09-8f26bd582b30 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:00.836466 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64a0468-e6a0-43ff-bf09-8f26bd582b30 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:00.847979 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.sql.core [None req-b64a0468-e6a0-43ff-bf09-8f26bd582b30 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 14 12:47:00.847979 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 14 12:47:00.847979 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [parameters: {'id': 'fce7cfb5df1345688d3e0d69ba04a5df', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 14 12:47:00.847979 dv-cinder-820994-7-smb devstack@keystone.service[81439]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81439) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 14 12:47:00.854103 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217110e7-5777-4d3d-a034-e1bb6ad58bf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:00.854733 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217110e7-5777-4d3d-a034-e1bb6ad58bf6 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:00.855011 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217110e7-5777-4d3d-a034-e1bb6ad58bf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:00.855280 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217110e7-5777-4d3d-a034-e1bb6ad58bf6 None admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:00.855953 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217110e7-5777-4d3d-a034-e1bb6ad58bf6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:00.856251 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217110e7-5777-4d3d-a034-e1bb6ad58bf6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:00.857898 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217110e7-5777-4d3d-a034-e1bb6ad58bf6 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:00.867686 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-b64a0468-e6a0-43ff-bf09-8f26bd582b30 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 14 12:47:00.867686 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:47:00.867686 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 14 12:47:00.867686 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 14 12:47:00.867686 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 14 12:47:00.867686 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 14 12:47:00.867686 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 14 12:47:00.867686 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application result = self._query(query) Oct 14 12:47:00.867686 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 14 12:47:00.867686 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application conn.query(q) Oct 14 12:47:00.867686 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 14 12:47:00.867686 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 14 12:47:00.867686 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 14 12:47:00.867686 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application result.read() Oct 14 12:47:00.868558 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 14 12:47:00.868558 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 14 12:47:00.868558 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 14 12:47:00.868558 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 14 12:47:00.868558 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 14 12:47:00.868558 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 14 12:47:00.868558 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 14 12:47:00.868558 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 14 12:47:00.868558 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 14 12:47:00.868558 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 14 12:47:00.868558 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 14 12:47:00.868558 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 14 12:47:00.868558 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:47:00.868558 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 14 12:47:00.868558 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 14 12:47:00.868558 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 14 12:47:00.868558 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 14 12:47:00.868558 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 14 12:47:00.869467 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application next(self.gen) Oct 14 12:47:00.869467 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 14 12:47:00.869467 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application yield resource Oct 14 12:47:00.869467 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 14 12:47:00.869467 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application next(self.gen) Oct 14 12:47:00.869467 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 14 12:47:00.869467 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application self.session.rollback() Oct 14 12:47:00.869467 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 14 12:47:00.869467 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application self.force_reraise() Oct 14 12:47:00.869467 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 14 12:47:00.869467 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise self.value Oct 14 12:47:00.869467 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 14 12:47:00.869467 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 14 12:47:00.869467 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 14 12:47:00.869467 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application session.commit() Oct 14 12:47:00.869467 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 14 12:47:00.869467 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 14 12:47:00.870367 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 14 12:47:00.870367 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application self._prepare_impl() Oct 14 12:47:00.870367 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 14 12:47:00.870367 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application self.session.flush() Oct 14 12:47:00.870367 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 14 12:47:00.870367 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application self._flush(objects) Oct 14 12:47:00.870367 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 14 12:47:00.870367 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 14 12:47:00.870367 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 14 12:47:00.870367 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application compat.raise_( Oct 14 12:47:00.870367 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 14 12:47:00.870367 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception Oct 14 12:47:00.870367 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 14 12:47:00.870367 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application flush_context.execute() Oct 14 12:47:00.870367 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 14 12:47:00.870367 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rec.execute(self) Oct 14 12:47:00.870367 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 14 12:47:00.871250 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 14 12:47:00.871250 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 14 12:47:00.871250 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 14 12:47:00.871250 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 14 12:47:00.871250 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 14 12:47:00.871250 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 14 12:47:00.871250 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 14 12:47:00.871250 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 14 12:47:00.871250 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 14 12:47:00.871250 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 14 12:47:00.871250 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 14 12:47:00.871250 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 14 12:47:00.871250 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 14 12:47:00.871250 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 14 12:47:00.871250 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 14 12:47:00.871989 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 14 12:47:00.871989 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception Oct 14 12:47:00.871989 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 14 12:47:00.871989 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 14 12:47:00.871989 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 14 12:47:00.871989 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 14 12:47:00.871989 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 14 12:47:00.871989 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application result = self._query(query) Oct 14 12:47:00.871989 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 14 12:47:00.871989 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application conn.query(q) Oct 14 12:47:00.871989 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 14 12:47:00.871989 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 14 12:47:00.871989 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 14 12:47:00.871989 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application result.read() Oct 14 12:47:00.871989 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 14 12:47:00.871989 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 14 12:47:00.871989 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 14 12:47:00.872761 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 14 12:47:00.872761 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 14 12:47:00.872761 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 14 12:47:00.872761 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 14 12:47:00.872761 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 14 12:47:00.872761 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 14 12:47:00.872761 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 14 12:47:00.872761 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [parameters: {'id': 'fce7cfb5df1345688d3e0d69ba04a5df', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 14 12:47:00.872761 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 14 12:47:00.872761 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 14 12:47:00.872761 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 14 12:47:00.872761 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 14 12:47:00.872761 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:47:00.872761 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 14 12:47:00.872761 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 14 12:47:00.873593 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 14 12:47:00.873593 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 14 12:47:00.873593 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name Default. Oct 14 12:47:00.873593 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 14 12:47:00.873593 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 14 12:47:00.873593 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 14 12:47:00.873593 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:47:00.873593 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:47:00.873593 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:47:00.873593 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:47:00.873593 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:47:00.873593 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:47:00.873593 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:47:00.873593 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:47:00.873593 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:47:00.873593 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:47:00.873593 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:47:00.874559 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Oct 14 12:47:00.874559 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Oct 14 12:47:00.874559 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:47:00.874559 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:47:00.874559 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Oct 14 12:47:00.874559 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Oct 14 12:47:00.874559 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:47:00.874559 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:47:00.874559 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 14 12:47:00.874559 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 14 12:47:00.874559 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 14 12:47:00.874559 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 14 12:47:00.874559 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 9/15] 10.222.0.17 () {60 vars in 1137 bytes} [Fri Oct 14 12:47:00 2022] POST /identity/v3/domains => generated 190 bytes in 190 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Oct 14 12:47:00.875931 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64a0468-e6a0-43ff-bf09-8f26bd582b30 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:00.876183 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 7/16] 10.222.0.17 () {56 vars in 1099 bytes} [Fri Oct 14 12:47:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:00.882382 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217110e7-5777-4d3d-a034-e1bb6ad58bf6 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:00.982022 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64a0468-e6a0-43ff-bf09-8f26bd582b30 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:00.986061 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217110e7-5777-4d3d-a034-e1bb6ad58bf6 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:01.020907 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110c45d4-3755-423f-96da-2154fe90eaec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:01.021735 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110c45d4-3755-423f-96da-2154fe90eaec None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:01.022013 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110c45d4-3755-423f-96da-2154fe90eaec None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:01.022312 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110c45d4-3755-423f-96da-2154fe90eaec None admin] PATH_INFO: `/v3/users/c832b4bdd0c849fb8bef8d4ac39a8dd6` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:01.022455 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153dde0f-a7e6-424e-9efe-911081ffd1da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:01.023305 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153dde0f-a7e6-424e-9efe-911081ffd1da None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:01.023449 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110c45d4-3755-423f-96da-2154fe90eaec None admin] RBAC: Authorizing `identity:get_user(user_id=c832b4bdd0c849fb8bef8d4ac39a8dd6)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:01.023587 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153dde0f-a7e6-424e-9efe-911081ffd1da None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:01.023859 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153dde0f-a7e6-424e-9efe-911081ffd1da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:01.024907 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110c45d4-3755-423f-96da-2154fe90eaec None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:01.026486 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 8/17] 10.222.0.17 () {56 vars in 1177 bytes} [Fri Oct 14 12:47:00 2022] GET /identity/v3/users/c832b4bdd0c849fb8bef8d4ac39a8dd6 => generated 247 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 12:47:01.031962 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110c45d4-3755-423f-96da-2154fe90eaec None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:01.041701 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153dde0f-a7e6-424e-9efe-911081ffd1da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:01.043238 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153dde0f-a7e6-424e-9efe-911081ffd1da None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:01.047254 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:01.060004 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-153dde0f-a7e6-424e-9efe-911081ffd1da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:47:01.060004 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:47:01.060004 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:47:01.060004 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:47:01.060004 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:47:01.060004 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:47:01.060004 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:47:01.060004 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:47:01.060004 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:47:01.060004 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:47:01.060004 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:47:01.060004 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:47:01.060004 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 12:47:01.060004 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 12:47:01.060004 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 12:47:01.060004 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 12:47:01.061076 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:47:01.061076 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:47:01.061076 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:47:01.061076 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:47:01.061076 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:47:01.061076 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:47:01.061076 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:47:01.061076 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 14 12:47:01.061076 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:47:01.061076 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:47:01.061076 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:47:01.061076 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:47:01.061076 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:47:01.061076 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:47:01.061076 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:47:01.061076 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:47:01.061076 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 12:47:01.061850 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 12:47:01.061850 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:47:01.061850 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 14 12:47:01.061850 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 10/18] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Oct 14 12:47:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:47:01.067188 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153dde0f-a7e6-424e-9efe-911081ffd1da None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:01.092119 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:01.143522 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110c45d4-3755-423f-96da-2154fe90eaec None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:01.178711 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a210a1b1-ba19-41fd-9a68-34ff85e413f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:01.179361 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a210a1b1-ba19-41fd-9a68-34ff85e413f6 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:01.179638 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a210a1b1-ba19-41fd-9a68-34ff85e413f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:01.179914 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a210a1b1-ba19-41fd-9a68-34ff85e413f6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:01.181062 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a210a1b1-ba19-41fd-9a68-34ff85e413f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:01.181651 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153dde0f-a7e6-424e-9efe-911081ffd1da None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:01.182564 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a210a1b1-ba19-41fd-9a68-34ff85e413f6 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:01.184133 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 9/19] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Oct 14 12:47:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 12:47:01.189818 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a210a1b1-ba19-41fd-9a68-34ff85e413f6 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:01.221207 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91eca780-d066-4837-8b99-d5e8f86393f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:01.221818 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eca780-d066-4837-8b99-d5e8f86393f1 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:01.222097 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eca780-d066-4837-8b99-d5e8f86393f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:01.222400 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eca780-d066-4837-8b99-d5e8f86393f1 None admin] PATH_INFO: `/v3/domains` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:01.223057 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91eca780-d066-4837-8b99-d5e8f86393f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:01.223357 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91eca780-d066-4837-8b99-d5e8f86393f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:01.224822 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91eca780-d066-4837-8b99-d5e8f86393f1 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:01.243059 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 11/20] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Oct 14 12:47:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:01.285256 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:01.308056 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a210a1b1-ba19-41fd-9a68-34ff85e413f6 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:01.346509 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0a3430-71f7-46de-9f2f-e3c69b1879df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:01.347195 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0a3430-71f7-46de-9f2f-e3c69b1879df None admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:01.347476 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0a3430-71f7-46de-9f2f-e3c69b1879df None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:01.347752 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0a3430-71f7-46de-9f2f-e3c69b1879df None admin] PATH_INFO: `/v3/domains/default/users/c832b4bdd0c849fb8bef8d4ac39a8dd6/roles/7f6e29e390bc41f7a9af17659a2e95d1` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:01.350457 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0a3430-71f7-46de-9f2f-e3c69b1879df None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=c832b4bdd0c849fb8bef8d4ac39a8dd6, role_id=7f6e29e390bc41f7a9af17659a2e95d1)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:01.351941 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0a3430-71f7-46de-9f2f-e3c69b1879df None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:01.470994 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 10/21] 10.222.0.17 () {58 vars in 1361 bytes} [Fri Oct 14 12:47:01 2022] PUT /identity/v3/domains/default/users/c832b4bdd0c849fb8bef8d4ac39a8dd6/roles/7f6e29e390bc41f7a9af17659a2e95d1 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 12:47:03.819765 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40832372-5174-4908-8f8d-974b93ef3720 None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:03.820312 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40832372-5174-4908-8f8d-974b93ef3720 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:03.820312 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40832372-5174-4908-8f8d-974b93ef3720 None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:03.821849 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 12/22] 10.222.0.17 () {54 vars in 927 bytes} [Fri Oct 14 12:47:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 14 12:47:03.828011 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd13345-c34d-43ac-bb8c-9c6d7850a66e None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:03.828470 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd13345-c34d-43ac-bb8c-9c6d7850a66e None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:03.828614 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd13345-c34d-43ac-bb8c-9c6d7850a66e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:03.859320 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-dfd13345-c34d-43ac-bb8c-9c6d7850a66e None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:47:03.860912 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-dfd13345-c34d-43ac-bb8c-9c6d7850a66e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:47:03.956429 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 11/23] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Oct 14 12:47:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 12:47:04.062273 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fab58a-c02f-47d3-925d-56a7cb2f59d9 None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:04.062611 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fab58a-c02f-47d3-925d-56a7cb2f59d9 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:04.062835 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fab58a-c02f-47d3-925d-56a7cb2f59d9 None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:04.064344 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 13/24] 10.222.0.17 () {54 vars in 927 bytes} [Fri Oct 14 12:47:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:47:04.086714 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f163042-c564-46b7-858a-4723f0293217 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:04.086714 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f163042-c564-46b7-858a-4723f0293217 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:04.086714 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f163042-c564-46b7-858a-4723f0293217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:04.112310 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-1f163042-c564-46b7-858a-4723f0293217 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:47:04.113561 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-1f163042-c564-46b7-858a-4723f0293217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:47:04.212250 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:04.216803 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 12/25] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Oct 14 12:47:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 12:47:04.376160 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fab58a-c02f-47d3-925d-56a7cb2f59d9 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:04.490156 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:04.515840 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fab58a-c02f-47d3-925d-56a7cb2f59d9 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:04.561757 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7804f33e-2c50-4ce7-9162-9576efa33e62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:04.562775 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7804f33e-2c50-4ce7-9162-9576efa33e62 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:04.563275 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7804f33e-2c50-4ce7-9162-9576efa33e62 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:04.563757 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7804f33e-2c50-4ce7-9162-9576efa33e62 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:04.576045 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7804f33e-2c50-4ce7-9162-9576efa33e62 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:04.577874 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7804f33e-2c50-4ce7-9162-9576efa33e62 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:04.603679 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-7804f33e-2c50-4ce7-9162-9576efa33e62 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:47:04.603679 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:47:04.603679 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:47:04.603679 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:47:04.603679 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:47:04.603679 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:47:04.603679 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:47:04.603679 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:47:04.603679 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:47:04.603679 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:47:04.603679 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:47:04.603679 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:47:04.603679 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 12:47:04.603679 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 12:47:04.603679 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 12:47:04.603679 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 12:47:04.604584 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:47:04.604584 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:47:04.604584 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:47:04.604584 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:47:04.604584 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:47:04.604584 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:47:04.604584 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:47:04.604584 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 14 12:47:04.604584 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:47:04.604584 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:47:04.604584 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:47:04.604584 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:47:04.604584 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:47:04.604584 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:47:04.604584 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:47:04.604584 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:47:04.604584 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 12:47:04.605395 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 12:47:04.605395 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:47:04.605395 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 14 12:47:04.607250 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 14/26] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Oct 14 12:47:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:47:04.613458 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f163042-c564-46b7-858a-4723f0293217 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:04.725047 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e1663e-b280-49d7-9eaa-3892ec8a5c38 None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:04.725661 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e1663e-b280-49d7-9eaa-3892ec8a5c38 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:04.726169 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e1663e-b280-49d7-9eaa-3892ec8a5c38 None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:04.727878 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 15/27] 10.222.0.17 () {54 vars in 927 bytes} [Fri Oct 14 12:47:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 14 12:47:04.744052 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a16d270-1c6e-4e87-9333-287dfbf7fabd None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:04.744661 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a16d270-1c6e-4e87-9333-287dfbf7fabd None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:04.745268 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a16d270-1c6e-4e87-9333-287dfbf7fabd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:04.778147 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f163042-c564-46b7-858a-4723f0293217 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:04.779651 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-1a16d270-1c6e-4e87-9333-287dfbf7fabd None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:47:04.781080 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-1a16d270-1c6e-4e87-9333-287dfbf7fabd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:47:04.848291 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff0cb19-5006-45df-973d-c9eb99bdc594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:04.849151 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff0cb19-5006-45df-973d-c9eb99bdc594 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:04.849406 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff0cb19-5006-45df-973d-c9eb99bdc594 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:04.849615 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff0cb19-5006-45df-973d-c9eb99bdc594 None admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:04.850235 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff0cb19-5006-45df-973d-c9eb99bdc594 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:04.850541 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff0cb19-5006-45df-973d-c9eb99bdc594 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:04.853730 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff0cb19-5006-45df-973d-c9eb99bdc594 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:04.878579 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 13/28] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Oct 14 12:47:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:04.879612 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff0cb19-5006-45df-973d-c9eb99bdc594 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:04.888217 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 16/29] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Oct 14 12:47:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 12:47:04.889325 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2977aed-80e8-4926-aa7e-3069dec34724 None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:04.889614 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2977aed-80e8-4926-aa7e-3069dec34724 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:04.889893 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2977aed-80e8-4926-aa7e-3069dec34724 None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:04.891522 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 17/30] 10.222.0.17 () {54 vars in 927 bytes} [Fri Oct 14 12:47:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:47:04.892237 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2977aed-80e8-4926-aa7e-3069dec34724 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:05.011465 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:05.017870 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:05.112607 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff0cb19-5006-45df-973d-c9eb99bdc594 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:05.115256 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2977aed-80e8-4926-aa7e-3069dec34724 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:05.175139 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e05eb5-f6b9-4994-bbed-52e7c146e1f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:05.175775 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e05eb5-f6b9-4994-bbed-52e7c146e1f2 None admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:05.176056 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e05eb5-f6b9-4994-bbed-52e7c146e1f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:05.176338 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e05eb5-f6b9-4994-bbed-52e7c146e1f2 None admin] PATH_INFO: `/v3/projects` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:05.177077 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e05eb5-f6b9-4994-bbed-52e7c146e1f2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:05.178784 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e05eb5-f6b9-4994-bbed-52e7c146e1f2 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:05.185873 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270d940c-55c3-49bc-a0eb-786f834cbbc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:05.188475 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270d940c-55c3-49bc-a0eb-786f834cbbc9 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:05.188844 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270d940c-55c3-49bc-a0eb-786f834cbbc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:05.189358 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270d940c-55c3-49bc-a0eb-786f834cbbc9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:05.205153 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270d940c-55c3-49bc-a0eb-786f834cbbc9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 12:47:05.212145 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-270d940c-55c3-49bc-a0eb-786f834cbbc9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 14 12:47:05.212145 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:47:05.212145 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:47:05.212145 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:47:05.212145 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:47:05.212145 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:47:05.212145 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:47:05.212145 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:47:05.212145 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:47:05.212145 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:47:05.212145 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:47:05.212145 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:47:05.212145 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 12:47:05.212145 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 12:47:05.212145 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 12:47:05.212145 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 12:47:05.213035 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 12:47:05.213035 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 12:47:05.213035 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 12:47:05.213035 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 12:47:05.213035 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:47:05.213035 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:47:05.213035 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:47:05.213035 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:47:05.213035 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:47:05.213035 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:47:05.213035 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:47:05.213035 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 14 12:47:05.213035 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:47:05.213035 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:47:05.213035 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:47:05.213035 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:47:05.213758 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:47:05.213758 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:47:05.213758 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:47:05.213758 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:47:05.213758 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 12:47:05.213758 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 12:47:05.213758 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 12:47:05.213758 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 12:47:05.213758 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 12:47:05.213758 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 12:47:05.213758 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 14 12:47:05.213758 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 14 12:47:05.213758 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 14/31] 10.222.0.17 () {56 vars in 1096 bytes} [Fri Oct 14 12:47:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:47:05.218143 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af3f8ca-b042-4bdc-992b-a4f71bd2bf2b None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:05.218143 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af3f8ca-b042-4bdc-992b-a4f71bd2bf2b None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:05.218143 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af3f8ca-b042-4bdc-992b-a4f71bd2bf2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:05.238322 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-6af3f8ca-b042-4bdc-992b-a4f71bd2bf2b None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:47:05.239625 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-6af3f8ca-b042-4bdc-992b-a4f71bd2bf2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:47:05.320831 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 15/32] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Oct 14 12:47:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 12:47:05.321458 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af3f8ca-b042-4bdc-992b-a4f71bd2bf2b None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:05.353322 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 18/33] 10.222.0.17 () {60 vars in 1141 bytes} [Fri Oct 14 12:47:04 2022] POST /identity/v3/projects => generated 301 bytes in 461 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 12:47:05.354156 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e05eb5-f6b9-4994-bbed-52e7c146e1f2 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:05.385207 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:05.453407 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af3f8ca-b042-4bdc-992b-a4f71bd2bf2b None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:05.490857 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e05eb5-f6b9-4994-bbed-52e7c146e1f2 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:05.496489 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69eeef5d-7fb3-47fb-b7f3-96ef8b710df0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:05.497176 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eeef5d-7fb3-47fb-b7f3-96ef8b710df0 None admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:05.497467 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eeef5d-7fb3-47fb-b7f3-96ef8b710df0 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:05.497803 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eeef5d-7fb3-47fb-b7f3-96ef8b710df0 None admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:05.498604 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69eeef5d-7fb3-47fb-b7f3-96ef8b710df0 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:05.500101 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69eeef5d-7fb3-47fb-b7f3-96ef8b710df0 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:05.522676 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:05.534421 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 16/34] 10.222.0.17 () {60 vars in 1131 bytes} [Fri Oct 14 12:47:05 2022] POST /identity/v3/roles => generated 219 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 12:47:05.554974 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022a4903-10aa-4c0f-a1fa-f08a0d31f5ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:05.556238 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022a4903-10aa-4c0f-a1fa-f08a0d31f5ec None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:05.556756 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022a4903-10aa-4c0f-a1fa-f08a0d31f5ec None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:05.557248 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022a4903-10aa-4c0f-a1fa-f08a0d31f5ec None admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:05.558292 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022a4903-10aa-4c0f-a1fa-f08a0d31f5ec None admin] RBAC: Adding query filter params (name=admin) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:05.558855 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022a4903-10aa-4c0f-a1fa-f08a0d31f5ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:05.561582 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022a4903-10aa-4c0f-a1fa-f08a0d31f5ec None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:05.579289 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 19/35] 10.222.0.17 () {56 vars in 1099 bytes} [Fri Oct 14 12:47:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:05.586991 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69eeef5d-7fb3-47fb-b7f3-96ef8b710df0 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:05.687154 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea8d979-4016-45e8-8f18-7881b270fb20 None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:05.687921 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea8d979-4016-45e8-8f18-7881b270fb20 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:05.688422 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea8d979-4016-45e8-8f18-7881b270fb20 None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:05.690262 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 20/36] 10.222.0.17 () {54 vars in 927 bytes} [Fri Oct 14 12:47:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 14 12:47:05.696984 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e527b1db-1634-4dfa-ad44-3e1d3d576533 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:05.697595 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e527b1db-1634-4dfa-ad44-3e1d3d576533 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:05.698256 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e527b1db-1634-4dfa-ad44-3e1d3d576533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:05.735480 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-e527b1db-1634-4dfa-ad44-3e1d3d576533 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:47:05.737163 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-e527b1db-1634-4dfa-ad44-3e1d3d576533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:47:05.860559 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 21/37] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Oct 14 12:47:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 14 12:47:05.860732 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69eeef5d-7fb3-47fb-b7f3-96ef8b710df0 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:05.862699 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae628c7-1282-4ef3-9c34-ccd85ea3b92c None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:05.863186 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae628c7-1282-4ef3-9c34-ccd85ea3b92c None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:05.863642 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae628c7-1282-4ef3-9c34-ccd85ea3b92c None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:05.865978 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 22/38] 10.222.0.17 () {54 vars in 927 bytes} [Fri Oct 14 12:47:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:47:05.867264 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae628c7-1282-4ef3-9c34-ccd85ea3b92c None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:05.875332 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:05.909241 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79c37cb-0ac2-4cd4-8779-8ac92250dfb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:05.910009 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79c37cb-0ac2-4cd4-8779-8ac92250dfb1 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:05.910330 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79c37cb-0ac2-4cd4-8779-8ac92250dfb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:05.910724 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79c37cb-0ac2-4cd4-8779-8ac92250dfb1 None admin] PATH_INFO: `/v3/users/c832b4bdd0c849fb8bef8d4ac39a8dd6` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:05.912822 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79c37cb-0ac2-4cd4-8779-8ac92250dfb1 None admin] RBAC: Authorizing `identity:get_user(user_id=c832b4bdd0c849fb8bef8d4ac39a8dd6)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:05.914584 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79c37cb-0ac2-4cd4-8779-8ac92250dfb1 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:05.916576 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 17/39] 10.222.0.17 () {56 vars in 1177 bytes} [Fri Oct 14 12:47:05 2022] GET /identity/v3/users/c832b4bdd0c849fb8bef8d4ac39a8dd6 => generated 247 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:05.917641 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6aa505-daae-435f-8432-c9a21f8f0dc8 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:05.917928 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6aa505-daae-435f-8432-c9a21f8f0dc8 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:05.918296 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6aa505-daae-435f-8432-c9a21f8f0dc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:05.941503 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-3b6aa505-daae-435f-8432-c9a21f8f0dc8 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:47:05.943029 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-3b6aa505-daae-435f-8432-c9a21f8f0dc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:47:06.018834 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae628c7-1282-4ef3-9c34-ccd85ea3b92c None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:06.031704 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:06.037918 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 18/40] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Oct 14 12:47:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 12:47:06.047335 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6aa505-daae-435f-8432-c9a21f8f0dc8 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:06.068338 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04eee4c8-2afd-4f92-b9c5-dc9b7ce222a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:06.069402 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eee4c8-2afd-4f92-b9c5-dc9b7ce222a3 None admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:06.070001 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eee4c8-2afd-4f92-b9c5-dc9b7ce222a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:06.070494 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eee4c8-2afd-4f92-b9c5-dc9b7ce222a3 None admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:06.071389 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04eee4c8-2afd-4f92-b9c5-dc9b7ce222a3 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:06.072977 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04eee4c8-2afd-4f92-b9c5-dc9b7ce222a3 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:06.093651 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 23/41] 10.222.0.17 () {60 vars in 1131 bytes} [Fri Oct 14 12:47:05 2022] POST /identity/v3/roles => generated 225 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 12:47:06.151624 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04eee4c8-2afd-4f92-b9c5-dc9b7ce222a3 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:06.198071 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6aa505-daae-435f-8432-c9a21f8f0dc8 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:06.211091 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:06.245676 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcc123d-22db-43a6-9e3f-ff27a87e489b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:06.246903 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcc123d-22db-43a6-9e3f-ff27a87e489b None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:06.247410 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcc123d-22db-43a6-9e3f-ff27a87e489b None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:06.247944 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcc123d-22db-43a6-9e3f-ff27a87e489b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:06.249511 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcc123d-22db-43a6-9e3f-ff27a87e489b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:06.251530 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcc123d-22db-43a6-9e3f-ff27a87e489b None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:06.253661 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 19/42] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Oct 14 12:47:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:06.263758 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcc123d-22db-43a6-9e3f-ff27a87e489b None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:06.292769 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04eee4c8-2afd-4f92-b9c5-dc9b7ce222a3 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:06.343446 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a8ad0f-0abc-49c6-93cf-485ae77ff7a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:06.344116 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a8ad0f-0abc-49c6-93cf-485ae77ff7a4 None admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:06.344402 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a8ad0f-0abc-49c6-93cf-485ae77ff7a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:06.344682 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a8ad0f-0abc-49c6-93cf-485ae77ff7a4 None admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:06.345360 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a8ad0f-0abc-49c6-93cf-485ae77ff7a4 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:06.346828 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a8ad0f-0abc-49c6-93cf-485ae77ff7a4 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:06.365775 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 24/43] 10.222.0.17 () {60 vars in 1131 bytes} [Fri Oct 14 12:47:06 2022] POST /identity/v3/roles => generated 223 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 12:47:06.366968 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a8ad0f-0abc-49c6-93cf-485ae77ff7a4 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:06.405619 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcc123d-22db-43a6-9e3f-ff27a87e489b None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:06.411768 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:06.447743 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c092d1df-b868-4c7e-be04-fdf1cf9be50c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:06.448374 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c092d1df-b868-4c7e-be04-fdf1cf9be50c None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:06.448656 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c092d1df-b868-4c7e-be04-fdf1cf9be50c None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:06.448930 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c092d1df-b868-4c7e-be04-fdf1cf9be50c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:06.449685 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c092d1df-b868-4c7e-be04-fdf1cf9be50c None admin] RBAC: Adding query filter params (role.id=7f6e29e390bc41f7a9af17659a2e95d1, scope.domain.id=default, user.id=c832b4bdd0c849fb8bef8d4ac39a8dd6) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:06.449996 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c092d1df-b868-4c7e-be04-fdf1cf9be50c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:06.452246 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c092d1df-b868-4c7e-be04-fdf1cf9be50c None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:06.460610 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 20/44] 10.222.0.17 () {56 vars in 1322 bytes} [Fri Oct 14 12:47:06 2022] GET /identity/v3/role_assignments?user.id=c832b4bdd0c849fb8bef8d4ac39a8dd6&scope.domain.id=default&role.id=7f6e29e390bc41f7a9af17659a2e95d1 => generated 530 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:06.524700 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a8ad0f-0abc-49c6-93cf-485ae77ff7a4 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:06.570685 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75bb259-79e2-4573-b3af-aff5c6b1a605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:06.571355 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75bb259-79e2-4573-b3af-aff5c6b1a605 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:06.571637 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75bb259-79e2-4573-b3af-aff5c6b1a605 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:06.571916 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75bb259-79e2-4573-b3af-aff5c6b1a605 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:06.573133 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75bb259-79e2-4573-b3af-aff5c6b1a605 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:06.574693 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75bb259-79e2-4573-b3af-aff5c6b1a605 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:06.576342 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 25/45] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Oct 14 12:47:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:06.582269 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c092d1df-b868-4c7e-be04-fdf1cf9be50c None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:06.640044 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:06.705005 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c092d1df-b868-4c7e-be04-fdf1cf9be50c None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:06.739282 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378d187f-1243-4aed-af08-b0e5da16d20b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:06.740137 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378d187f-1243-4aed-af08-b0e5da16d20b None admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:06.740419 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378d187f-1243-4aed-af08-b0e5da16d20b None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:06.740696 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378d187f-1243-4aed-af08-b0e5da16d20b None admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:06.741371 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378d187f-1243-4aed-af08-b0e5da16d20b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:06.742889 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378d187f-1243-4aed-af08-b0e5da16d20b None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:06.773182 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 21/46] 10.222.0.17 () {60 vars in 1141 bytes} [Fri Oct 14 12:47:06 2022] POST /identity/v3/projects => generated 312 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 12:47:08.936479 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcd8d8f-1cd5-4533-a65d-7f5421d3be49 None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:08.937001 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcd8d8f-1cd5-4533-a65d-7f5421d3be49 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:08.937112 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcd8d8f-1cd5-4533-a65d-7f5421d3be49 None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:08.938397 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 26/47] 10.222.0.17 () {54 vars in 927 bytes} [Fri Oct 14 12:47:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:47:08.944612 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea475071-88d5-463c-a9ac-49b6cf3fdf81 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:08.945063 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea475071-88d5-463c-a9ac-49b6cf3fdf81 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:08.945164 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea475071-88d5-463c-a9ac-49b6cf3fdf81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:08.963877 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-ea475071-88d5-463c-a9ac-49b6cf3fdf81 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:47:08.965082 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-ea475071-88d5-463c-a9ac-49b6cf3fdf81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:47:09.033379 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 22/48] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Oct 14 12:47:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 14 12:47:09.302781 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcd8d8f-1cd5-4533-a65d-7f5421d3be49 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:09.399538 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:09.408121 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcd8d8f-1cd5-4533-a65d-7f5421d3be49 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:09.443130 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6d5e0e-a85f-44f7-b196-b38f37220e88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:09.443771 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6d5e0e-a85f-44f7-b196-b38f37220e88 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:09.444050 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6d5e0e-a85f-44f7-b196-b38f37220e88 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:09.444329 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6d5e0e-a85f-44f7-b196-b38f37220e88 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:09.445511 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6d5e0e-a85f-44f7-b196-b38f37220e88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:09.447021 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6d5e0e-a85f-44f7-b196-b38f37220e88 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:09.448622 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 27/49] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Oct 14 12:47:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:09.454597 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea475071-88d5-463c-a9ac-49b6cf3fdf81 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:09.478381 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:09.556821 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea475071-88d5-463c-a9ac-49b6cf3fdf81 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:09.592298 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4703fde3-349f-4063-b6ae-7a8e98f24106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:09.592916 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4703fde3-349f-4063-b6ae-7a8e98f24106 None admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:09.593199 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4703fde3-349f-4063-b6ae-7a8e98f24106 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:09.593483 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4703fde3-349f-4063-b6ae-7a8e98f24106 None admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:09.594174 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4703fde3-349f-4063-b6ae-7a8e98f24106 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:09.595644 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4703fde3-349f-4063-b6ae-7a8e98f24106 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:09.623769 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 23/50] 10.222.0.17 () {60 vars in 1140 bytes} [Fri Oct 14 12:47:09 2022] POST /identity/v3/projects => generated 298 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 12:47:11.820194 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f6a1ae-6d8d-4acc-8ea7-289fda2dfc9a None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:11.820749 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f6a1ae-6d8d-4acc-8ea7-289fda2dfc9a None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:11.820749 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f6a1ae-6d8d-4acc-8ea7-289fda2dfc9a None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:11.822077 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 28/51] 10.222.0.17 () {54 vars in 927 bytes} [Fri Oct 14 12:47:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:47:11.827825 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac77bd7-129a-4585-b0ee-14efa6118281 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:11.828286 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac77bd7-129a-4585-b0ee-14efa6118281 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:11.828372 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac77bd7-129a-4585-b0ee-14efa6118281 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:11.846772 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-5ac77bd7-129a-4585-b0ee-14efa6118281 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:47:11.847994 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-5ac77bd7-129a-4585-b0ee-14efa6118281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:47:11.917377 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 24/52] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Oct 14 12:47:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 12:47:12.185658 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f6a1ae-6d8d-4acc-8ea7-289fda2dfc9a None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:12.296828 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f6a1ae-6d8d-4acc-8ea7-289fda2dfc9a None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:12.331202 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093b2d34-efd9-4d2d-98b9-e60b64f8ced4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:12.331836 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093b2d34-efd9-4d2d-98b9-e60b64f8ced4 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:12.332117 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093b2d34-efd9-4d2d-98b9-e60b64f8ced4 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:12.332394 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093b2d34-efd9-4d2d-98b9-e60b64f8ced4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:12.334548 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093b2d34-efd9-4d2d-98b9-e60b64f8ced4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:12.336016 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093b2d34-efd9-4d2d-98b9-e60b64f8ced4 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:12.337592 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 29/53] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Oct 14 12:47:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:12.343412 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac77bd7-129a-4585-b0ee-14efa6118281 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:12.346616 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:12.446971 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac77bd7-129a-4585-b0ee-14efa6118281 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:12.482739 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa97964-66e4-4d84-9f3e-e2b838025cb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:12.483613 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa97964-66e4-4d84-9f3e-e2b838025cb2 None admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:12.483896 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa97964-66e4-4d84-9f3e-e2b838025cb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:12.484178 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa97964-66e4-4d84-9f3e-e2b838025cb2 None admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:12.484833 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa97964-66e4-4d84-9f3e-e2b838025cb2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:12.486325 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa97964-66e4-4d84-9f3e-e2b838025cb2 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:12.514995 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 25/54] 10.222.0.17 () {60 vars in 1132 bytes} [Fri Oct 14 12:47:12 2022] POST /identity/v3/users => generated 275 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 12:47:15.798739 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e715e0-1ed8-4dc2-bee0-3884454beb60 None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:15.799758 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e715e0-1ed8-4dc2-bee0-3884454beb60 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:15.800303 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e715e0-1ed8-4dc2-bee0-3884454beb60 None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:15.801940 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 30/55] 10.222.0.17 () {54 vars in 927 bytes} [Fri Oct 14 12:47:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:47:15.813419 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b81dee-ee93-494c-bd53-7e6b52695371 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:15.814413 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b81dee-ee93-494c-bd53-7e6b52695371 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:15.814892 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b81dee-ee93-494c-bd53-7e6b52695371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:15.843749 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-a5b81dee-ee93-494c-bd53-7e6b52695371 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:47:15.844984 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-a5b81dee-ee93-494c-bd53-7e6b52695371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:47:15.920106 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:15.933696 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 26/56] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Oct 14 12:47:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 14 12:47:16.113707 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0bd893-85b2-40a5-ac8b-8bbe06febe97 None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:16.113995 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0bd893-85b2-40a5-ac8b-8bbe06febe97 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:16.114346 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0bd893-85b2-40a5-ac8b-8bbe06febe97 None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:16.115954 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 31/57] 10.222.0.17 () {54 vars in 927 bytes} [Fri Oct 14 12:47:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:47:16.121543 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd16e73-fdf2-4051-af4a-c4d8a5460630 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:16.121837 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd16e73-fdf2-4051-af4a-c4d8a5460630 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:16.122139 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd16e73-fdf2-4051-af4a-c4d8a5460630 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:16.127404 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eda66a-34e8-4806-99e5-cfdf33390910 None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:16.127948 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eda66a-34e8-4806-99e5-cfdf33390910 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:16.128457 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eda66a-34e8-4806-99e5-cfdf33390910 None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:16.130050 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 32/58] 10.222.0.17 () {54 vars in 927 bytes} [Fri Oct 14 12:47:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 14 12:47:16.142788 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-6bd16e73-fdf2-4051-af4a-c4d8a5460630 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:47:16.144011 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-6bd16e73-fdf2-4051-af4a-c4d8a5460630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:47:16.148734 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5789bca5-878b-4b80-93cf-3b977c70837f None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:16.149332 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5789bca5-878b-4b80-93cf-3b977c70837f None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:16.149822 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5789bca5-878b-4b80-93cf-3b977c70837f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:16.239569 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 27/59] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Oct 14 12:47:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 12:47:16.288460 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd16e73-fdf2-4051-af4a-c4d8a5460630 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:16.309502 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-5789bca5-878b-4b80-93cf-3b977c70837f None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:47:16.312299 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-5789bca5-878b-4b80-93cf-3b977c70837f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:47:16.343023 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:16.396621 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 33/60] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Oct 14 12:47:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 12:47:16.425855 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd16e73-fdf2-4051-af4a-c4d8a5460630 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:16.448711 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:16.469611 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d1b0be-e467-47cb-84a1-3223ef310583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:16.470307 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d1b0be-e467-47cb-84a1-3223ef310583 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:16.470595 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d1b0be-e467-47cb-84a1-3223ef310583 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:16.470874 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d1b0be-e467-47cb-84a1-3223ef310583 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:16.483473 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d1b0be-e467-47cb-84a1-3223ef310583 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 12:47:16.488778 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-66d1b0be-e467-47cb-84a1-3223ef310583 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 14 12:47:16.488778 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:47:16.488778 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:47:16.488778 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:47:16.488778 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:47:16.488778 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:47:16.488778 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:47:16.488778 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:47:16.488778 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:47:16.488778 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:47:16.488778 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:47:16.488778 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:47:16.488778 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 12:47:16.488778 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 12:47:16.488778 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 12:47:16.488778 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 12:47:16.489716 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 12:47:16.489716 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 12:47:16.489716 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 12:47:16.489716 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 12:47:16.489716 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:47:16.489716 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:47:16.489716 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:47:16.489716 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:47:16.489716 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:47:16.489716 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:47:16.489716 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:47:16.489716 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 14 12:47:16.489716 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:47:16.489716 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:47:16.489716 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:47:16.489716 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:47:16.490489 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:47:16.490489 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:47:16.490489 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:47:16.490489 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:47:16.490489 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 12:47:16.490489 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 12:47:16.490489 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 12:47:16.490489 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 12:47:16.490489 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 12:47:16.490489 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 12:47:16.490489 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 14 12:47:16.490489 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 14 12:47:16.490489 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 28/61] 10.222.0.17 () {56 vars in 1099 bytes} [Fri Oct 14 12:47:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 14 12:47:16.497965 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5789bca5-878b-4b80-93cf-3b977c70837f None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:16.558445 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be80e2a-7524-4943-b0f7-0a6131f9c5b0 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:16.558806 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be80e2a-7524-4943-b0f7-0a6131f9c5b0 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:16.559006 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be80e2a-7524-4943-b0f7-0a6131f9c5b0 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:16.560407 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 29/62] 10.222.0.17 () {54 vars in 927 bytes} [Fri Oct 14 12:47:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:47:16.571665 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b72a4a-7a78-45fc-be8e-7961586338f2 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:16.571964 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b72a4a-7a78-45fc-be8e-7961586338f2 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:16.572219 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b72a4a-7a78-45fc-be8e-7961586338f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:16.597563 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-67b72a4a-7a78-45fc-be8e-7961586338f2 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:47:16.598868 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-67b72a4a-7a78-45fc-be8e-7961586338f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:47:16.614810 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5789bca5-878b-4b80-93cf-3b977c70837f None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:16.654654 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2db0f0-af30-4a2e-9d2d-d5d65b57ffb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:16.655692 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2db0f0-af30-4a2e-9d2d-d5d65b57ffb1 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:16.656166 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2db0f0-af30-4a2e-9d2d-d5d65b57ffb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:16.656639 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2db0f0-af30-4a2e-9d2d-d5d65b57ffb1 None admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:16.657609 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2db0f0-af30-4a2e-9d2d-d5d65b57ffb1 None admin] RBAC: Adding query filter params (name=member) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:16.658107 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2db0f0-af30-4a2e-9d2d-d5d65b57ffb1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:16.660061 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2db0f0-af30-4a2e-9d2d-d5d65b57ffb1 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:16.670174 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 34/63] 10.222.0.17 () {56 vars in 1101 bytes} [Fri Oct 14 12:47:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:16.675961 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2db0f0-af30-4a2e-9d2d-d5d65b57ffb1 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:16.680964 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 30/64] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Oct 14 12:47:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 14 12:47:16.681358 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b72a4a-7a78-45fc-be8e-7961586338f2 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:16.704099 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:16.787775 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2db0f0-af30-4a2e-9d2d-d5d65b57ffb1 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:16.797189 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b72a4a-7a78-45fc-be8e-7961586338f2 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:16.809501 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:16.828646 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c35a57-5723-46c6-ade7-0091d1110137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:16.829302 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c35a57-5723-46c6-ade7-0091d1110137 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:16.829572 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c35a57-5723-46c6-ade7-0091d1110137 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:16.829835 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c35a57-5723-46c6-ade7-0091d1110137 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:16.835556 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644af6bc-0f6b-45a5-9949-d605b6a0a23f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:16.836484 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644af6bc-0f6b-45a5-9949-d605b6a0a23f None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:16.836790 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644af6bc-0f6b-45a5-9949-d605b6a0a23f None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:16.837088 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644af6bc-0f6b-45a5-9949-d605b6a0a23f None admin] PATH_INFO: `/v3/users/bb38b29e9ad84f16b142b35dfce4e938` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:16.842927 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c35a57-5723-46c6-ade7-0091d1110137 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 12:47:16.849785 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-53c35a57-5723-46c6-ade7-0091d1110137 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 14 12:47:16.849785 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:47:16.849785 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:47:16.849785 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:47:16.849785 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:47:16.849785 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:47:16.849785 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:47:16.849785 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:47:16.849785 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:47:16.849785 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:47:16.849785 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:47:16.849785 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:47:16.849785 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 12:47:16.849785 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 12:47:16.849785 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 12:47:16.849785 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 12:47:16.850860 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 12:47:16.850860 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 12:47:16.850860 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 12:47:16.850860 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 12:47:16.850860 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:47:16.850860 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:47:16.850860 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:47:16.850860 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:47:16.850860 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:47:16.850860 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:47:16.850860 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:47:16.850860 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 14 12:47:16.850860 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:47:16.850860 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:47:16.850860 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:47:16.850860 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:47:16.851589 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:47:16.851589 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:47:16.851589 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:47:16.851589 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:47:16.851589 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 12:47:16.851589 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 12:47:16.851589 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 12:47:16.851589 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 12:47:16.851589 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 12:47:16.851589 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 12:47:16.851589 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 14 12:47:16.851589 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 14 12:47:16.852836 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 35/65] 10.222.0.17 () {56 vars in 1114 bytes} [Fri Oct 14 12:47:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:47:16.854111 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055162ee-8859-4b61-804c-24b3dbc76535 None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:16.854438 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055162ee-8859-4b61-804c-24b3dbc76535 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:16.854710 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055162ee-8859-4b61-804c-24b3dbc76535 None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:16.855966 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 36/66] 10.222.0.17 () {54 vars in 927 bytes} [Fri Oct 14 12:47:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:47:16.856913 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055162ee-8859-4b61-804c-24b3dbc76535 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:16.858600 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644af6bc-0f6b-45a5-9949-d605b6a0a23f None admin] RBAC: Authorizing `identity:get_user(user_id=bb38b29e9ad84f16b142b35dfce4e938)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:16.860110 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644af6bc-0f6b-45a5-9949-d605b6a0a23f None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:16.862092 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 31/67] 10.222.0.17 () {56 vars in 1177 bytes} [Fri Oct 14 12:47:16 2022] GET /identity/v3/users/bb38b29e9ad84f16b142b35dfce4e938 => generated 275 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:16.862821 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644af6bc-0f6b-45a5-9949-d605b6a0a23f None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:16.967262 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:16.979134 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644af6bc-0f6b-45a5-9949-d605b6a0a23f None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:16.986542 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055162ee-8859-4b61-804c-24b3dbc76535 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:17.014264 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f470fdc-aeb8-41d4-8e55-dbd0077c8bba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:17.014873 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f470fdc-aeb8-41d4-8e55-dbd0077c8bba None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:17.015153 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f470fdc-aeb8-41d4-8e55-dbd0077c8bba None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:17.015424 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f470fdc-aeb8-41d4-8e55-dbd0077c8bba None admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:17.016088 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f470fdc-aeb8-41d4-8e55-dbd0077c8bba None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:17.016400 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f470fdc-aeb8-41d4-8e55-dbd0077c8bba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:17.017779 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f470fdc-aeb8-41d4-8e55-dbd0077c8bba None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:17.022258 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35c5197-c79d-4bf6-8b7e-1264bcae1c7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:17.023329 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35c5197-c79d-4bf6-8b7e-1264bcae1c7c None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:17.023613 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35c5197-c79d-4bf6-8b7e-1264bcae1c7c None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:17.024035 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35c5197-c79d-4bf6-8b7e-1264bcae1c7c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:17.025694 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 32/68] 10.222.0.17 () {56 vars in 1111 bytes} [Fri Oct 14 12:47:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:17.027024 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c0f09f-25a9-472c-bbe0-ff9c808f3a59 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:17.027320 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c0f09f-25a9-472c-bbe0-ff9c808f3a59 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:17.027596 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c0f09f-25a9-472c-bbe0-ff9c808f3a59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:17.035391 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35c5197-c79d-4bf6-8b7e-1264bcae1c7c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 12:47:17.040537 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-b35c5197-c79d-4bf6-8b7e-1264bcae1c7c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 14 12:47:17.040537 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:47:17.040537 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:47:17.040537 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:47:17.040537 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:47:17.040537 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:47:17.040537 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:47:17.040537 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:47:17.040537 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:47:17.040537 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:47:17.040537 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:47:17.040537 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:47:17.040537 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 12:47:17.040537 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 12:47:17.040537 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 12:47:17.040537 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 12:47:17.041370 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 12:47:17.041370 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 12:47:17.041370 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 12:47:17.041370 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 12:47:17.041370 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:47:17.041370 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:47:17.041370 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:47:17.041370 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:47:17.041370 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:47:17.041370 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:47:17.041370 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:47:17.041370 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 14 12:47:17.041370 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:47:17.041370 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:47:17.041370 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:47:17.041370 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:47:17.042196 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:47:17.042196 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:47:17.042196 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:47:17.042196 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:47:17.042196 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 12:47:17.042196 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 12:47:17.042196 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 12:47:17.042196 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 12:47:17.042196 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 12:47:17.042196 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 12:47:17.042196 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 14 12:47:17.042196 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 14 12:47:17.042196 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 37/69] 10.222.0.17 () {56 vars in 1096 bytes} [Fri Oct 14 12:47:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:47:17.042953 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35c5197-c79d-4bf6-8b7e-1264bcae1c7c None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:17.046408 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-d0c0f09f-25a9-472c-bbe0-ff9c808f3a59 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:47:17.047845 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-d0c0f09f-25a9-472c-bbe0-ff9c808f3a59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:47:17.072600 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:17.120272 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 33/70] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Oct 14 12:47:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 12:47:17.121128 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c0f09f-25a9-472c-bbe0-ff9c808f3a59 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:17.148680 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35c5197-c79d-4bf6-8b7e-1264bcae1c7c None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:17.183292 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4e3ab5-abc8-41bc-aece-c0d7b930d14a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:17.183923 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4e3ab5-abc8-41bc-aece-c0d7b930d14a None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:17.184212 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4e3ab5-abc8-41bc-aece-c0d7b930d14a None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:17.184491 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4e3ab5-abc8-41bc-aece-c0d7b930d14a None admin] PATH_INFO: `/v3/projects/bb069426c7f5452ebe72633778574267` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:17.185641 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4e3ab5-abc8-41bc-aece-c0d7b930d14a None admin] RBAC: Authorizing `identity:get_project(project_id=bb069426c7f5452ebe72633778574267)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:17.187374 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4e3ab5-abc8-41bc-aece-c0d7b930d14a None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:17.189369 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 38/71] 10.222.0.17 () {56 vars in 1186 bytes} [Fri Oct 14 12:47:17 2022] GET /identity/v3/projects/bb069426c7f5452ebe72633778574267 => generated 298 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:17.190156 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4e3ab5-abc8-41bc-aece-c0d7b930d14a None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:17.206548 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:17.254451 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c0f09f-25a9-472c-bbe0-ff9c808f3a59 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:17.303706 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3baaa5a-c3e3-4167-b474-e56c6e5e87a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:17.304583 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3baaa5a-c3e3-4167-b474-e56c6e5e87a5 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:17.305006 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3baaa5a-c3e3-4167-b474-e56c6e5e87a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:17.305424 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3baaa5a-c3e3-4167-b474-e56c6e5e87a5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:17.317087 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3baaa5a-c3e3-4167-b474-e56c6e5e87a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 12:47:17.321581 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4e3ab5-abc8-41bc-aece-c0d7b930d14a None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:17.322759 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-a3baaa5a-c3e3-4167-b474-e56c6e5e87a5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 14 12:47:17.322759 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:47:17.322759 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:47:17.322759 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:47:17.322759 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:47:17.322759 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:47:17.322759 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:47:17.322759 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:47:17.322759 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:47:17.322759 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:47:17.322759 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:47:17.322759 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:47:17.322759 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 12:47:17.322759 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 12:47:17.322759 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 12:47:17.322759 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 12:47:17.323647 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 12:47:17.323647 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 12:47:17.323647 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 12:47:17.323647 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 12:47:17.323647 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:47:17.323647 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:47:17.323647 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:47:17.323647 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:47:17.323647 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:47:17.323647 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:47:17.323647 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:47:17.323647 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 14 12:47:17.323647 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:47:17.323647 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:47:17.323647 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:47:17.323647 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:47:17.324384 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:47:17.324384 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:47:17.324384 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:47:17.324384 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:47:17.324384 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 12:47:17.324384 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 12:47:17.324384 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 12:47:17.324384 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 12:47:17.324384 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 12:47:17.324384 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 12:47:17.324384 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 14 12:47:17.324384 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 14 12:47:17.326455 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 34/72] 10.222.0.17 () {56 vars in 1099 bytes} [Fri Oct 14 12:47:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:47:17.331288 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3baaa5a-c3e3-4167-b474-e56c6e5e87a5 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:17.355599 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:17.368959 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90b9297-3159-41c2-9c96-59b9be0c4643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:17.369619 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90b9297-3159-41c2-9c96-59b9be0c4643 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:17.369908 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90b9297-3159-41c2-9c96-59b9be0c4643 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:17.370207 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90b9297-3159-41c2-9c96-59b9be0c4643 None admin] PATH_INFO: `/v3/users/bb38b29e9ad84f16b142b35dfce4e938` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:17.371731 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90b9297-3159-41c2-9c96-59b9be0c4643 None admin] RBAC: Authorizing `identity:get_user(user_id=bb38b29e9ad84f16b142b35dfce4e938)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:17.373223 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90b9297-3159-41c2-9c96-59b9be0c4643 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:17.374908 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 39/73] 10.222.0.17 () {56 vars in 1177 bytes} [Fri Oct 14 12:47:17 2022] GET /identity/v3/users/bb38b29e9ad84f16b142b35dfce4e938 => generated 275 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:17.375665 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90b9297-3159-41c2-9c96-59b9be0c4643 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:17.465724 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:17.479318 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3baaa5a-c3e3-4167-b474-e56c6e5e87a5 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:17.491801 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90b9297-3159-41c2-9c96-59b9be0c4643 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:17.525364 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88149a66-156d-4666-a916-3b2676404183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:17.525889 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88149a66-156d-4666-a916-3b2676404183 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:17.526054 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8313fc7-bed0-402a-9b53-c2999b9b2b1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:17.526208 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88149a66-156d-4666-a916-3b2676404183 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:17.526464 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88149a66-156d-4666-a916-3b2676404183 None admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:17.526743 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8313fc7-bed0-402a-9b53-c2999b9b2b1a None admin] REQUEST_METHOD: `PUT` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:17.527019 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8313fc7-bed0-402a-9b53-c2999b9b2b1a None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:17.527156 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88149a66-156d-4666-a916-3b2676404183 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:17.527307 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8313fc7-bed0-402a-9b53-c2999b9b2b1a None admin] PATH_INFO: `/v3/projects/bb069426c7f5452ebe72633778574267/users/bb38b29e9ad84f16b142b35dfce4e938/roles/5e8849303a75425b9eaa2681cc031af1` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:17.527449 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88149a66-156d-4666-a916-3b2676404183 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:17.528862 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88149a66-156d-4666-a916-3b2676404183 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:17.529461 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8313fc7-bed0-402a-9b53-c2999b9b2b1a None admin] RBAC: Authorizing `identity:create_grant(project_id=bb069426c7f5452ebe72633778574267, user_id=bb38b29e9ad84f16b142b35dfce4e938, role_id=5e8849303a75425b9eaa2681cc031af1)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:17.531030 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8313fc7-bed0-402a-9b53-c2999b9b2b1a None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:17.539447 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 35/74] 10.222.0.17 () {56 vars in 1099 bytes} [Fri Oct 14 12:47:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:17.540161 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88149a66-156d-4666-a916-3b2676404183 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:17.549255 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 40/75] 10.222.0.17 () {58 vars in 1439 bytes} [Fri Oct 14 12:47:17 2022] PUT /identity/v3/projects/bb069426c7f5452ebe72633778574267/users/bb38b29e9ad84f16b142b35dfce4e938/roles/5e8849303a75425b9eaa2681cc031af1 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 12:47:17.550537 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8313fc7-bed0-402a-9b53-c2999b9b2b1a None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:17.659324 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:17.683585 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8313fc7-bed0-402a-9b53-c2999b9b2b1a None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:17.686097 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88149a66-156d-4666-a916-3b2676404183 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:17.723272 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99401674-e9a9-46b2-95de-ab6690fdc13e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:17.724675 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99401674-e9a9-46b2-95de-ab6690fdc13e None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:17.725448 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99401674-e9a9-46b2-95de-ab6690fdc13e None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:17.725735 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99401674-e9a9-46b2-95de-ab6690fdc13e None admin] PATH_INFO: `/v3/projects/bb069426c7f5452ebe72633778574267` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:17.725831 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af5f40c-8854-4dc6-b35a-2985e84eab32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:17.726439 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af5f40c-8854-4dc6-b35a-2985e84eab32 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:17.726716 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af5f40c-8854-4dc6-b35a-2985e84eab32 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:17.726987 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af5f40c-8854-4dc6-b35a-2985e84eab32 None admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:17.727091 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99401674-e9a9-46b2-95de-ab6690fdc13e None admin] RBAC: Authorizing `identity:get_project(project_id=bb069426c7f5452ebe72633778574267)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:17.727656 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af5f40c-8854-4dc6-b35a-2985e84eab32 None admin] RBAC: Adding query filter params (name=member) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:17.727969 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af5f40c-8854-4dc6-b35a-2985e84eab32 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:17.728457 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99401674-e9a9-46b2-95de-ab6690fdc13e None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:17.729332 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af5f40c-8854-4dc6-b35a-2985e84eab32 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:17.730303 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 41/76] 10.222.0.17 () {56 vars in 1186 bytes} [Fri Oct 14 12:47:17 2022] GET /identity/v3/projects/bb069426c7f5452ebe72633778574267 => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:17.731015 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99401674-e9a9-46b2-95de-ab6690fdc13e None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:17.741468 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:17.748185 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 36/77] 10.222.0.17 () {56 vars in 1101 bytes} [Fri Oct 14 12:47:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:17.749518 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af5f40c-8854-4dc6-b35a-2985e84eab32 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:17.857716 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99401674-e9a9-46b2-95de-ab6690fdc13e None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:17.889525 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af5f40c-8854-4dc6-b35a-2985e84eab32 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:17.900796 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07848336-22f2-4711-9750-c7e93d754728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:17.901568 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07848336-22f2-4711-9750-c7e93d754728 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:17.901861 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07848336-22f2-4711-9750-c7e93d754728 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:17.902506 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07848336-22f2-4711-9750-c7e93d754728 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:17.903449 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07848336-22f2-4711-9750-c7e93d754728 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:17.905036 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07848336-22f2-4711-9750-c7e93d754728 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:17.910247 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 42/78] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Oct 14 12:47:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:17.910247 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07848336-22f2-4711-9750-c7e93d754728 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:17.932804 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0666718d-1bdf-4009-949f-c0d48670786b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:17.933449 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0666718d-1bdf-4009-949f-c0d48670786b None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:17.933728 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0666718d-1bdf-4009-949f-c0d48670786b None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:17.934084 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0666718d-1bdf-4009-949f-c0d48670786b None admin] PATH_INFO: `/v3/users/c832b4bdd0c849fb8bef8d4ac39a8dd6` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:17.935654 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0666718d-1bdf-4009-949f-c0d48670786b None admin] RBAC: Authorizing `identity:get_user(user_id=c832b4bdd0c849fb8bef8d4ac39a8dd6)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:17.937145 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0666718d-1bdf-4009-949f-c0d48670786b None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:17.938799 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 37/79] 10.222.0.17 () {56 vars in 1177 bytes} [Fri Oct 14 12:47:17 2022] GET /identity/v3/users/c832b4bdd0c849fb8bef8d4ac39a8dd6 => generated 247 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:17.939576 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0666718d-1bdf-4009-949f-c0d48670786b None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:17.956745 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:18.002749 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:18.031871 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07848336-22f2-4711-9750-c7e93d754728 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:18.048614 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0666718d-1bdf-4009-949f-c0d48670786b None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:18.071445 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb280136-89a4-49fc-b6f9-b28599e0fc3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:18.072173 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb280136-89a4-49fc-b6f9-b28599e0fc3b None admin] REQUEST_METHOD: `PUT` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:18.072458 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb280136-89a4-49fc-b6f9-b28599e0fc3b None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:18.072853 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb280136-89a4-49fc-b6f9-b28599e0fc3b None admin] PATH_INFO: `/v3/projects/bb069426c7f5452ebe72633778574267/users/bb38b29e9ad84f16b142b35dfce4e938/roles/251e12cde1564a10b367cc385e58b828` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:18.075262 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb280136-89a4-49fc-b6f9-b28599e0fc3b None admin] RBAC: Authorizing `identity:create_grant(project_id=bb069426c7f5452ebe72633778574267, user_id=bb38b29e9ad84f16b142b35dfce4e938, role_id=251e12cde1564a10b367cc385e58b828)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:18.077092 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb280136-89a4-49fc-b6f9-b28599e0fc3b None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:18.086303 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a7d9dc-d0cb-457d-bd43-639eadbec4d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:18.086303 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a7d9dc-d0cb-457d-bd43-639eadbec4d9 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:18.086303 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a7d9dc-d0cb-457d-bd43-639eadbec4d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:18.086625 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a7d9dc-d0cb-457d-bd43-639eadbec4d9 None admin] PATH_INFO: `/v3/users/bb38b29e9ad84f16b142b35dfce4e938` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:18.089423 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a7d9dc-d0cb-457d-bd43-639eadbec4d9 None admin] RBAC: Authorizing `identity:get_user(user_id=bb38b29e9ad84f16b142b35dfce4e938)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:18.089423 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a7d9dc-d0cb-457d-bd43-639eadbec4d9 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:18.090629 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 38/80] 10.222.0.17 () {56 vars in 1177 bytes} [Fri Oct 14 12:47:17 2022] GET /identity/v3/users/bb38b29e9ad84f16b142b35dfce4e938 => generated 275 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:18.091390 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a7d9dc-d0cb-457d-bd43-639eadbec4d9 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:18.096181 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 43/81] 10.222.0.17 () {58 vars in 1439 bytes} [Fri Oct 14 12:47:17 2022] PUT /identity/v3/projects/bb069426c7f5452ebe72633778574267/users/bb38b29e9ad84f16b142b35dfce4e938/roles/251e12cde1564a10b367cc385e58b828 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 12:47:18.097299 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb280136-89a4-49fc-b6f9-b28599e0fc3b None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:18.215380 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:18.241090 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a7d9dc-d0cb-457d-bd43-639eadbec4d9 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:18.258312 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb280136-89a4-49fc-b6f9-b28599e0fc3b None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:18.291359 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1727d99b-a1de-4e09-913f-fbf0af19b1cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:18.291996 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1727d99b-a1de-4e09-913f-fbf0af19b1cf None admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:18.292278 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1727d99b-a1de-4e09-913f-fbf0af19b1cf None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:18.292549 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1727d99b-a1de-4e09-913f-fbf0af19b1cf None admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:18.293371 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1727d99b-a1de-4e09-913f-fbf0af19b1cf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:18.294891 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1727d99b-a1de-4e09-913f-fbf0af19b1cf None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:18.309853 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d12c96-e853-4d8c-ab8c-e6b9d9f1e771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:18.310639 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d12c96-e853-4d8c-ab8c-e6b9d9f1e771 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:18.311024 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d12c96-e853-4d8c-ab8c-e6b9d9f1e771 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:18.311332 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d12c96-e853-4d8c-ab8c-e6b9d9f1e771 None admin] PATH_INFO: `/v3/projects/bb069426c7f5452ebe72633778574267` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:18.312671 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d12c96-e853-4d8c-ab8c-e6b9d9f1e771 None admin] RBAC: Authorizing `identity:get_project(project_id=bb069426c7f5452ebe72633778574267)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:18.314314 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d12c96-e853-4d8c-ab8c-e6b9d9f1e771 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:18.315965 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 44/82] 10.222.0.17 () {56 vars in 1186 bytes} [Fri Oct 14 12:47:18 2022] GET /identity/v3/projects/bb069426c7f5452ebe72633778574267 => generated 298 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:18.316972 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d12c96-e853-4d8c-ab8c-e6b9d9f1e771 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:18.320621 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:18.325273 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 39/83] 10.222.0.17 () {60 vars in 1132 bytes} [Fri Oct 14 12:47:18 2022] POST /identity/v3/users => generated 289 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 12:47:18.326792 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1727d99b-a1de-4e09-913f-fbf0af19b1cf None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:18.457298 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d12c96-e853-4d8c-ab8c-e6b9d9f1e771 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:18.479050 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1727d99b-a1de-4e09-913f-fbf0af19b1cf None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:18.503348 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb8911b-688d-4892-a478-d1577ad8c86e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:18.504141 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb8911b-688d-4892-a478-d1577ad8c86e None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:18.504504 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb8911b-688d-4892-a478-d1577ad8c86e None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:18.504925 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb8911b-688d-4892-a478-d1577ad8c86e None admin] PATH_INFO: `/v3/projects/86b6df3329824442963df485b1348816` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:18.506447 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb8911b-688d-4892-a478-d1577ad8c86e None admin] RBAC: Authorizing `identity:get_project(project_id=86b6df3329824442963df485b1348816)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:18.508081 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb8911b-688d-4892-a478-d1577ad8c86e None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:18.510404 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 45/84] 10.222.0.17 () {56 vars in 1186 bytes} [Fri Oct 14 12:47:18 2022] GET /identity/v3/projects/86b6df3329824442963df485b1348816 => generated 312 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:18.516676 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb8911b-688d-4892-a478-d1577ad8c86e None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:18.535880 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0988bacc-429b-4011-9aa6-68f9c5eb5e79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:18.537332 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0988bacc-429b-4011-9aa6-68f9c5eb5e79 None admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:18.537762 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0988bacc-429b-4011-9aa6-68f9c5eb5e79 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:18.538401 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0988bacc-429b-4011-9aa6-68f9c5eb5e79 None admin] PATH_INFO: `/v3/projects/bb069426c7f5452ebe72633778574267/users/c832b4bdd0c849fb8bef8d4ac39a8dd6/roles/7f6e29e390bc41f7a9af17659a2e95d1` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:18.541067 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0988bacc-429b-4011-9aa6-68f9c5eb5e79 None admin] RBAC: Authorizing `identity:create_grant(project_id=bb069426c7f5452ebe72633778574267, user_id=c832b4bdd0c849fb8bef8d4ac39a8dd6, role_id=7f6e29e390bc41f7a9af17659a2e95d1)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:18.543378 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0988bacc-429b-4011-9aa6-68f9c5eb5e79 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:18.548771 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:18.568307 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 40/85] 10.222.0.17 () {58 vars in 1439 bytes} [Fri Oct 14 12:47:18 2022] PUT /identity/v3/projects/bb069426c7f5452ebe72633778574267/users/c832b4bdd0c849fb8bef8d4ac39a8dd6/roles/7f6e29e390bc41f7a9af17659a2e95d1 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 12:47:18.606516 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:18.642209 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb8911b-688d-4892-a478-d1577ad8c86e None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:18.680792 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9dfb73-1a64-40e4-8a9a-7d6269201bfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:18.681470 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9dfb73-1a64-40e4-8a9a-7d6269201bfc None admin] REQUEST_METHOD: `PUT` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:18.681765 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9dfb73-1a64-40e4-8a9a-7d6269201bfc None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:18.682073 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9dfb73-1a64-40e4-8a9a-7d6269201bfc None admin] PATH_INFO: `/v3/projects/86b6df3329824442963df485b1348816/users/bb38b29e9ad84f16b142b35dfce4e938/roles/5e8849303a75425b9eaa2681cc031af1` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:18.684141 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9dfb73-1a64-40e4-8a9a-7d6269201bfc None admin] RBAC: Authorizing `identity:create_grant(project_id=86b6df3329824442963df485b1348816, user_id=bb38b29e9ad84f16b142b35dfce4e938, role_id=5e8849303a75425b9eaa2681cc031af1)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:18.685642 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9dfb73-1a64-40e4-8a9a-7d6269201bfc None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:18.704909 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 46/86] 10.222.0.17 () {58 vars in 1439 bytes} [Fri Oct 14 12:47:18 2022] PUT /identity/v3/projects/86b6df3329824442963df485b1348816/users/bb38b29e9ad84f16b142b35dfce4e938/roles/5e8849303a75425b9eaa2681cc031af1 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 12:47:19.986952 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7b9f48-dd1e-441d-863d-25e99360dd71 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:19.987457 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7b9f48-dd1e-441d-863d-25e99360dd71 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:19.987900 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7b9f48-dd1e-441d-863d-25e99360dd71 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:19.990913 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 41/87] 10.222.0.17 () {54 vars in 927 bytes} [Fri Oct 14 12:47:19 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:47:19.996757 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb3e52c-9da8-4e29-b9f1-e3191d79fcb0 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:19.997228 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb3e52c-9da8-4e29-b9f1-e3191d79fcb0 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:19.997299 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb3e52c-9da8-4e29-b9f1-e3191d79fcb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:20.016858 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-1cb3e52c-9da8-4e29-b9f1-e3191d79fcb0 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:47:20.018090 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-1cb3e52c-9da8-4e29-b9f1-e3191d79fcb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:47:20.094232 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 47/88] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Oct 14 12:47:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 12:47:20.396631 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7b9f48-dd1e-441d-863d-25e99360dd71 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:20.532517 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7b9f48-dd1e-441d-863d-25e99360dd71 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:20.572546 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba54a31c-8708-4706-b890-71503a3e3354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:20.573331 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba54a31c-8708-4706-b890-71503a3e3354 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:20.573614 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba54a31c-8708-4706-b890-71503a3e3354 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:20.573894 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba54a31c-8708-4706-b890-71503a3e3354 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:20.586085 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba54a31c-8708-4706-b890-71503a3e3354 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 12:47:20.591041 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-ba54a31c-8708-4706-b890-71503a3e3354 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 14 12:47:20.591041 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:47:20.591041 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:47:20.591041 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:47:20.591041 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:47:20.591041 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:47:20.591041 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:47:20.591041 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:47:20.591041 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:47:20.591041 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:47:20.591041 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:47:20.591041 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:47:20.591041 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 12:47:20.591041 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 12:47:20.591041 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 12:47:20.591041 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 12:47:20.591903 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 12:47:20.591903 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 12:47:20.591903 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 12:47:20.591903 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 12:47:20.591903 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:47:20.591903 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:47:20.591903 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:47:20.591903 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:47:20.591903 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:47:20.591903 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:47:20.591903 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:47:20.591903 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 14 12:47:20.591903 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:47:20.591903 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:47:20.591903 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:47:20.591903 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:47:20.592640 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:47:20.592640 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:47:20.592640 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:47:20.592640 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:47:20.592640 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 12:47:20.592640 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 12:47:20.592640 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 12:47:20.592640 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 12:47:20.592640 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 12:47:20.592640 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 12:47:20.592640 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 14 12:47:20.592640 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 14 12:47:20.592640 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 42/89] 10.222.0.17 () {56 vars in 1099 bytes} [Fri Oct 14 12:47:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:47:20.598262 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb3e52c-9da8-4e29-b9f1-e3191d79fcb0 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:20.668158 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:20.715109 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb3e52c-9da8-4e29-b9f1-e3191d79fcb0 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:20.751386 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f94e15-283e-430c-81f5-e2c298331cbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:20.752014 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f94e15-283e-430c-81f5-e2c298331cbb None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:20.752299 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f94e15-283e-430c-81f5-e2c298331cbb None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:20.752577 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f94e15-283e-430c-81f5-e2c298331cbb None admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:20.753311 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f94e15-283e-430c-81f5-e2c298331cbb None admin] RBAC: Adding query filter params (name=member) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:20.753623 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f94e15-283e-430c-81f5-e2c298331cbb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:20.755668 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f94e15-283e-430c-81f5-e2c298331cbb None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:20.764541 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 48/90] 10.222.0.17 () {56 vars in 1101 bytes} [Fri Oct 14 12:47:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:20.770774 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba54a31c-8708-4706-b890-71503a3e3354 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:20.852754 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:20.914756 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba54a31c-8708-4706-b890-71503a3e3354 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:20.955727 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba5383a-844f-4a89-bb12-08b57012e84d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:20.956278 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba5383a-844f-4a89-bb12-08b57012e84d None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:20.956566 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba5383a-844f-4a89-bb12-08b57012e84d None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:20.956893 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba5383a-844f-4a89-bb12-08b57012e84d None admin] PATH_INFO: `/v3/users/bb38b29e9ad84f16b142b35dfce4e938` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:20.958666 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba5383a-844f-4a89-bb12-08b57012e84d None admin] RBAC: Authorizing `identity:get_user(user_id=bb38b29e9ad84f16b142b35dfce4e938)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:20.960218 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba5383a-844f-4a89-bb12-08b57012e84d None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:20.961825 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 43/91] 10.222.0.17 () {56 vars in 1177 bytes} [Fri Oct 14 12:47:20 2022] GET /identity/v3/users/bb38b29e9ad84f16b142b35dfce4e938 => generated 275 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:20.967587 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f94e15-283e-430c-81f5-e2c298331cbb None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:21.077690 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f94e15-283e-430c-81f5-e2c298331cbb None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:21.104137 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:21.124648 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832e4eae-fe73-4418-a63e-5588537b239c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:21.125613 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832e4eae-fe73-4418-a63e-5588537b239c None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:21.126066 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832e4eae-fe73-4418-a63e-5588537b239c None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:21.126541 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832e4eae-fe73-4418-a63e-5588537b239c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:21.204225 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832e4eae-fe73-4418-a63e-5588537b239c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:21.205698 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832e4eae-fe73-4418-a63e-5588537b239c None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:21.311444 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 49/92] 10.222.0.17 () {58 vars in 1282 bytes} [Fri Oct 14 12:47:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 14 12:47:21.316869 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba5383a-844f-4a89-bb12-08b57012e84d None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:21.440332 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba5383a-844f-4a89-bb12-08b57012e84d None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:21.476783 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:21.493600 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1aae24-f46e-435a-bc6c-dafc1090d6b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:21.494288 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1aae24-f46e-435a-bc6c-dafc1090d6b9 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:21.494571 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1aae24-f46e-435a-bc6c-dafc1090d6b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:21.494847 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1aae24-f46e-435a-bc6c-dafc1090d6b9 None admin] PATH_INFO: `/v3/projects/bb069426c7f5452ebe72633778574267` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:21.499008 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1aae24-f46e-435a-bc6c-dafc1090d6b9 None admin] RBAC: Authorizing `identity:get_project(project_id=bb069426c7f5452ebe72633778574267)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:21.500513 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1aae24-f46e-435a-bc6c-dafc1090d6b9 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:21.502715 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 44/93] 10.222.0.17 () {56 vars in 1186 bytes} [Fri Oct 14 12:47:21 2022] GET /identity/v3/projects/bb069426c7f5452ebe72633778574267 => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:21.509389 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832e4eae-fe73-4418-a63e-5588537b239c None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:21.568176 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:21.630242 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832e4eae-fe73-4418-a63e-5588537b239c None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:21.667412 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c166c9f3-60cd-497e-9a9f-ab2da4b7cbe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:21.668035 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c166c9f3-60cd-497e-9a9f-ab2da4b7cbe4 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:21.668318 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c166c9f3-60cd-497e-9a9f-ab2da4b7cbe4 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:21.668596 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c166c9f3-60cd-497e-9a9f-ab2da4b7cbe4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:21.669331 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c166c9f3-60cd-497e-9a9f-ab2da4b7cbe4 None admin] RBAC: Adding query filter params (role.id=5e8849303a75425b9eaa2681cc031af1, scope.project.id=bb069426c7f5452ebe72633778574267, user.id=bb38b29e9ad84f16b142b35dfce4e938) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:21.669640 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c166c9f3-60cd-497e-9a9f-ab2da4b7cbe4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:21.671132 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c166c9f3-60cd-497e-9a9f-ab2da4b7cbe4 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:21.681423 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 50/94] 10.222.0.17 () {56 vars in 1374 bytes} [Fri Oct 14 12:47:21 2022] GET /identity/v3/role_assignments?user.id=bb38b29e9ad84f16b142b35dfce4e938&scope.project.id=bb069426c7f5452ebe72633778574267&role.id=5e8849303a75425b9eaa2681cc031af1 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:21.740607 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8104c8e3-daa7-486c-b34f-ec1ab556c231 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:21.740919 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8104c8e3-daa7-486c-b34f-ec1ab556c231 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:21.741196 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8104c8e3-daa7-486c-b34f-ec1ab556c231 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:21.742903 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 45/95] 10.222.0.17 () {54 vars in 927 bytes} [Fri Oct 14 12:47:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:47:21.750818 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee248712-0adb-400c-bc7d-354c10fcc0a6 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:21.751141 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee248712-0adb-400c-bc7d-354c10fcc0a6 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:21.751385 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee248712-0adb-400c-bc7d-354c10fcc0a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:21.775910 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-ee248712-0adb-400c-bc7d-354c10fcc0a6 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:47:21.777256 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-ee248712-0adb-400c-bc7d-354c10fcc0a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:47:21.884752 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 51/96] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Oct 14 12:47:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 12:47:22.037087 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cc19ba-0f02-4e37-a263-7f2500bfff34 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:22.037751 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cc19ba-0f02-4e37-a263-7f2500bfff34 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:22.038278 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cc19ba-0f02-4e37-a263-7f2500bfff34 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:22.039960 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 46/97] 10.222.0.17 () {54 vars in 927 bytes} [Fri Oct 14 12:47:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:47:22.046777 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99257f68-5159-498e-8fbf-db9ce72d4d32 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:22.047204 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99257f68-5159-498e-8fbf-db9ce72d4d32 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:22.047463 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99257f68-5159-498e-8fbf-db9ce72d4d32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:22.073029 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-99257f68-5159-498e-8fbf-db9ce72d4d32 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:47:22.074284 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-99257f68-5159-498e-8fbf-db9ce72d4d32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:47:22.099034 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:22.173557 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 52/98] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Oct 14 12:47:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 12:47:22.191421 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1dc920-dfa2-47e9-bc19-104a039a7707 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:22.191711 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1dc920-dfa2-47e9-bc19-104a039a7707 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:22.191974 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1dc920-dfa2-47e9-bc19-104a039a7707 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:22.193629 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 47/99] 10.222.0.17 () {54 vars in 927 bytes} [Fri Oct 14 12:47:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:47:22.199547 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0954932c-a71d-488f-a750-8983ba772232 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:22.199841 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0954932c-a71d-488f-a750-8983ba772232 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:22.200125 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0954932c-a71d-488f-a750-8983ba772232 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:22.225765 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-0954932c-a71d-488f-a750-8983ba772232 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:47:22.227036 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-0954932c-a71d-488f-a750-8983ba772232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:47:22.317590 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 53/100] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Oct 14 12:47:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 12:47:22.388162 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1dc920-dfa2-47e9-bc19-104a039a7707 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:22.515683 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0954932c-a71d-488f-a750-8983ba772232 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:22.543692 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1dc920-dfa2-47e9-bc19-104a039a7707 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:22.588973 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03a7957-cd5b-4ac0-81c2-daae065bfc0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:22.589668 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03a7957-cd5b-4ac0-81c2-daae065bfc0f None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:22.589884 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03a7957-cd5b-4ac0-81c2-daae065bfc0f None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:22.590192 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03a7957-cd5b-4ac0-81c2-daae065bfc0f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:22.602436 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03a7957-cd5b-4ac0-81c2-daae065bfc0f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 12:47:22.607176 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-c03a7957-cd5b-4ac0-81c2-daae065bfc0f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 14 12:47:22.607176 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:47:22.607176 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:47:22.607176 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:47:22.607176 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:47:22.607176 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:47:22.607176 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:47:22.607176 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:47:22.607176 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:47:22.607176 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:47:22.607176 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:47:22.607176 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:47:22.607176 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 12:47:22.607176 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 12:47:22.607176 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 12:47:22.607176 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 12:47:22.608361 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 12:47:22.608361 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 12:47:22.608361 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 12:47:22.608361 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 12:47:22.608361 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:47:22.608361 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:47:22.608361 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:47:22.608361 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:47:22.608361 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:47:22.608361 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:47:22.608361 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:47:22.608361 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 14 12:47:22.608361 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:47:22.608361 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:47:22.608361 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:47:22.608361 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:47:22.609104 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:47:22.609104 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:47:22.609104 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:47:22.609104 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:47:22.609104 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 12:47:22.609104 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 12:47:22.609104 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 12:47:22.609104 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 12:47:22.609104 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 12:47:22.609104 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 12:47:22.609104 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 14 12:47:22.609104 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 14 12:47:22.609104 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 48/101] 10.222.0.17 () {56 vars in 1114 bytes} [Fri Oct 14 12:47:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:47:22.609712 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2b4eb9-f6e8-46b0-8473-810d0f8ee022 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:22.610550 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2b4eb9-f6e8-46b0-8473-810d0f8ee022 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:22.610550 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2b4eb9-f6e8-46b0-8473-810d0f8ee022 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:22.615836 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 49/102] 10.222.0.17 () {54 vars in 927 bytes} [Fri Oct 14 12:47:22 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:47:22.615836 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a36175-5905-41ef-bd35-9847590a24c2 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:22.615836 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a36175-5905-41ef-bd35-9847590a24c2 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:22.615836 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a36175-5905-41ef-bd35-9847590a24c2 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:22.615836 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 50/103] 10.222.0.17 () {54 vars in 927 bytes} [Fri Oct 14 12:47:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:47:22.617211 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a36175-5905-41ef-bd35-9847590a24c2 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:22.623245 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:22.652022 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0954932c-a71d-488f-a750-8983ba772232 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:22.674837 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:22.688578 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685510a6-a552-4ca0-957e-23bc2fc54918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:22.689322 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685510a6-a552-4ca0-957e-23bc2fc54918 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:22.689613 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685510a6-a552-4ca0-957e-23bc2fc54918 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:22.689894 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685510a6-a552-4ca0-957e-23bc2fc54918 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:22.700313 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685510a6-a552-4ca0-957e-23bc2fc54918 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 12:47:22.705207 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-685510a6-a552-4ca0-957e-23bc2fc54918 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 14 12:47:22.705207 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:47:22.705207 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:47:22.705207 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:47:22.705207 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:47:22.705207 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:47:22.705207 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:47:22.705207 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:47:22.705207 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:47:22.705207 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:47:22.705207 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:47:22.705207 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:47:22.705207 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 12:47:22.705207 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 12:47:22.705207 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 12:47:22.705207 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 12:47:22.706047 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 12:47:22.706047 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 12:47:22.706047 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 12:47:22.706047 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 12:47:22.706047 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:47:22.706047 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:47:22.706047 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:47:22.706047 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:47:22.706047 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:47:22.706047 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:47:22.706047 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:47:22.706047 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 14 12:47:22.706047 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:47:22.706047 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:47:22.706047 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:47:22.706047 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:47:22.707059 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:47:22.707059 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:47:22.707059 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:47:22.707059 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:47:22.707059 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 12:47:22.707059 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 12:47:22.707059 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 12:47:22.707059 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 12:47:22.707059 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 12:47:22.707059 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 12:47:22.707059 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 14 12:47:22.707059 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 14 12:47:22.707059 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 54/104] 10.222.0.17 () {56 vars in 1099 bytes} [Fri Oct 14 12:47:22 2022] GET /identity/v3/roles/reader => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:47:22.708639 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdccd9f9-22aa-45b5-8346-6784800253fa None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:22.708835 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdccd9f9-22aa-45b5-8346-6784800253fa None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:22.709091 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdccd9f9-22aa-45b5-8346-6784800253fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:22.726328 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a36175-5905-41ef-bd35-9847590a24c2 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:22.727252 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-fdccd9f9-22aa-45b5-8346-6784800253fa None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:47:22.728520 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-fdccd9f9-22aa-45b5-8346-6784800253fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:47:22.761198 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad2d250-fb4e-4daa-aba6-4cc3e5158159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:22.761809 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad2d250-fb4e-4daa-aba6-4cc3e5158159 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:22.762094 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad2d250-fb4e-4daa-aba6-4cc3e5158159 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:22.762406 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad2d250-fb4e-4daa-aba6-4cc3e5158159 None admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:22.763076 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad2d250-fb4e-4daa-aba6-4cc3e5158159 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:22.763390 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad2d250-fb4e-4daa-aba6-4cc3e5158159 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:22.764776 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad2d250-fb4e-4daa-aba6-4cc3e5158159 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:22.773720 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 51/105] 10.222.0.17 () {56 vars in 1111 bytes} [Fri Oct 14 12:47:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:22.774932 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7b674a-9f85-456e-85e5-0711cba84d57 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:22.775225 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7b674a-9f85-456e-85e5-0711cba84d57 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:22.775504 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7b674a-9f85-456e-85e5-0711cba84d57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:22.793913 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-3e7b674a-9f85-456e-85e5-0711cba84d57 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:47:22.795227 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-3e7b674a-9f85-456e-85e5-0711cba84d57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:47:22.800577 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 55/106] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Oct 14 12:47:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 12:47:22.807030 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdccd9f9-22aa-45b5-8346-6784800253fa None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:22.878855 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 52/107] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Oct 14 12:47:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 12:47:22.880241 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7b674a-9f85-456e-85e5-0711cba84d57 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:22.892335 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:22.935355 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdccd9f9-22aa-45b5-8346-6784800253fa None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:22.955293 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:22.978794 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34747e4f-be09-4b64-a8d3-53a3e6d7532c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:22.979885 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34747e4f-be09-4b64-a8d3-53a3e6d7532c None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:22.980366 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34747e4f-be09-4b64-a8d3-53a3e6d7532c None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:22.980839 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34747e4f-be09-4b64-a8d3-53a3e6d7532c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:22.994629 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34747e4f-be09-4b64-a8d3-53a3e6d7532c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 12:47:23.001348 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-34747e4f-be09-4b64-a8d3-53a3e6d7532c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 14 12:47:23.001348 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:47:23.001348 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:47:23.001348 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:47:23.001348 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:47:23.001348 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:47:23.001348 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:47:23.001348 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:47:23.001348 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:47:23.001348 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:47:23.001348 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:47:23.001348 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:47:23.001348 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 12:47:23.001348 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 12:47:23.001348 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 12:47:23.001348 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 12:47:23.002537 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 12:47:23.002537 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 12:47:23.002537 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 12:47:23.002537 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 12:47:23.002537 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:47:23.002537 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:47:23.002537 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:47:23.002537 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:47:23.002537 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:47:23.002537 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:47:23.002537 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:47:23.002537 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 14 12:47:23.002537 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:47:23.002537 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:47:23.002537 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:47:23.002537 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:47:23.003293 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:47:23.003293 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:47:23.003293 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:47:23.003293 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:47:23.003293 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 12:47:23.003293 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 12:47:23.003293 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 12:47:23.003293 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 12:47:23.003293 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 12:47:23.003293 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 12:47:23.003293 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 14 12:47:23.003293 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 14 12:47:23.006275 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 56/108] 10.222.0.17 () {56 vars in 1099 bytes} [Fri Oct 14 12:47:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:47:23.007397 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34747e4f-be09-4b64-a8d3-53a3e6d7532c None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:23.052369 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7b674a-9f85-456e-85e5-0711cba84d57 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:23.105632 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4a1093-0568-4bd7-aa34-492767b978de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:23.106326 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4a1093-0568-4bd7-aa34-492767b978de None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:23.106613 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4a1093-0568-4bd7-aa34-492767b978de None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:23.106887 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4a1093-0568-4bd7-aa34-492767b978de None admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:23.107565 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4a1093-0568-4bd7-aa34-492767b978de None admin] RBAC: Adding query filter params (name=reader) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:23.107872 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4a1093-0568-4bd7-aa34-492767b978de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:23.109575 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4a1093-0568-4bd7-aa34-492767b978de None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:23.123163 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 53/109] 10.222.0.17 () {56 vars in 1101 bytes} [Fri Oct 14 12:47:22 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:23.124553 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4a1093-0568-4bd7-aa34-492767b978de None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:23.138742 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34747e4f-be09-4b64-a8d3-53a3e6d7532c None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:23.166537 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:23.176186 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6025df7e-fbe9-47f7-ad61-e71da54da9b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:23.177402 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6025df7e-fbe9-47f7-ad61-e71da54da9b3 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:23.177695 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6025df7e-fbe9-47f7-ad61-e71da54da9b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:23.178062 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6025df7e-fbe9-47f7-ad61-e71da54da9b3 None admin] PATH_INFO: `/v3/users/bb38b29e9ad84f16b142b35dfce4e938` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:23.179159 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6025df7e-fbe9-47f7-ad61-e71da54da9b3 None admin] RBAC: Authorizing `identity:get_user(user_id=bb38b29e9ad84f16b142b35dfce4e938)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:23.180638 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6025df7e-fbe9-47f7-ad61-e71da54da9b3 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:23.182267 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 57/110] 10.222.0.17 () {56 vars in 1177 bytes} [Fri Oct 14 12:47:23 2022] GET /identity/v3/users/bb38b29e9ad84f16b142b35dfce4e938 => generated 275 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:23.183122 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6025df7e-fbe9-47f7-ad61-e71da54da9b3 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:23.250944 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4a1093-0568-4bd7-aa34-492767b978de None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:23.271331 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:23.296322 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a580497-c416-421c-9c38-b76671b5bfc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:23.297033 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a580497-c416-421c-9c38-b76671b5bfc7 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:23.297323 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a580497-c416-421c-9c38-b76671b5bfc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:23.297602 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a580497-c416-421c-9c38-b76671b5bfc7 None admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:23.298308 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a580497-c416-421c-9c38-b76671b5bfc7 None admin] RBAC: Adding query filter params (name=member) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:23.298620 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a580497-c416-421c-9c38-b76671b5bfc7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:23.300011 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a580497-c416-421c-9c38-b76671b5bfc7 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:23.305270 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6025df7e-fbe9-47f7-ad61-e71da54da9b3 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:23.309260 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 54/111] 10.222.0.17 () {56 vars in 1101 bytes} [Fri Oct 14 12:47:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:23.310140 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a580497-c416-421c-9c38-b76671b5bfc7 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:23.345241 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f13940-f360-4e76-ab05-460fecdf7a04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:23.345884 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f13940-f360-4e76-ab05-460fecdf7a04 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:23.346190 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f13940-f360-4e76-ab05-460fecdf7a04 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:23.346467 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f13940-f360-4e76-ab05-460fecdf7a04 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:23.357492 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f13940-f360-4e76-ab05-460fecdf7a04 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 12:47:23.363198 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-72f13940-f360-4e76-ab05-460fecdf7a04 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 14 12:47:23.363198 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:47:23.363198 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:47:23.363198 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:47:23.363198 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:47:23.363198 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:47:23.363198 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:47:23.363198 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:47:23.363198 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:47:23.363198 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:47:23.363198 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:47:23.363198 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:47:23.363198 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 12:47:23.363198 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 12:47:23.363198 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 12:47:23.363198 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 12:47:23.364375 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 12:47:23.364375 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 12:47:23.364375 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 12:47:23.364375 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 12:47:23.364375 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:47:23.364375 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:47:23.364375 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:47:23.364375 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:47:23.364375 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:47:23.364375 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:47:23.364375 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:47:23.364375 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 14 12:47:23.364375 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:47:23.364375 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:47:23.364375 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:47:23.364375 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:47:23.370657 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:47:23.370657 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:47:23.370657 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:47:23.370657 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:47:23.370657 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 12:47:23.370657 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 12:47:23.370657 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 12:47:23.370657 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 12:47:23.370657 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 12:47:23.370657 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 12:47:23.370657 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 14 12:47:23.370657 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 14 12:47:23.370657 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 58/112] 10.222.0.17 () {56 vars in 1096 bytes} [Fri Oct 14 12:47:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:47:23.370657 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f13940-f360-4e76-ab05-460fecdf7a04 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:23.417156 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a580497-c416-421c-9c38-b76671b5bfc7 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:23.425230 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:23.452011 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2c271a-5691-4fa7-ab14-113bf76fbcc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:23.452639 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2c271a-5691-4fa7-ab14-113bf76fbcc7 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:23.452915 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2c271a-5691-4fa7-ab14-113bf76fbcc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:23.453202 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2c271a-5691-4fa7-ab14-113bf76fbcc7 None admin] PATH_INFO: `/v3/users/b0840d1820bd40379fedf7dd0f4df326` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:23.468322 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2c271a-5691-4fa7-ab14-113bf76fbcc7 None admin] RBAC: Authorizing `identity:get_user(user_id=b0840d1820bd40379fedf7dd0f4df326)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:23.469820 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2c271a-5691-4fa7-ab14-113bf76fbcc7 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:23.471563 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 55/113] 10.222.0.17 () {56 vars in 1177 bytes} [Fri Oct 14 12:47:23 2022] GET /identity/v3/users/b0840d1820bd40379fedf7dd0f4df326 => generated 289 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:23.471684 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f13940-f360-4e76-ab05-460fecdf7a04 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:23.472337 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2c271a-5691-4fa7-ab14-113bf76fbcc7 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:23.502033 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:23.508944 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6168b97a-bb5f-4148-aace-446e9780bd51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:23.509575 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6168b97a-bb5f-4148-aace-446e9780bd51 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:23.509859 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6168b97a-bb5f-4148-aace-446e9780bd51 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:23.510146 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6168b97a-bb5f-4148-aace-446e9780bd51 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:23.577808 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2c271a-5691-4fa7-ab14-113bf76fbcc7 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:23.581309 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6168b97a-bb5f-4148-aace-446e9780bd51 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:23.582896 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6168b97a-bb5f-4148-aace-446e9780bd51 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:23.615564 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542ad905-3965-497c-b29b-c03879f354ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:23.616206 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542ad905-3965-497c-b29b-c03879f354ae None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:23.616490 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542ad905-3965-497c-b29b-c03879f354ae None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:23.616821 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542ad905-3965-497c-b29b-c03879f354ae None admin] PATH_INFO: `/v3/domains/default` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:23.617966 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542ad905-3965-497c-b29b-c03879f354ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:23.619478 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542ad905-3965-497c-b29b-c03879f354ae None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:23.621081 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 56/114] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Oct 14 12:47:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:23.621081 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542ad905-3965-497c-b29b-c03879f354ae None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:23.649295 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:23.699354 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 59/115] 10.222.0.17 () {58 vars in 1282 bytes} [Fri Oct 14 12:47:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 14 12:47:23.703143 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6168b97a-bb5f-4148-aace-446e9780bd51 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:23.721696 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:23.729976 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542ad905-3965-497c-b29b-c03879f354ae None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:23.768579 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fe3d9c-95c3-445c-bce8-d65d27f7e863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:23.769227 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fe3d9c-95c3-445c-bce8-d65d27f7e863 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:23.769510 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fe3d9c-95c3-445c-bce8-d65d27f7e863 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:23.769789 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fe3d9c-95c3-445c-bce8-d65d27f7e863 None admin] PATH_INFO: `/v3/users/bb38b29e9ad84f16b142b35dfce4e938` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:23.771003 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fe3d9c-95c3-445c-bce8-d65d27f7e863 None admin] RBAC: Authorizing `identity:get_user(user_id=bb38b29e9ad84f16b142b35dfce4e938)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:23.772722 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fe3d9c-95c3-445c-bce8-d65d27f7e863 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:23.774996 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 57/116] 10.222.0.17 () {56 vars in 1177 bytes} [Fri Oct 14 12:47:23 2022] GET /identity/v3/users/bb38b29e9ad84f16b142b35dfce4e938 => generated 275 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:23.775662 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fe3d9c-95c3-445c-bce8-d65d27f7e863 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:23.821707 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6168b97a-bb5f-4148-aace-446e9780bd51 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:23.861210 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5aa42ab-6800-441e-adcd-f916adb66cdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:23.861895 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aa42ab-6800-441e-adcd-f916adb66cdb None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:23.862202 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aa42ab-6800-441e-adcd-f916adb66cdb None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:23.862480 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aa42ab-6800-441e-adcd-f916adb66cdb None admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:23.863149 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5aa42ab-6800-441e-adcd-f916adb66cdb None admin] RBAC: Adding query filter params (name=admin) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:23.863452 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5aa42ab-6800-441e-adcd-f916adb66cdb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:23.865534 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5aa42ab-6800-441e-adcd-f916adb66cdb None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:23.874074 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 60/117] 10.222.0.17 () {56 vars in 1099 bytes} [Fri Oct 14 12:47:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:23.876010 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5aa42ab-6800-441e-adcd-f916adb66cdb None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:23.895252 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:23.896252 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fe3d9c-95c3-445c-bce8-d65d27f7e863 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:23.932701 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65edcdce-08f4-4cc4-9674-27657321d364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:23.933346 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65edcdce-08f4-4cc4-9674-27657321d364 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:23.933630 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65edcdce-08f4-4cc4-9674-27657321d364 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:23.933909 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65edcdce-08f4-4cc4-9674-27657321d364 None admin] PATH_INFO: `/v3/projects/bb069426c7f5452ebe72633778574267` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:23.935091 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65edcdce-08f4-4cc4-9674-27657321d364 None admin] RBAC: Authorizing `identity:get_project(project_id=bb069426c7f5452ebe72633778574267)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:23.936570 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65edcdce-08f4-4cc4-9674-27657321d364 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:23.938269 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 58/118] 10.222.0.17 () {56 vars in 1186 bytes} [Fri Oct 14 12:47:23 2022] GET /identity/v3/projects/bb069426c7f5452ebe72633778574267 => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:23.939073 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65edcdce-08f4-4cc4-9674-27657321d364 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:23.971268 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:23.987429 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5aa42ab-6800-441e-adcd-f916adb66cdb None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:24.022067 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4664a3-a3e3-4bfc-8402-70c9c78fcb41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:24.022707 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4664a3-a3e3-4bfc-8402-70c9c78fcb41 None admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:24.022986 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4664a3-a3e3-4bfc-8402-70c9c78fcb41 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:24.023258 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4664a3-a3e3-4bfc-8402-70c9c78fcb41 None admin] PATH_INFO: `/v3/projects` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:24.023901 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4664a3-a3e3-4bfc-8402-70c9c78fcb41 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:24.025358 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4664a3-a3e3-4bfc-8402-70c9c78fcb41 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:24.045031 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65edcdce-08f4-4cc4-9674-27657321d364 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:24.053102 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 61/119] 10.222.0.17 () {60 vars in 1141 bytes} [Fri Oct 14 12:47:23 2022] POST /identity/v3/projects => generated 302 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 12:47:24.053960 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4664a3-a3e3-4bfc-8402-70c9c78fcb41 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:24.100869 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a5e1bf-7841-405d-8baf-7e64f6d6cf8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:24.101421 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a5e1bf-7841-405d-8baf-7e64f6d6cf8c None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:24.101812 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a5e1bf-7841-405d-8baf-7e64f6d6cf8c None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:24.102276 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a5e1bf-7841-405d-8baf-7e64f6d6cf8c None admin] PATH_INFO: `/v3/projects/bb069426c7f5452ebe72633778574267` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:24.104264 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a5e1bf-7841-405d-8baf-7e64f6d6cf8c None admin] RBAC: Authorizing `identity:get_project(project_id=bb069426c7f5452ebe72633778574267)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:24.107413 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a5e1bf-7841-405d-8baf-7e64f6d6cf8c None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:24.110602 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 59/120] 10.222.0.17 () {56 vars in 1186 bytes} [Fri Oct 14 12:47:23 2022] GET /identity/v3/projects/bb069426c7f5452ebe72633778574267 => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:24.112030 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a5e1bf-7841-405d-8baf-7e64f6d6cf8c None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:24.143660 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:24.190475 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4664a3-a3e3-4bfc-8402-70c9c78fcb41 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:24.248652 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4013c55c-1b6c-43bc-a00a-0c74efe2f88f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:24.249673 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4013c55c-1b6c-43bc-a00a-0c74efe2f88f None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:24.250031 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4013c55c-1b6c-43bc-a00a-0c74efe2f88f None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:24.251354 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4013c55c-1b6c-43bc-a00a-0c74efe2f88f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:24.277395 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:24.280201 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a5e1bf-7841-405d-8baf-7e64f6d6cf8c None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:24.346076 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153a9c16-2141-49ac-b3a1-bcfac5622f94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:24.346752 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153a9c16-2141-49ac-b3a1-bcfac5622f94 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:24.347036 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153a9c16-2141-49ac-b3a1-bcfac5622f94 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:24.347315 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153a9c16-2141-49ac-b3a1-bcfac5622f94 None admin] PATH_INFO: `/v3/users/c832b4bdd0c849fb8bef8d4ac39a8dd6` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:24.348667 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153a9c16-2141-49ac-b3a1-bcfac5622f94 None admin] RBAC: Authorizing `identity:get_user(user_id=c832b4bdd0c849fb8bef8d4ac39a8dd6)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:24.349174 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4013c55c-1b6c-43bc-a00a-0c74efe2f88f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:24.350170 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153a9c16-2141-49ac-b3a1-bcfac5622f94 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:24.351280 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4013c55c-1b6c-43bc-a00a-0c74efe2f88f None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:24.351802 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 60/121] 10.222.0.17 () {56 vars in 1177 bytes} [Fri Oct 14 12:47:24 2022] GET /identity/v3/users/c832b4bdd0c849fb8bef8d4ac39a8dd6 => generated 247 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:24.356530 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153a9c16-2141-49ac-b3a1-bcfac5622f94 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:24.450243 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:24.495864 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 62/122] 10.222.0.17 () {58 vars in 1282 bytes} [Fri Oct 14 12:47:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 14 12:47:24.497216 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4013c55c-1b6c-43bc-a00a-0c74efe2f88f None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:24.509045 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153a9c16-2141-49ac-b3a1-bcfac5622f94 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:24.550738 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab0e354-0e37-4152-9277-406eb6a794d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:24.552006 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab0e354-0e37-4152-9277-406eb6a794d9 None admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:24.552437 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab0e354-0e37-4152-9277-406eb6a794d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:24.552887 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab0e354-0e37-4152-9277-406eb6a794d9 None admin] PATH_INFO: `/v3/projects/bb069426c7f5452ebe72633778574267/users/b0840d1820bd40379fedf7dd0f4df326/roles/8cab83b8007b48b1934e19126b3170a6` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:24.554940 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab0e354-0e37-4152-9277-406eb6a794d9 None admin] RBAC: Authorizing `identity:create_grant(project_id=bb069426c7f5452ebe72633778574267, user_id=b0840d1820bd40379fedf7dd0f4df326, role_id=8cab83b8007b48b1934e19126b3170a6)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:24.556410 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab0e354-0e37-4152-9277-406eb6a794d9 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:24.585845 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 61/123] 10.222.0.17 () {58 vars in 1439 bytes} [Fri Oct 14 12:47:24 2022] PUT /identity/v3/projects/bb069426c7f5452ebe72633778574267/users/b0840d1820bd40379fedf7dd0f4df326/roles/8cab83b8007b48b1934e19126b3170a6 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 12:47:24.585845 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab0e354-0e37-4152-9277-406eb6a794d9 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:24.646164 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4013c55c-1b6c-43bc-a00a-0c74efe2f88f None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:24.684132 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:24.694972 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8abccbd-0ba1-4621-a1ef-8658d411ab7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:24.696043 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8abccbd-0ba1-4621-a1ef-8658d411ab7c None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:24.696534 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8abccbd-0ba1-4621-a1ef-8658d411ab7c None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:24.697061 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8abccbd-0ba1-4621-a1ef-8658d411ab7c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:24.698068 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8abccbd-0ba1-4621-a1ef-8658d411ab7c None admin] RBAC: Adding query filter params (role.id=251e12cde1564a10b367cc385e58b828, scope.project.id=bb069426c7f5452ebe72633778574267, user.id=bb38b29e9ad84f16b142b35dfce4e938) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:24.698663 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8abccbd-0ba1-4621-a1ef-8658d411ab7c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:24.700571 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8abccbd-0ba1-4621-a1ef-8658d411ab7c None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:24.709443 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 63/124] 10.222.0.17 () {56 vars in 1374 bytes} [Fri Oct 14 12:47:24 2022] GET /identity/v3/role_assignments?user.id=bb38b29e9ad84f16b142b35dfce4e938&scope.project.id=bb069426c7f5452ebe72633778574267&role.id=251e12cde1564a10b367cc385e58b828 => generated 608 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:24.719550 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8abccbd-0ba1-4621-a1ef-8658d411ab7c None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:24.807092 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:24.860292 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab0e354-0e37-4152-9277-406eb6a794d9 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:24.911276 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8abccbd-0ba1-4621-a1ef-8658d411ab7c None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:24.949849 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66db2ae7-caba-4d33-88a6-359ad0634d32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:24.950660 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66db2ae7-caba-4d33-88a6-359ad0634d32 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:24.950898 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66db2ae7-caba-4d33-88a6-359ad0634d32 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:24.951184 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66db2ae7-caba-4d33-88a6-359ad0634d32 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:24.955381 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddedd9be-8f4e-4a35-a5f3-11122599a09d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:24.956033 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddedd9be-8f4e-4a35-a5f3-11122599a09d None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:24.956322 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddedd9be-8f4e-4a35-a5f3-11122599a09d None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:24.956605 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddedd9be-8f4e-4a35-a5f3-11122599a09d None admin] PATH_INFO: `/v3/projects/86b6df3329824442963df485b1348816` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:24.957859 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddedd9be-8f4e-4a35-a5f3-11122599a09d None admin] RBAC: Authorizing `identity:get_project(project_id=86b6df3329824442963df485b1348816)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:24.959870 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddedd9be-8f4e-4a35-a5f3-11122599a09d None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:24.963125 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 64/125] 10.222.0.17 () {56 vars in 1186 bytes} [Fri Oct 14 12:47:24 2022] GET /identity/v3/projects/86b6df3329824442963df485b1348816 => generated 312 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:24.969674 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddedd9be-8f4e-4a35-a5f3-11122599a09d None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:25.046476 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66db2ae7-caba-4d33-88a6-359ad0634d32 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:25.048531 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66db2ae7-caba-4d33-88a6-359ad0634d32 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:25.090932 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:25.105939 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:25.115238 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddedd9be-8f4e-4a35-a5f3-11122599a09d None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:25.166054 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5428b10f-b87a-4fc5-a027-4aa4d8587e67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:25.166756 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5428b10f-b87a-4fc5-a027-4aa4d8587e67 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:25.167138 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5428b10f-b87a-4fc5-a027-4aa4d8587e67 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:25.167424 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5428b10f-b87a-4fc5-a027-4aa4d8587e67 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:25.168471 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5428b10f-b87a-4fc5-a027-4aa4d8587e67 None admin] RBAC: Adding query filter params (role.id=5e8849303a75425b9eaa2681cc031af1, scope.project.id=86b6df3329824442963df485b1348816, user.id=bb38b29e9ad84f16b142b35dfce4e938) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:25.168805 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5428b10f-b87a-4fc5-a027-4aa4d8587e67 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:25.171822 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5428b10f-b87a-4fc5-a027-4aa4d8587e67 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:25.179876 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 65/126] 10.222.0.17 () {56 vars in 1374 bytes} [Fri Oct 14 12:47:24 2022] GET /identity/v3/role_assignments?user.id=bb38b29e9ad84f16b142b35dfce4e938&scope.project.id=86b6df3329824442963df485b1348816&role.id=5e8849303a75425b9eaa2681cc031af1 => generated 608 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 12:47:25.187764 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 62/127] 10.222.0.17 () {58 vars in 1282 bytes} [Fri Oct 14 12:47:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 609 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 14 12:47:25.194584 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5428b10f-b87a-4fc5-a027-4aa4d8587e67 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:25.312076 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5428b10f-b87a-4fc5-a027-4aa4d8587e67 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:25.353386 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f50365e-ec50-4cf9-aa46-1b5f50328fd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:25.354094 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f50365e-ec50-4cf9-aa46-1b5f50328fd5 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:25.354756 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f50365e-ec50-4cf9-aa46-1b5f50328fd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:25.355044 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f50365e-ec50-4cf9-aa46-1b5f50328fd5 None admin] PATH_INFO: `/v3/projects/bb069426c7f5452ebe72633778574267` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:25.356378 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f50365e-ec50-4cf9-aa46-1b5f50328fd5 None admin] RBAC: Authorizing `identity:get_project(project_id=bb069426c7f5452ebe72633778574267)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:25.357806 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f50365e-ec50-4cf9-aa46-1b5f50328fd5 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:25.359818 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 66/128] 10.222.0.17 () {56 vars in 1186 bytes} [Fri Oct 14 12:47:25 2022] GET /identity/v3/projects/bb069426c7f5452ebe72633778574267 => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 12:47:25.366267 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66db2ae7-caba-4d33-88a6-359ad0634d32 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:25.479388 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66db2ae7-caba-4d33-88a6-359ad0634d32 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:25.509331 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:25.519196 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09749cb8-dde8-42c8-9ee9-4ecba121128c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:25.519812 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09749cb8-dde8-42c8-9ee9-4ecba121128c None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:25.520129 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09749cb8-dde8-42c8-9ee9-4ecba121128c None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:25.520451 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09749cb8-dde8-42c8-9ee9-4ecba121128c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:25.521507 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09749cb8-dde8-42c8-9ee9-4ecba121128c None admin] RBAC: Adding query filter params (role.id=7f6e29e390bc41f7a9af17659a2e95d1, scope.project.id=bb069426c7f5452ebe72633778574267, user.id=c832b4bdd0c849fb8bef8d4ac39a8dd6) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:25.521826 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09749cb8-dde8-42c8-9ee9-4ecba121128c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:25.523327 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09749cb8-dde8-42c8-9ee9-4ecba121128c None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:25.530235 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 63/129] 10.222.0.17 () {56 vars in 1374 bytes} [Fri Oct 14 12:47:25 2022] GET /identity/v3/role_assignments?user.id=c832b4bdd0c849fb8bef8d4ac39a8dd6&scope.project.id=bb069426c7f5452ebe72633778574267&role.id=7f6e29e390bc41f7a9af17659a2e95d1 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:26.366078 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8803fc7-a43b-49b6-8171-23d1be066f7a None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:26.366596 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8803fc7-a43b-49b6-8171-23d1be066f7a None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:26.366596 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8803fc7-a43b-49b6-8171-23d1be066f7a None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:26.367919 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 67/130] 10.222.0.17 () {54 vars in 927 bytes} [Fri Oct 14 12:47:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:47:26.373283 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92676ab7-c00b-4350-b11c-066874054361 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:26.373572 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92676ab7-c00b-4350-b11c-066874054361 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:26.373913 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92676ab7-c00b-4350-b11c-066874054361 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:26.392080 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-92676ab7-c00b-4350-b11c-066874054361 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:47:26.393255 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-92676ab7-c00b-4350-b11c-066874054361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:47:26.457168 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 64/131] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Oct 14 12:47:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 12:47:26.729070 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8803fc7-a43b-49b6-8171-23d1be066f7a None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:26.763681 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:26.836968 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8803fc7-a43b-49b6-8171-23d1be066f7a None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:26.872096 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5a61d1-63ca-4270-955b-69797e561364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:26.872778 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5a61d1-63ca-4270-955b-69797e561364 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:26.873058 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5a61d1-63ca-4270-955b-69797e561364 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:26.873337 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5a61d1-63ca-4270-955b-69797e561364 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:26.874641 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5a61d1-63ca-4270-955b-69797e561364 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:26.876151 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5a61d1-63ca-4270-955b-69797e561364 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:26.877855 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 68/132] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Oct 14 12:47:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:26.883874 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92676ab7-c00b-4350-b11c-066874054361 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:26.997787 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92676ab7-c00b-4350-b11c-066874054361 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:27.002915 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21988b6f-0dcc-42f9-a893-d2f63f9fc06d None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:27.003209 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21988b6f-0dcc-42f9-a893-d2f63f9fc06d None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:27.003493 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21988b6f-0dcc-42f9-a893-d2f63f9fc06d None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:27.005072 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 69/133] 10.222.0.17 () {54 vars in 927 bytes} [Fri Oct 14 12:47:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 14 12:47:27.010355 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becc9fe4-6b4e-4fbd-930f-6b9d1554e20b None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:27.010649 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becc9fe4-6b4e-4fbd-930f-6b9d1554e20b None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:27.010934 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becc9fe4-6b4e-4fbd-930f-6b9d1554e20b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:27.018406 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:27.030404 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-becc9fe4-6b4e-4fbd-930f-6b9d1554e20b None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:47:27.031676 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-becc9fe4-6b4e-4fbd-930f-6b9d1554e20b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:47:27.033067 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e61fb5-5adb-4c55-bbea-8f7b431074d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:27.033685 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e61fb5-5adb-4c55-bbea-8f7b431074d7 None admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:27.033966 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e61fb5-5adb-4c55-bbea-8f7b431074d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:27.034273 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e61fb5-5adb-4c55-bbea-8f7b431074d7 None admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:27.034944 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e61fb5-5adb-4c55-bbea-8f7b431074d7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:27.036926 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e61fb5-5adb-4c55-bbea-8f7b431074d7 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:27.060229 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 65/134] 10.222.0.17 () {60 vars in 1132 bytes} [Fri Oct 14 12:47:26 2022] POST /identity/v3/users => generated 283 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 12:47:27.109229 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 70/135] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Oct 14 12:47:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 14 12:47:27.378642 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e61fb5-5adb-4c55-bbea-8f7b431074d7 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:27.497308 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e61fb5-5adb-4c55-bbea-8f7b431074d7 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:27.536371 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ede294-7488-46a2-bca0-c54000ed7a90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:27.537030 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ede294-7488-46a2-bca0-c54000ed7a90 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:27.537406 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ede294-7488-46a2-bca0-c54000ed7a90 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:27.537712 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ede294-7488-46a2-bca0-c54000ed7a90 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:27.549289 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ede294-7488-46a2-bca0-c54000ed7a90 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 12:47:27.554853 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-18ede294-7488-46a2-bca0-c54000ed7a90 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 14 12:47:27.554853 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:47:27.554853 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:47:27.554853 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:47:27.554853 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:47:27.554853 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:47:27.554853 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:47:27.554853 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:47:27.554853 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:47:27.554853 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:47:27.554853 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:47:27.554853 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:47:27.554853 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 12:47:27.554853 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 12:47:27.554853 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 12:47:27.554853 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 12:47:27.555758 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 12:47:27.555758 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 12:47:27.555758 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 12:47:27.555758 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 12:47:27.555758 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:47:27.555758 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:47:27.555758 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:47:27.555758 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:47:27.555758 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:47:27.555758 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:47:27.555758 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:47:27.555758 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 14 12:47:27.555758 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:47:27.555758 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:47:27.555758 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:47:27.555758 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:47:27.556547 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:47:27.556547 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:47:27.556547 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:47:27.556547 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:47:27.556547 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 12:47:27.556547 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 12:47:27.556547 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 12:47:27.556547 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 12:47:27.556547 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 12:47:27.556547 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 12:47:27.556547 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 14 12:47:27.556547 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 14 12:47:27.556547 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 66/136] 10.222.0.17 () {56 vars in 1099 bytes} [Fri Oct 14 12:47:27 2022] GET /identity/v3/roles/reader => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:47:27.563369 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becc9fe4-6b4e-4fbd-930f-6b9d1554e20b None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:27.598651 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:27.675802 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becc9fe4-6b4e-4fbd-930f-6b9d1554e20b None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:27.713716 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97434ef-c733-4d95-ad58-a04cb6f61c0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:27.714720 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97434ef-c733-4d95-ad58-a04cb6f61c0d None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:27.715240 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97434ef-c733-4d95-ad58-a04cb6f61c0d None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:27.715699 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97434ef-c733-4d95-ad58-a04cb6f61c0d None admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:27.716540 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97434ef-c733-4d95-ad58-a04cb6f61c0d None admin] RBAC: Adding query filter params (name=reader) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:27.717030 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97434ef-c733-4d95-ad58-a04cb6f61c0d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:27.718999 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97434ef-c733-4d95-ad58-a04cb6f61c0d None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:27.729104 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 71/137] 10.222.0.17 () {56 vars in 1101 bytes} [Fri Oct 14 12:47:27 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:27.735448 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ede294-7488-46a2-bca0-c54000ed7a90 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:27.775122 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:27.849378 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ede294-7488-46a2-bca0-c54000ed7a90 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:27.890076 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f917a83-a2e9-472a-95fb-f6ea96a0c83e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:27.890745 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f917a83-a2e9-472a-95fb-f6ea96a0c83e None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:27.891008 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f917a83-a2e9-472a-95fb-f6ea96a0c83e None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:27.891282 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f917a83-a2e9-472a-95fb-f6ea96a0c83e None admin] PATH_INFO: `/v3/users/b0840d1820bd40379fedf7dd0f4df326` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:27.893388 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f917a83-a2e9-472a-95fb-f6ea96a0c83e None admin] RBAC: Authorizing `identity:get_user(user_id=b0840d1820bd40379fedf7dd0f4df326)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:27.894872 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f917a83-a2e9-472a-95fb-f6ea96a0c83e None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:27.897561 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 67/138] 10.222.0.17 () {56 vars in 1177 bytes} [Fri Oct 14 12:47:27 2022] GET /identity/v3/users/b0840d1820bd40379fedf7dd0f4df326 => generated 289 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:27.903547 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97434ef-c733-4d95-ad58-a04cb6f61c0d None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:28.018158 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97434ef-c733-4d95-ad58-a04cb6f61c0d None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:28.019683 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:28.057218 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec01ef4-6cca-45f9-a2c5-831b12138456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:28.057838 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec01ef4-6cca-45f9-a2c5-831b12138456 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:28.058137 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec01ef4-6cca-45f9-a2c5-831b12138456 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:28.058429 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec01ef4-6cca-45f9-a2c5-831b12138456 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:28.134921 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec01ef4-6cca-45f9-a2c5-831b12138456 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:28.136418 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec01ef4-6cca-45f9-a2c5-831b12138456 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:28.235763 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:28.245779 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 72/139] 10.222.0.17 () {58 vars in 1282 bytes} [Fri Oct 14 12:47:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 14 12:47:28.251884 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f917a83-a2e9-472a-95fb-f6ea96a0c83e None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:28.365578 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f917a83-a2e9-472a-95fb-f6ea96a0c83e None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:28.369818 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:28.410729 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe57e28-8147-48d0-9088-0a81b0b01d6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:28.411445 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe57e28-8147-48d0-9088-0a81b0b01d6c None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:28.411736 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe57e28-8147-48d0-9088-0a81b0b01d6c None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:28.412021 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe57e28-8147-48d0-9088-0a81b0b01d6c None admin] PATH_INFO: `/v3/projects/bb069426c7f5452ebe72633778574267` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:28.413176 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe57e28-8147-48d0-9088-0a81b0b01d6c None admin] RBAC: Authorizing `identity:get_project(project_id=bb069426c7f5452ebe72633778574267)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:28.414670 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe57e28-8147-48d0-9088-0a81b0b01d6c None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:28.416337 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 68/140] 10.222.0.17 () {56 vars in 1186 bytes} [Fri Oct 14 12:47:28 2022] GET /identity/v3/projects/bb069426c7f5452ebe72633778574267 => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 12:47:28.423267 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec01ef4-6cca-45f9-a2c5-831b12138456 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:28.538447 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec01ef4-6cca-45f9-a2c5-831b12138456 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:28.579911 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7eb46b-77f3-4651-b1a7-51201c9abd57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:28.580890 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7eb46b-77f3-4651-b1a7-51201c9abd57 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:28.580890 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7eb46b-77f3-4651-b1a7-51201c9abd57 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:28.581141 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7eb46b-77f3-4651-b1a7-51201c9abd57 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:28.581777 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7eb46b-77f3-4651-b1a7-51201c9abd57 None admin] RBAC: Adding query filter params (role.id=8cab83b8007b48b1934e19126b3170a6, scope.project.id=bb069426c7f5452ebe72633778574267, user.id=b0840d1820bd40379fedf7dd0f4df326) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:28.582091 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7eb46b-77f3-4651-b1a7-51201c9abd57 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:28.583644 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7eb46b-77f3-4651-b1a7-51201c9abd57 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:28.590285 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 73/141] 10.222.0.17 () {56 vars in 1374 bytes} [Fri Oct 14 12:47:28 2022] GET /identity/v3/role_assignments?user.id=b0840d1820bd40379fedf7dd0f4df326&scope.project.id=bb069426c7f5452ebe72633778574267&role.id=8cab83b8007b48b1934e19126b3170a6 => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:29.517049 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8da25c6-40a1-4715-9e04-057dde3e9e09 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:29.517562 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8da25c6-40a1-4715-9e04-057dde3e9e09 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:29.517562 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8da25c6-40a1-4715-9e04-057dde3e9e09 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:29.519110 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 69/142] 10.222.0.17 () {54 vars in 927 bytes} [Fri Oct 14 12:47:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:47:29.524711 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5561505-0d7d-4607-88dc-056ca0a91dd2 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:29.525005 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5561505-0d7d-4607-88dc-056ca0a91dd2 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:29.525279 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5561505-0d7d-4607-88dc-056ca0a91dd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:29.543711 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-f5561505-0d7d-4607-88dc-056ca0a91dd2 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:47:29.544903 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-f5561505-0d7d-4607-88dc-056ca0a91dd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:47:29.604737 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:29.620426 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39faaf0f-4d6d-4e6c-b1ee-26530189dc94 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:29.620667 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39faaf0f-4d6d-4e6c-b1ee-26530189dc94 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:29.621176 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39faaf0f-4d6d-4e6c-b1ee-26530189dc94 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:29.622844 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 74/143] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Oct 14 12:47:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 12:47:29.622952 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 70/144] 10.222.0.17 () {54 vars in 927 bytes} [Fri Oct 14 12:47:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 14 12:47:29.627922 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeb9222-36d1-4575-8b7f-d6d8236e6d3b None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:29.628217 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeb9222-36d1-4575-8b7f-d6d8236e6d3b None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:29.628507 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeb9222-36d1-4575-8b7f-d6d8236e6d3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:29.647020 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-cfeb9222-36d1-4575-8b7f-d6d8236e6d3b None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:47:29.648222 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-cfeb9222-36d1-4575-8b7f-d6d8236e6d3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:47:29.688394 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28540b2d-9201-437a-a7f2-a83bfce18ed0 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:29.688678 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28540b2d-9201-437a-a7f2-a83bfce18ed0 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:29.689113 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28540b2d-9201-437a-a7f2-a83bfce18ed0 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:29.690666 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 71/145] 10.222.0.17 () {54 vars in 927 bytes} [Fri Oct 14 12:47:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 14 12:47:29.696681 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1378361c-d83a-4f2d-a64b-7413a14974d8 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:29.697203 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1378361c-d83a-4f2d-a64b-7413a14974d8 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:29.697475 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1378361c-d83a-4f2d-a64b-7413a14974d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:29.717482 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-1378361c-d83a-4f2d-a64b-7413a14974d8 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:47:29.722209 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 75/146] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Oct 14 12:47:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 12:47:29.722356 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-1378361c-d83a-4f2d-a64b-7413a14974d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:47:29.787956 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 72/147] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Oct 14 12:47:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 14 12:47:29.887004 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeb9222-36d1-4575-8b7f-d6d8236e6d3b None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:29.986499 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeb9222-36d1-4575-8b7f-d6d8236e6d3b None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:29.995634 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1378361c-d83a-4f2d-a64b-7413a14974d8 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:30.002719 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:30.022716 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828ac3b1-4b87-4889-b20a-4b2b479c01af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:30.023346 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828ac3b1-4b87-4889-b20a-4b2b479c01af None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:30.023624 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828ac3b1-4b87-4889-b20a-4b2b479c01af None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:30.023894 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828ac3b1-4b87-4889-b20a-4b2b479c01af None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:30.034219 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828ac3b1-4b87-4889-b20a-4b2b479c01af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 12:47:30.039781 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-828ac3b1-4b87-4889-b20a-4b2b479c01af None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 14 12:47:30.039781 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:47:30.039781 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:47:30.039781 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:47:30.039781 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:47:30.039781 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:47:30.039781 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:47:30.039781 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:47:30.039781 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:47:30.039781 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:47:30.039781 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:47:30.039781 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:47:30.039781 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 12:47:30.039781 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 12:47:30.039781 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 12:47:30.039781 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 12:47:30.040630 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 12:47:30.040630 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 12:47:30.040630 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 12:47:30.040630 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 12:47:30.040630 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:47:30.040630 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:47:30.040630 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:47:30.040630 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:47:30.040630 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:47:30.040630 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:47:30.040630 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:47:30.040630 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 14 12:47:30.040630 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:47:30.040630 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:47:30.040630 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:47:30.040630 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:47:30.041549 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:47:30.041549 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:47:30.041549 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:47:30.041549 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:47:30.041549 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 12:47:30.041549 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 12:47:30.041549 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 12:47:30.041549 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 12:47:30.041549 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 12:47:30.041549 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 12:47:30.041549 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 14 12:47:30.041549 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 14 12:47:30.041549 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 76/148] 10.222.0.17 () {56 vars in 1096 bytes} [Fri Oct 14 12:47:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:47:30.046447 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828ac3b1-4b87-4889-b20a-4b2b479c01af None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:30.104019 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1378361c-d83a-4f2d-a64b-7413a14974d8 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:30.105546 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:30.139779 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70101a45-e142-4f0d-8308-6c92c085ead2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:30.140410 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70101a45-e142-4f0d-8308-6c92c085ead2 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:30.140686 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70101a45-e142-4f0d-8308-6c92c085ead2 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:30.140958 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70101a45-e142-4f0d-8308-6c92c085ead2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:30.149150 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828ac3b1-4b87-4889-b20a-4b2b479c01af None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:30.151496 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70101a45-e142-4f0d-8308-6c92c085ead2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 12:47:30.156355 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-70101a45-e142-4f0d-8308-6c92c085ead2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 14 12:47:30.156355 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:47:30.156355 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:47:30.156355 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:47:30.156355 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:47:30.156355 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:47:30.156355 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:47:30.156355 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:47:30.156355 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:47:30.156355 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:47:30.156355 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:47:30.156355 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:47:30.156355 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 12:47:30.156355 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 12:47:30.156355 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 12:47:30.156355 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 12:47:30.157283 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 12:47:30.157283 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 12:47:30.157283 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 12:47:30.157283 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 12:47:30.157283 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:47:30.157283 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:47:30.157283 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:47:30.157283 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:47:30.157283 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:47:30.157283 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:47:30.157283 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:47:30.157283 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 14 12:47:30.157283 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:47:30.157283 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:47:30.157283 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:47:30.157283 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:47:30.158732 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:47:30.158732 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:47:30.158732 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:47:30.158732 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:47:30.158732 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 12:47:30.158732 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 12:47:30.158732 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 12:47:30.158732 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 12:47:30.158732 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 12:47:30.158732 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 12:47:30.158732 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 14 12:47:30.158732 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 14 12:47:30.158732 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 73/149] 10.222.0.17 () {56 vars in 1114 bytes} [Fri Oct 14 12:47:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 14 12:47:30.158732 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70101a45-e142-4f0d-8308-6c92c085ead2 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:30.186557 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027dc54c-a2f2-4e4d-a3f6-386f4fcc6064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:30.187169 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027dc54c-a2f2-4e4d-a3f6-386f4fcc6064 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:30.187454 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027dc54c-a2f2-4e4d-a3f6-386f4fcc6064 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:30.187723 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027dc54c-a2f2-4e4d-a3f6-386f4fcc6064 None admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:30.188379 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027dc54c-a2f2-4e4d-a3f6-386f4fcc6064 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:30.188684 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027dc54c-a2f2-4e4d-a3f6-386f4fcc6064 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:30.190093 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027dc54c-a2f2-4e4d-a3f6-386f4fcc6064 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:30.199225 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 77/150] 10.222.0.17 () {56 vars in 1099 bytes} [Fri Oct 14 12:47:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 12:47:30.200111 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027dc54c-a2f2-4e4d-a3f6-386f4fcc6064 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:30.240646 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:30.259943 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70101a45-e142-4f0d-8308-6c92c085ead2 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:30.293227 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a426ead4-a48a-4e35-b0a8-d95a9a8a3571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:30.293775 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a426ead4-a48a-4e35-b0a8-d95a9a8a3571 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:30.294058 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a426ead4-a48a-4e35-b0a8-d95a9a8a3571 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:30.294358 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a426ead4-a48a-4e35-b0a8-d95a9a8a3571 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:30.295477 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a426ead4-a48a-4e35-b0a8-d95a9a8a3571 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:30.296949 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a426ead4-a48a-4e35-b0a8-d95a9a8a3571 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:30.302227 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 74/151] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Oct 14 12:47:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:30.302227 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a426ead4-a48a-4e35-b0a8-d95a9a8a3571 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:30.302432 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027dc54c-a2f2-4e4d-a3f6-386f4fcc6064 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:30.334164 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:30.337401 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad834365-ccc0-4c5e-b2b2-cff8d63947a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:30.338049 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad834365-ccc0-4c5e-b2b2-cff8d63947a2 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:30.338366 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad834365-ccc0-4c5e-b2b2-cff8d63947a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:30.338652 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad834365-ccc0-4c5e-b2b2-cff8d63947a2 None admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:30.339350 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad834365-ccc0-4c5e-b2b2-cff8d63947a2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:30.339661 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad834365-ccc0-4c5e-b2b2-cff8d63947a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:30.341130 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad834365-ccc0-4c5e-b2b2-cff8d63947a2 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:30.350210 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 78/152] 10.222.0.17 () {56 vars in 1111 bytes} [Fri Oct 14 12:47:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:30.356180 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad834365-ccc0-4c5e-b2b2-cff8d63947a2 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:30.416633 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a426ead4-a48a-4e35-b0a8-d95a9a8a3571 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:30.454044 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0591dfdb-084c-4939-b4aa-abc129d0a66c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:30.454694 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0591dfdb-084c-4939-b4aa-abc129d0a66c None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:30.454974 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0591dfdb-084c-4939-b4aa-abc129d0a66c None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:30.455249 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0591dfdb-084c-4939-b4aa-abc129d0a66c None admin] PATH_INFO: `/v3/users/8b12635429ae4cb9817607d9a2b582b3` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:30.457977 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:30.461463 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad834365-ccc0-4c5e-b2b2-cff8d63947a2 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:30.469720 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0591dfdb-084c-4939-b4aa-abc129d0a66c None admin] RBAC: Authorizing `identity:get_user(user_id=8b12635429ae4cb9817607d9a2b582b3)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:30.471253 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0591dfdb-084c-4939-b4aa-abc129d0a66c None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:30.472933 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 75/153] 10.222.0.17 () {56 vars in 1177 bytes} [Fri Oct 14 12:47:30 2022] GET /identity/v3/users/8b12635429ae4cb9817607d9a2b582b3 => generated 283 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:30.472933 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0591dfdb-084c-4939-b4aa-abc129d0a66c None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:30.498226 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c668dba0-f0b0-4ff6-977f-1166017d6ba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:30.498839 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c668dba0-f0b0-4ff6-977f-1166017d6ba4 None admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:30.499120 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c668dba0-f0b0-4ff6-977f-1166017d6ba4 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:30.499391 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c668dba0-f0b0-4ff6-977f-1166017d6ba4 None admin] PATH_INFO: `/v3/users` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:30.500047 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c668dba0-f0b0-4ff6-977f-1166017d6ba4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:30.501499 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c668dba0-f0b0-4ff6-977f-1166017d6ba4 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:30.529968 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 79/154] 10.222.0.17 () {60 vars in 1132 bytes} [Fri Oct 14 12:47:30 2022] POST /identity/v3/users => generated 297 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 12:47:30.530842 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c668dba0-f0b0-4ff6-977f-1166017d6ba4 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:30.580704 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:30.597054 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0591dfdb-084c-4939-b4aa-abc129d0a66c None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:30.639325 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a8b68f-1b74-48a6-9cb5-2f7cc58796a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:30.640334 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a8b68f-1b74-48a6-9cb5-2f7cc58796a3 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:30.640692 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a8b68f-1b74-48a6-9cb5-2f7cc58796a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:30.640969 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a8b68f-1b74-48a6-9cb5-2f7cc58796a3 None admin] PATH_INFO: `/v3/users/8b12635429ae4cb9817607d9a2b582b3` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:30.642220 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a8b68f-1b74-48a6-9cb5-2f7cc58796a3 None admin] RBAC: Authorizing `identity:get_user(user_id=8b12635429ae4cb9817607d9a2b582b3)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:30.643728 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a8b68f-1b74-48a6-9cb5-2f7cc58796a3 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:30.645735 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 76/155] 10.222.0.17 () {56 vars in 1177 bytes} [Fri Oct 14 12:47:30 2022] GET /identity/v3/users/8b12635429ae4cb9817607d9a2b582b3 => generated 283 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:30.651300 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a8b68f-1b74-48a6-9cb5-2f7cc58796a3 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:30.654993 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c668dba0-f0b0-4ff6-977f-1166017d6ba4 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:30.699148 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53056fe-ada7-437d-ab96-9e1870a6a22e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:30.699818 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53056fe-ada7-437d-ab96-9e1870a6a22e None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:30.700098 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53056fe-ada7-437d-ab96-9e1870a6a22e None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:30.700879 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53056fe-ada7-437d-ab96-9e1870a6a22e None admin] PATH_INFO: `/v3/projects/7941e70fc4dd4ecb9c70a568789af856` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:30.702653 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53056fe-ada7-437d-ab96-9e1870a6a22e None admin] RBAC: Authorizing `identity:get_project(project_id=7941e70fc4dd4ecb9c70a568789af856)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:30.704738 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53056fe-ada7-437d-ab96-9e1870a6a22e None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:30.709230 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 80/156] 10.222.0.17 () {56 vars in 1186 bytes} [Fri Oct 14 12:47:30 2022] GET /identity/v3/projects/7941e70fc4dd4ecb9c70a568789af856 => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:30.715097 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53056fe-ada7-437d-ab96-9e1870a6a22e None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:30.743875 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:30.771016 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a8b68f-1b74-48a6-9cb5-2f7cc58796a3 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:30.814931 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafc2844-f27c-4056-a55b-e9efec4b526e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:30.815853 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafc2844-f27c-4056-a55b-e9efec4b526e None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:30.816133 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafc2844-f27c-4056-a55b-e9efec4b526e None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:30.816405 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafc2844-f27c-4056-a55b-e9efec4b526e None admin] PATH_INFO: `/v3/projects/7941e70fc4dd4ecb9c70a568789af856` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:30.818716 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafc2844-f27c-4056-a55b-e9efec4b526e None admin] RBAC: Authorizing `identity:get_project(project_id=7941e70fc4dd4ecb9c70a568789af856)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:30.820268 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafc2844-f27c-4056-a55b-e9efec4b526e None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:30.823109 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 77/157] 10.222.0.17 () {56 vars in 1186 bytes} [Fri Oct 14 12:47:30 2022] GET /identity/v3/projects/7941e70fc4dd4ecb9c70a568789af856 => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 12:47:30.828971 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafc2844-f27c-4056-a55b-e9efec4b526e None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:30.834692 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53056fe-ada7-437d-ab96-9e1870a6a22e None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:30.862751 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:30.873723 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4631ff-13b2-451c-9854-9feb703b0624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:30.874564 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4631ff-13b2-451c-9854-9feb703b0624 None admin] REQUEST_METHOD: `PUT` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:30.874849 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4631ff-13b2-451c-9854-9feb703b0624 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:30.875124 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4631ff-13b2-451c-9854-9feb703b0624 None admin] PATH_INFO: `/v3/projects/7941e70fc4dd4ecb9c70a568789af856/users/8b12635429ae4cb9817607d9a2b582b3/roles/7f6e29e390bc41f7a9af17659a2e95d1` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:30.877088 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4631ff-13b2-451c-9854-9feb703b0624 None admin] RBAC: Authorizing `identity:create_grant(project_id=7941e70fc4dd4ecb9c70a568789af856, user_id=8b12635429ae4cb9817607d9a2b582b3, role_id=7f6e29e390bc41f7a9af17659a2e95d1)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:30.878595 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4631ff-13b2-451c-9854-9feb703b0624 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:30.896378 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 81/158] 10.222.0.17 () {58 vars in 1439 bytes} [Fri Oct 14 12:47:30 2022] PUT /identity/v3/projects/7941e70fc4dd4ecb9c70a568789af856/users/8b12635429ae4cb9817607d9a2b582b3/roles/7f6e29e390bc41f7a9af17659a2e95d1 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 12:47:30.955279 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafc2844-f27c-4056-a55b-e9efec4b526e None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:30.995837 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c9c085-1c20-435f-8fc1-4e72c661bebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:30.996525 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c9c085-1c20-435f-8fc1-4e72c661bebf None admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:30.996813 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c9c085-1c20-435f-8fc1-4e72c661bebf None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:30.997091 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c9c085-1c20-435f-8fc1-4e72c661bebf None admin] PATH_INFO: `/v3/projects/7941e70fc4dd4ecb9c70a568789af856/users/8b12635429ae4cb9817607d9a2b582b3/roles/251e12cde1564a10b367cc385e58b828` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:30.999364 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c9c085-1c20-435f-8fc1-4e72c661bebf None admin] RBAC: Authorizing `identity:create_grant(project_id=7941e70fc4dd4ecb9c70a568789af856, user_id=8b12635429ae4cb9817607d9a2b582b3, role_id=251e12cde1564a10b367cc385e58b828)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:31.000867 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c9c085-1c20-435f-8fc1-4e72c661bebf None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:31.018075 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 78/159] 10.222.0.17 () {58 vars in 1439 bytes} [Fri Oct 14 12:47:30 2022] PUT /identity/v3/projects/7941e70fc4dd4ecb9c70a568789af856/users/8b12635429ae4cb9817607d9a2b582b3/roles/251e12cde1564a10b367cc385e58b828 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 12:47:32.945637 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b24265a-4b38-4aae-b1d2-b95c23069d75 None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:32.946200 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b24265a-4b38-4aae-b1d2-b95c23069d75 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:32.946200 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b24265a-4b38-4aae-b1d2-b95c23069d75 None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:32.947771 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 82/160] 10.222.0.17 () {54 vars in 927 bytes} [Fri Oct 14 12:47:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:47:32.953149 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a55658-81e0-4514-8bea-a29be9f584cd None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:32.953574 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a55658-81e0-4514-8bea-a29be9f584cd None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:32.953762 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a55658-81e0-4514-8bea-a29be9f584cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:32.973843 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-c2a55658-81e0-4514-8bea-a29be9f584cd None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:47:32.975272 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-c2a55658-81e0-4514-8bea-a29be9f584cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:47:33.052278 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 79/161] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Oct 14 12:47:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 12:47:33.162997 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1656fa85-9837-4c91-8e6a-15023f05bdf1 None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:33.163334 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1656fa85-9837-4c91-8e6a-15023f05bdf1 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:33.163556 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1656fa85-9837-4c91-8e6a-15023f05bdf1 None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:33.165344 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 83/162] 10.222.0.17 () {54 vars in 927 bytes} [Fri Oct 14 12:47:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:47:33.171736 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2376c775-be29-44a6-8802-fc42e7f56c01 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:33.172099 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2376c775-be29-44a6-8802-fc42e7f56c01 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:33.172293 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2376c775-be29-44a6-8802-fc42e7f56c01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:33.194161 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-2376c775-be29-44a6-8802-fc42e7f56c01 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:47:33.195371 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-2376c775-be29-44a6-8802-fc42e7f56c01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:47:33.206054 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:33.270785 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 80/163] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Oct 14 12:47:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 12:47:33.284451 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70b0ef5-de4f-4a20-af0c-e47e50a43231 None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:33.284744 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70b0ef5-de4f-4a20-af0c-e47e50a43231 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:33.285003 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70b0ef5-de4f-4a20-af0c-e47e50a43231 None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:33.286575 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 84/164] 10.222.0.17 () {54 vars in 927 bytes} [Fri Oct 14 12:47:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:47:33.291978 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0c28ec-9527-4e1a-b35c-b563cb6bbc65 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:33.292268 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0c28ec-9527-4e1a-b35c-b563cb6bbc65 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:33.292537 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0c28ec-9527-4e1a-b35c-b563cb6bbc65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:33.311301 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-ff0c28ec-9527-4e1a-b35c-b563cb6bbc65 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:47:33.312478 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-ff0c28ec-9527-4e1a-b35c-b563cb6bbc65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:47:33.352398 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70b0ef5-de4f-4a20-af0c-e47e50a43231 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:33.387451 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 81/165] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Oct 14 12:47:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 12:47:33.450140 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:33.470948 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70b0ef5-de4f-4a20-af0c-e47e50a43231 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:33.509386 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee61afb-8edd-45c6-95cd-da9886ced5c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:33.510026 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee61afb-8edd-45c6-95cd-da9886ced5c3 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:33.510334 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee61afb-8edd-45c6-95cd-da9886ced5c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:33.510606 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee61afb-8edd-45c6-95cd-da9886ced5c3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:33.521918 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee61afb-8edd-45c6-95cd-da9886ced5c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 12:47:33.527096 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-aee61afb-8edd-45c6-95cd-da9886ced5c3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 14 12:47:33.527096 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:47:33.527096 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:47:33.527096 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:47:33.527096 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:47:33.527096 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:47:33.527096 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:47:33.527096 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:47:33.527096 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:47:33.527096 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:47:33.527096 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:47:33.527096 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:47:33.527096 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 12:47:33.527096 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 12:47:33.527096 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 12:47:33.527096 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 12:47:33.527946 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 12:47:33.527946 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 12:47:33.527946 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 12:47:33.527946 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 12:47:33.527946 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:47:33.527946 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:47:33.527946 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:47:33.527946 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:47:33.527946 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:47:33.527946 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:47:33.527946 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:47:33.527946 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 14 12:47:33.527946 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:47:33.527946 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:47:33.527946 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:47:33.527946 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:47:33.529255 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:47:33.529255 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:47:33.529255 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:47:33.529255 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:47:33.529255 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 12:47:33.529255 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 12:47:33.529255 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 12:47:33.529255 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 12:47:33.529255 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 12:47:33.529255 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 12:47:33.529255 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 14 12:47:33.529255 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 14 12:47:33.529255 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 85/166] 10.222.0.17 () {56 vars in 1099 bytes} [Fri Oct 14 12:47:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:47:33.535287 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0c28ec-9527-4e1a-b35c-b563cb6bbc65 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:33.557278 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee61afb-8edd-45c6-95cd-da9886ced5c3 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:33.633403 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:33.661730 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0c28ec-9527-4e1a-b35c-b563cb6bbc65 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:33.679221 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee61afb-8edd-45c6-95cd-da9886ced5c3 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:33.697042 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479d2d0b-15ca-46d5-b9e9-da552fca32b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:33.697650 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479d2d0b-15ca-46d5-b9e9-da552fca32b2 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:33.697921 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479d2d0b-15ca-46d5-b9e9-da552fca32b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:33.698214 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479d2d0b-15ca-46d5-b9e9-da552fca32b2 None admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:33.698900 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479d2d0b-15ca-46d5-b9e9-da552fca32b2 None admin] RBAC: Adding query filter params (name=member) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:33.699199 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479d2d0b-15ca-46d5-b9e9-da552fca32b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:33.700581 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479d2d0b-15ca-46d5-b9e9-da552fca32b2 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:33.708917 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 82/167] 10.222.0.17 () {56 vars in 1101 bytes} [Fri Oct 14 12:47:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:33.713942 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6912a591-ac81-4d48-8e0c-24f870fa3775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:33.714623 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6912a591-ac81-4d48-8e0c-24f870fa3775 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:33.714720 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daa3088-cdcb-4e1c-8181-bd627e1d4fe9 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:33.714906 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6912a591-ac81-4d48-8e0c-24f870fa3775 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:33.714995 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daa3088-cdcb-4e1c-8181-bd627e1d4fe9 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:33.715182 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6912a591-ac81-4d48-8e0c-24f870fa3775 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:33.715278 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daa3088-cdcb-4e1c-8181-bd627e1d4fe9 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:33.716453 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 83/168] 10.222.0.17 () {54 vars in 927 bytes} [Fri Oct 14 12:47:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:47:33.717143 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daa3088-cdcb-4e1c-8181-bd627e1d4fe9 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:33.731175 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6912a591-ac81-4d48-8e0c-24f870fa3775 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 12:47:33.736835 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-6912a591-ac81-4d48-8e0c-24f870fa3775 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 14 12:47:33.736835 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:47:33.736835 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:47:33.736835 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:47:33.736835 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:47:33.736835 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:47:33.736835 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:47:33.736835 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:47:33.736835 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:47:33.736835 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:47:33.736835 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:47:33.736835 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:47:33.736835 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 12:47:33.736835 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 12:47:33.736835 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 12:47:33.736835 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 12:47:33.737700 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 12:47:33.737700 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 12:47:33.737700 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 12:47:33.737700 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 12:47:33.737700 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:47:33.737700 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:47:33.737700 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:47:33.737700 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:47:33.737700 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:47:33.737700 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:47:33.737700 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:47:33.737700 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 14 12:47:33.737700 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:47:33.737700 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:47:33.737700 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:47:33.737700 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:47:33.738528 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:47:33.738528 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:47:33.738528 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:47:33.738528 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:47:33.738528 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 12:47:33.738528 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 12:47:33.738528 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 12:47:33.738528 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 12:47:33.738528 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 12:47:33.738528 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 12:47:33.738528 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 14 12:47:33.738528 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 14 12:47:33.738528 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 86/169] 10.222.0.17 () {56 vars in 1096 bytes} [Fri Oct 14 12:47:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 14 12:47:33.740293 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6912a591-ac81-4d48-8e0c-24f870fa3775 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:33.746840 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:33.823594 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daa3088-cdcb-4e1c-8181-bd627e1d4fe9 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:33.843934 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6912a591-ac81-4d48-8e0c-24f870fa3775 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:33.857804 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb323144-a96d-4061-a25e-cecee0e23daa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:33.858708 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb323144-a96d-4061-a25e-cecee0e23daa None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:33.858988 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb323144-a96d-4061-a25e-cecee0e23daa None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:33.859261 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb323144-a96d-4061-a25e-cecee0e23daa None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:33.861979 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:33.871232 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb323144-a96d-4061-a25e-cecee0e23daa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 12:47:33.876178 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-cb323144-a96d-4061-a25e-cecee0e23daa None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 14 12:47:33.876178 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:47:33.876178 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:47:33.876178 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:47:33.876178 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:47:33.876178 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:47:33.876178 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:47:33.876178 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:47:33.876178 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:47:33.876178 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:47:33.876178 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:47:33.876178 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:47:33.876178 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 12:47:33.876178 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 12:47:33.876178 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 12:47:33.876178 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 12:47:33.877112 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 12:47:33.877112 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 12:47:33.877112 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 12:47:33.877112 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 12:47:33.877112 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:47:33.877112 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:47:33.877112 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:47:33.877112 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:47:33.877112 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:47:33.877112 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:47:33.877112 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:47:33.877112 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 14 12:47:33.877112 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:47:33.877112 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:47:33.877112 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:47:33.877112 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:47:33.877882 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:47:33.877882 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:47:33.877882 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:47:33.877882 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:47:33.877882 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 12:47:33.877882 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 12:47:33.877882 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 12:47:33.877882 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 12:47:33.877882 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 12:47:33.877882 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 12:47:33.877882 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 14 12:47:33.877882 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 14 12:47:33.877882 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 84/170] 10.222.0.17 () {56 vars in 1114 bytes} [Fri Oct 14 12:47:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:47:33.878562 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9731c2-5220-426c-a5a0-af664385b685 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:33.879285 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9731c2-5220-426c-a5a0-af664385b685 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:33.879285 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9731c2-5220-426c-a5a0-af664385b685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:33.883879 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62adf7a5-0c76-4d53-a438-a003ac06f5f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:33.884573 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62adf7a5-0c76-4d53-a438-a003ac06f5f3 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:33.884819 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62adf7a5-0c76-4d53-a438-a003ac06f5f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:33.885082 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62adf7a5-0c76-4d53-a438-a003ac06f5f3 None admin] PATH_INFO: `/v3/users/025a71affd64465d8ef8f07a3a7d130f` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:33.897063 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-aa9731c2-5220-426c-a5a0-af664385b685 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:47:33.898284 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-aa9731c2-5220-426c-a5a0-af664385b685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:47:33.900672 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62adf7a5-0c76-4d53-a438-a003ac06f5f3 None admin] RBAC: Authorizing `identity:get_user(user_id=025a71affd64465d8ef8f07a3a7d130f)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:33.902224 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62adf7a5-0c76-4d53-a438-a003ac06f5f3 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:33.903904 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 87/171] 10.222.0.17 () {56 vars in 1177 bytes} [Fri Oct 14 12:47:33 2022] GET /identity/v3/users/025a71affd64465d8ef8f07a3a7d130f => generated 297 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:33.904677 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62adf7a5-0c76-4d53-a438-a003ac06f5f3 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:33.967413 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:33.968098 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 85/172] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Oct 14 12:47:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 12:47:33.968689 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9731c2-5220-426c-a5a0-af664385b685 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:34.013022 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62adf7a5-0c76-4d53-a438-a003ac06f5f3 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:34.052063 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a9c978-5cb4-4142-b068-1f4341b13b65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:34.052676 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a9c978-5cb4-4142-b068-1f4341b13b65 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:34.052964 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a9c978-5cb4-4142-b068-1f4341b13b65 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:34.053236 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a9c978-5cb4-4142-b068-1f4341b13b65 None admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:34.053915 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a9c978-5cb4-4142-b068-1f4341b13b65 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:34.054255 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a9c978-5cb4-4142-b068-1f4341b13b65 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:34.055650 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a9c978-5cb4-4142-b068-1f4341b13b65 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:34.064189 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 88/173] 10.222.0.17 () {56 vars in 1099 bytes} [Fri Oct 14 12:47:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:34.065221 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a9c978-5cb4-4142-b068-1f4341b13b65 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:34.092557 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9731c2-5220-426c-a5a0-af664385b685 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:34.122072 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:34.131402 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44d1697-da1a-44c5-aafb-1d8c2ead8bf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:34.132022 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44d1697-da1a-44c5-aafb-1d8c2ead8bf9 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:34.132310 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44d1697-da1a-44c5-aafb-1d8c2ead8bf9 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:34.132583 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44d1697-da1a-44c5-aafb-1d8c2ead8bf9 None admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:34.133256 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44d1697-da1a-44c5-aafb-1d8c2ead8bf9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:34.133562 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44d1697-da1a-44c5-aafb-1d8c2ead8bf9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:34.135005 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44d1697-da1a-44c5-aafb-1d8c2ead8bf9 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:34.143129 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 86/174] 10.222.0.17 () {56 vars in 1111 bytes} [Fri Oct 14 12:47:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:34.149156 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44d1697-da1a-44c5-aafb-1d8c2ead8bf9 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:34.182805 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a9c978-5cb4-4142-b068-1f4341b13b65 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:34.209341 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:34.223078 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d0405a-0906-4d5b-b8a5-8451efe19f0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:34.224772 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d0405a-0906-4d5b-b8a5-8451efe19f0d None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:34.225229 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d0405a-0906-4d5b-b8a5-8451efe19f0d None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:34.225701 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d0405a-0906-4d5b-b8a5-8451efe19f0d None admin] PATH_INFO: `/v3/projects/7941e70fc4dd4ecb9c70a568789af856` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:34.227138 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d0405a-0906-4d5b-b8a5-8451efe19f0d None admin] RBAC: Authorizing `identity:get_project(project_id=7941e70fc4dd4ecb9c70a568789af856)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:34.228838 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d0405a-0906-4d5b-b8a5-8451efe19f0d None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:34.231604 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 89/175] 10.222.0.17 () {56 vars in 1186 bytes} [Fri Oct 14 12:47:34 2022] GET /identity/v3/projects/7941e70fc4dd4ecb9c70a568789af856 => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:34.232887 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d0405a-0906-4d5b-b8a5-8451efe19f0d None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:34.255085 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44d1697-da1a-44c5-aafb-1d8c2ead8bf9 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:34.290349 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b10f9b-a7f5-45d0-82d0-6175197242b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:34.290903 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b10f9b-a7f5-45d0-82d0-6175197242b4 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:34.291177 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b10f9b-a7f5-45d0-82d0-6175197242b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:34.291446 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b10f9b-a7f5-45d0-82d0-6175197242b4 None admin] PATH_INFO: `/v3/users/8b12635429ae4cb9817607d9a2b582b3` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:34.292663 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b10f9b-a7f5-45d0-82d0-6175197242b4 None admin] RBAC: Authorizing `identity:get_user(user_id=8b12635429ae4cb9817607d9a2b582b3)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:34.294437 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b10f9b-a7f5-45d0-82d0-6175197242b4 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:34.296114 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 87/176] 10.222.0.17 () {56 vars in 1177 bytes} [Fri Oct 14 12:47:34 2022] GET /identity/v3/users/8b12635429ae4cb9817607d9a2b582b3 => generated 283 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:34.300713 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b10f9b-a7f5-45d0-82d0-6175197242b4 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:34.344329 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d0405a-0906-4d5b-b8a5-8451efe19f0d None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:34.353799 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:34.378221 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef90959d-8596-48ba-85b4-bfe4705cf7aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:34.378855 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef90959d-8596-48ba-85b4-bfe4705cf7aa None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:34.379132 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef90959d-8596-48ba-85b4-bfe4705cf7aa None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:34.380025 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef90959d-8596-48ba-85b4-bfe4705cf7aa None admin] PATH_INFO: `/v3/users/8b12635429ae4cb9817607d9a2b582b3` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:34.381166 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef90959d-8596-48ba-85b4-bfe4705cf7aa None admin] RBAC: Authorizing `identity:get_user(user_id=8b12635429ae4cb9817607d9a2b582b3)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:34.382658 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef90959d-8596-48ba-85b4-bfe4705cf7aa None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:34.384245 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 90/177] 10.222.0.17 () {56 vars in 1177 bytes} [Fri Oct 14 12:47:34 2022] GET /identity/v3/users/8b12635429ae4cb9817607d9a2b582b3 => generated 283 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:34.389017 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef90959d-8596-48ba-85b4-bfe4705cf7aa None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:34.403184 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b10f9b-a7f5-45d0-82d0-6175197242b4 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:34.438074 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c22826e-eb17-4799-8214-0042d4c89c6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:34.438763 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c22826e-eb17-4799-8214-0042d4c89c6f None admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:34.439042 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c22826e-eb17-4799-8214-0042d4c89c6f None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:34.439317 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c22826e-eb17-4799-8214-0042d4c89c6f None admin] PATH_INFO: `/v3/projects/7941e70fc4dd4ecb9c70a568789af856/users/025a71affd64465d8ef8f07a3a7d130f/roles/5e8849303a75425b9eaa2681cc031af1` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:34.441224 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c22826e-eb17-4799-8214-0042d4c89c6f None admin] RBAC: Authorizing `identity:create_grant(project_id=7941e70fc4dd4ecb9c70a568789af856, user_id=025a71affd64465d8ef8f07a3a7d130f, role_id=5e8849303a75425b9eaa2681cc031af1)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:34.443241 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c22826e-eb17-4799-8214-0042d4c89c6f None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:34.446769 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:34.460117 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 88/178] 10.222.0.17 () {58 vars in 1439 bytes} [Fri Oct 14 12:47:34 2022] PUT /identity/v3/projects/7941e70fc4dd4ecb9c70a568789af856/users/025a71affd64465d8ef8f07a3a7d130f/roles/5e8849303a75425b9eaa2681cc031af1 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 12:47:34.466078 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c22826e-eb17-4799-8214-0042d4c89c6f None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:34.495426 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef90959d-8596-48ba-85b4-bfe4705cf7aa None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:34.539350 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1524b540-7a7a-4f9f-97b3-0d50c1e79713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:34.540015 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1524b540-7a7a-4f9f-97b3-0d50c1e79713 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:34.540301 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1524b540-7a7a-4f9f-97b3-0d50c1e79713 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:34.540639 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1524b540-7a7a-4f9f-97b3-0d50c1e79713 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:34.541820 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1524b540-7a7a-4f9f-97b3-0d50c1e79713 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:34.543349 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1524b540-7a7a-4f9f-97b3-0d50c1e79713 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:34.545016 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 91/179] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Oct 14 12:47:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:34.550618 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1524b540-7a7a-4f9f-97b3-0d50c1e79713 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:34.591407 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c22826e-eb17-4799-8214-0042d4c89c6f None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:34.611325 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:34.635298 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd612541-7d1c-4b4d-b4e6-fcb45c495cb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:34.635917 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd612541-7d1c-4b4d-b4e6-fcb45c495cb2 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:34.636200 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd612541-7d1c-4b4d-b4e6-fcb45c495cb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:34.636471 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd612541-7d1c-4b4d-b4e6-fcb45c495cb2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:34.672105 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1524b540-7a7a-4f9f-97b3-0d50c1e79713 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:34.700859 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:34.709986 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967b1283-8586-4bb3-8c52-ea4b673e1a84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:34.710638 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967b1283-8586-4bb3-8c52-ea4b673e1a84 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:34.710920 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967b1283-8586-4bb3-8c52-ea4b673e1a84 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:34.711198 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967b1283-8586-4bb3-8c52-ea4b673e1a84 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:34.712817 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd612541-7d1c-4b4d-b4e6-fcb45c495cb2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:34.714417 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd612541-7d1c-4b4d-b4e6-fcb45c495cb2 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:34.789830 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967b1283-8586-4bb3-8c52-ea4b673e1a84 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:34.791545 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967b1283-8586-4bb3-8c52-ea4b673e1a84 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:34.821268 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 89/180] 10.222.0.17 () {58 vars in 1282 bytes} [Fri Oct 14 12:47:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 14 12:47:34.821268 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd612541-7d1c-4b4d-b4e6-fcb45c495cb2 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:34.836806 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:34.911378 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 92/181] 10.222.0.17 () {58 vars in 1282 bytes} [Fri Oct 14 12:47:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 14 12:47:34.912290 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967b1283-8586-4bb3-8c52-ea4b673e1a84 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:34.924514 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd612541-7d1c-4b4d-b4e6-fcb45c495cb2 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:34.942739 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:34.961208 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdf3d17-ff32-46fe-8c9d-4774bb8b7ef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:34.961827 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdf3d17-ff32-46fe-8c9d-4774bb8b7ef2 None admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:34.962110 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdf3d17-ff32-46fe-8c9d-4774bb8b7ef2 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:34.962414 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdf3d17-ff32-46fe-8c9d-4774bb8b7ef2 None admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:34.963070 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdf3d17-ff32-46fe-8c9d-4774bb8b7ef2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:34.964516 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdf3d17-ff32-46fe-8c9d-4774bb8b7ef2 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:34.986737 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 90/182] 10.222.0.17 () {60 vars in 1132 bytes} [Fri Oct 14 12:47:34 2022] POST /identity/v3/users => generated 297 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 12:47:34.987589 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdf3d17-ff32-46fe-8c9d-4774bb8b7ef2 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:35.066013 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967b1283-8586-4bb3-8c52-ea4b673e1a84 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:35.087275 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:35.121647 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01d0b3f-e87e-4fb6-a1d1-bb487e4a623e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:35.122353 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01d0b3f-e87e-4fb6-a1d1-bb487e4a623e None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:35.122638 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01d0b3f-e87e-4fb6-a1d1-bb487e4a623e None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:35.122916 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01d0b3f-e87e-4fb6-a1d1-bb487e4a623e None admin] PATH_INFO: `/v3/projects/7941e70fc4dd4ecb9c70a568789af856` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:35.124126 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01d0b3f-e87e-4fb6-a1d1-bb487e4a623e None admin] RBAC: Authorizing `identity:get_project(project_id=7941e70fc4dd4ecb9c70a568789af856)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:35.125745 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01d0b3f-e87e-4fb6-a1d1-bb487e4a623e None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:35.127577 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 93/183] 10.222.0.17 () {56 vars in 1186 bytes} [Fri Oct 14 12:47:34 2022] GET /identity/v3/projects/7941e70fc4dd4ecb9c70a568789af856 => generated 302 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:35.133169 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdf3d17-ff32-46fe-8c9d-4774bb8b7ef2 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:35.133503 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01d0b3f-e87e-4fb6-a1d1-bb487e4a623e None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:35.175102 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b64f82-33f2-45ba-a01e-8c53a67346ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:35.176455 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b64f82-33f2-45ba-a01e-8c53a67346ef None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:35.176931 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b64f82-33f2-45ba-a01e-8c53a67346ef None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:35.177395 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b64f82-33f2-45ba-a01e-8c53a67346ef None admin] PATH_INFO: `/v3/projects/7941e70fc4dd4ecb9c70a568789af856` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:35.178937 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b64f82-33f2-45ba-a01e-8c53a67346ef None admin] RBAC: Authorizing `identity:get_project(project_id=7941e70fc4dd4ecb9c70a568789af856)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:35.180912 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b64f82-33f2-45ba-a01e-8c53a67346ef None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:35.183283 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 91/184] 10.222.0.17 () {56 vars in 1186 bytes} [Fri Oct 14 12:47:34 2022] GET /identity/v3/projects/7941e70fc4dd4ecb9c70a568789af856 => generated 302 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:35.191159 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b64f82-33f2-45ba-a01e-8c53a67346ef None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:35.248984 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:35.261671 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01d0b3f-e87e-4fb6-a1d1-bb487e4a623e None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:35.311851 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9647d84-45c4-47f4-9a64-da8f9d40d786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:35.312483 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9647d84-45c4-47f4-9a64-da8f9d40d786 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:35.312761 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9647d84-45c4-47f4-9a64-da8f9d40d786 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:35.313022 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9647d84-45c4-47f4-9a64-da8f9d40d786 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:35.313771 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9647d84-45c4-47f4-9a64-da8f9d40d786 None admin] RBAC: Adding query filter params (role.id=7f6e29e390bc41f7a9af17659a2e95d1, scope.project.id=7941e70fc4dd4ecb9c70a568789af856, user.id=8b12635429ae4cb9817607d9a2b582b3) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:35.314081 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9647d84-45c4-47f4-9a64-da8f9d40d786 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:35.316525 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9647d84-45c4-47f4-9a64-da8f9d40d786 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:35.325361 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 94/185] 10.222.0.17 () {56 vars in 1374 bytes} [Fri Oct 14 12:47:35 2022] GET /identity/v3/role_assignments?user.id=8b12635429ae4cb9817607d9a2b582b3&scope.project.id=7941e70fc4dd4ecb9c70a568789af856&role.id=7f6e29e390bc41f7a9af17659a2e95d1 => generated 608 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:35.350402 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b64f82-33f2-45ba-a01e-8c53a67346ef None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:35.398345 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ed208b-e491-4fed-a06c-6cef484c517a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:35.398985 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ed208b-e491-4fed-a06c-6cef484c517a None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:35.399261 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ed208b-e491-4fed-a06c-6cef484c517a None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:35.399527 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ed208b-e491-4fed-a06c-6cef484c517a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:35.400270 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ed208b-e491-4fed-a06c-6cef484c517a None admin] RBAC: Adding query filter params (role.id=251e12cde1564a10b367cc385e58b828, scope.project.id=7941e70fc4dd4ecb9c70a568789af856, user.id=8b12635429ae4cb9817607d9a2b582b3) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:35.400575 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ed208b-e491-4fed-a06c-6cef484c517a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:35.402103 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ed208b-e491-4fed-a06c-6cef484c517a None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:35.409138 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 92/186] 10.222.0.17 () {56 vars in 1374 bytes} [Fri Oct 14 12:47:35 2022] GET /identity/v3/role_assignments?user.id=8b12635429ae4cb9817607d9a2b582b3&scope.project.id=7941e70fc4dd4ecb9c70a568789af856&role.id=251e12cde1564a10b367cc385e58b828 => generated 608 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:36.685248 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0006fffb-529f-498c-8cf8-07cfaf173f6d None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:36.685765 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0006fffb-529f-498c-8cf8-07cfaf173f6d None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:36.685840 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0006fffb-529f-498c-8cf8-07cfaf173f6d None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:36.687302 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 95/187] 10.222.0.17 () {54 vars in 927 bytes} [Fri Oct 14 12:47:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:47:36.692898 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3180e49b-b06a-40e4-af49-240d7a7f6669 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:36.693326 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3180e49b-b06a-40e4-af49-240d7a7f6669 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:36.693501 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3180e49b-b06a-40e4-af49-240d7a7f6669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:36.706920 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:36.712756 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-3180e49b-b06a-40e4-af49-240d7a7f6669 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:47:36.714777 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-3180e49b-b06a-40e4-af49-240d7a7f6669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:47:36.783415 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 93/188] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Oct 14 12:47:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 14 12:47:37.053296 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0006fffb-529f-498c-8cf8-07cfaf173f6d None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:37.181510 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0006fffb-529f-498c-8cf8-07cfaf173f6d None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:37.215641 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a95e1e-6cdd-4a08-8a2d-e76f75cdae76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:37.216269 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a95e1e-6cdd-4a08-8a2d-e76f75cdae76 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:37.216543 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a95e1e-6cdd-4a08-8a2d-e76f75cdae76 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:37.216809 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a95e1e-6cdd-4a08-8a2d-e76f75cdae76 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:37.228136 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a95e1e-6cdd-4a08-8a2d-e76f75cdae76 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 12:47:37.232976 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-b5a95e1e-6cdd-4a08-8a2d-e76f75cdae76 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 14 12:47:37.232976 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:47:37.232976 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:47:37.232976 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:47:37.232976 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:47:37.232976 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:47:37.232976 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:47:37.232976 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:47:37.232976 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:47:37.232976 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:47:37.232976 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:47:37.232976 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:47:37.232976 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 12:47:37.232976 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 12:47:37.232976 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 12:47:37.232976 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 12:47:37.234140 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 12:47:37.234140 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 12:47:37.234140 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 12:47:37.234140 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 12:47:37.234140 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:47:37.234140 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:47:37.234140 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:47:37.234140 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:47:37.234140 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:47:37.234140 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:47:37.234140 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:47:37.234140 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 14 12:47:37.234140 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:47:37.234140 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:47:37.234140 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:47:37.234140 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:47:37.234945 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:47:37.234945 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:47:37.234945 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:47:37.234945 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:47:37.234945 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 12:47:37.234945 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 12:47:37.234945 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 12:47:37.234945 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 12:47:37.234945 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 12:47:37.234945 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 12:47:37.234945 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 14 12:47:37.234945 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 14 12:47:37.234945 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 96/189] 10.222.0.17 () {56 vars in 1099 bytes} [Fri Oct 14 12:47:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:47:37.241597 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3180e49b-b06a-40e4-af49-240d7a7f6669 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:37.356461 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3180e49b-b06a-40e4-af49-240d7a7f6669 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:37.394403 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c1bf80-9edf-41e7-861f-df4fac9ad76b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:37.395656 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c1bf80-9edf-41e7-861f-df4fac9ad76b None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:37.395949 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c1bf80-9edf-41e7-861f-df4fac9ad76b None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:37.396223 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c1bf80-9edf-41e7-861f-df4fac9ad76b None admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:37.396905 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c1bf80-9edf-41e7-861f-df4fac9ad76b None admin] RBAC: Adding query filter params (name=member) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:37.397210 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c1bf80-9edf-41e7-861f-df4fac9ad76b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:37.398635 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c1bf80-9edf-41e7-861f-df4fac9ad76b None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:37.400292 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:37.409641 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 94/190] 10.222.0.17 () {56 vars in 1101 bytes} [Fri Oct 14 12:47:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:37.416360 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a95e1e-6cdd-4a08-8a2d-e76f75cdae76 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:37.444502 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:37.540262 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a95e1e-6cdd-4a08-8a2d-e76f75cdae76 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:37.556531 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b48044-bafe-4bd8-8874-aad2768a0159 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:37.556912 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b48044-bafe-4bd8-8874-aad2768a0159 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:37.557301 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b48044-bafe-4bd8-8874-aad2768a0159 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:37.558700 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 95/191] 10.222.0.17 () {54 vars in 927 bytes} [Fri Oct 14 12:47:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:47:37.566047 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d33169f-f0f0-4566-8719-5941caed83ae None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:37.566356 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d33169f-f0f0-4566-8719-5941caed83ae None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:37.567198 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d33169f-f0f0-4566-8719-5941caed83ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:37.588784 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f26a6d7-7117-43c7-885a-c914344d913c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:37.589024 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-3d33169f-f0f0-4566-8719-5941caed83ae None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:47:37.589431 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f26a6d7-7117-43c7-885a-c914344d913c None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:37.589712 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f26a6d7-7117-43c7-885a-c914344d913c None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:37.589991 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f26a6d7-7117-43c7-885a-c914344d913c None admin] PATH_INFO: `/v3/users/025a71affd64465d8ef8f07a3a7d130f` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:37.590182 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-3d33169f-f0f0-4566-8719-5941caed83ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:47:37.591252 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f26a6d7-7117-43c7-885a-c914344d913c None admin] RBAC: Authorizing `identity:get_user(user_id=025a71affd64465d8ef8f07a3a7d130f)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:37.592953 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f26a6d7-7117-43c7-885a-c914344d913c None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:37.595672 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 97/192] 10.222.0.17 () {56 vars in 1177 bytes} [Fri Oct 14 12:47:37 2022] GET /identity/v3/users/025a71affd64465d8ef8f07a3a7d130f => generated 297 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:37.601408 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f26a6d7-7117-43c7-885a-c914344d913c None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:37.665330 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 96/193] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Oct 14 12:47:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 14 12:47:37.666562 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbdcbc8-b388-4387-8142-a2489cf40e79 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:37.666852 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbdcbc8-b388-4387-8142-a2489cf40e79 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:37.667122 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbdcbc8-b388-4387-8142-a2489cf40e79 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:37.668535 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 97/194] 10.222.0.17 () {54 vars in 927 bytes} [Fri Oct 14 12:47:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:47:37.673804 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b5c19a-3e2a-4781-aaa0-7bf1ac639354 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:37.674089 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b5c19a-3e2a-4781-aaa0-7bf1ac639354 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:37.674392 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b5c19a-3e2a-4781-aaa0-7bf1ac639354 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:37.693444 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-46b5c19a-3e2a-4781-aaa0-7bf1ac639354 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:47:37.694682 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-46b5c19a-3e2a-4781-aaa0-7bf1ac639354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:47:37.711377 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:37.725822 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f26a6d7-7117-43c7-885a-c914344d913c None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:37.769849 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d659e1-431e-4358-9f3c-6dcbdebbf3ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:37.771177 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d659e1-431e-4358-9f3c-6dcbdebbf3ba None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:37.771454 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d659e1-431e-4358-9f3c-6dcbdebbf3ba None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:37.771724 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d659e1-431e-4358-9f3c-6dcbdebbf3ba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:37.771883 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 98/195] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Oct 14 12:47:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 14 12:47:37.863228 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d659e1-431e-4358-9f3c-6dcbdebbf3ba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:37.865891 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d659e1-431e-4358-9f3c-6dcbdebbf3ba None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:37.938205 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b5c19a-3e2a-4781-aaa0-7bf1ac639354 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:37.984380 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:38.003148 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 98/196] 10.222.0.17 () {58 vars in 1282 bytes} [Fri Oct 14 12:47:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 14 12:47:38.004911 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d659e1-431e-4358-9f3c-6dcbdebbf3ba None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:38.015986 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:38.067250 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b5c19a-3e2a-4781-aaa0-7bf1ac639354 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:38.109984 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ed2389-95ed-43ca-bf5c-0e1eca295d0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:38.110661 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ed2389-95ed-43ca-bf5c-0e1eca295d0f None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:38.110934 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ed2389-95ed-43ca-bf5c-0e1eca295d0f None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:38.111200 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ed2389-95ed-43ca-bf5c-0e1eca295d0f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:38.122233 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ed2389-95ed-43ca-bf5c-0e1eca295d0f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 12:47:38.124521 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d659e1-431e-4358-9f3c-6dcbdebbf3ba None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:38.127148 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-a2ed2389-95ed-43ca-bf5c-0e1eca295d0f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 14 12:47:38.127148 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:47:38.127148 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:47:38.127148 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:47:38.127148 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:47:38.127148 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:47:38.127148 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:47:38.127148 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:47:38.127148 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:47:38.127148 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:47:38.127148 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:47:38.127148 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:47:38.127148 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 12:47:38.127148 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 12:47:38.127148 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 12:47:38.127148 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 12:47:38.128215 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 12:47:38.128215 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 12:47:38.128215 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 12:47:38.128215 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 12:47:38.128215 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:47:38.128215 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:47:38.128215 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:47:38.128215 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:47:38.128215 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:47:38.128215 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:47:38.128215 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:47:38.128215 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 14 12:47:38.128215 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:47:38.128215 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:47:38.128215 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:47:38.128215 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:47:38.129013 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:47:38.129013 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:47:38.129013 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:47:38.129013 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:47:38.129013 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 12:47:38.129013 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 12:47:38.129013 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 12:47:38.129013 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 12:47:38.129013 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 12:47:38.129013 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 12:47:38.129013 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 14 12:47:38.129013 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 14 12:47:38.129013 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 99/197] 10.222.0.17 () {56 vars in 1099 bytes} [Fri Oct 14 12:47:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 14 12:47:38.134148 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ed2389-95ed-43ca-bf5c-0e1eca295d0f None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:38.163775 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750c1dfa-0923-4dfc-a900-5a22319854f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:38.164415 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750c1dfa-0923-4dfc-a900-5a22319854f1 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:38.164695 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750c1dfa-0923-4dfc-a900-5a22319854f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:38.164985 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750c1dfa-0923-4dfc-a900-5a22319854f1 None admin] PATH_INFO: `/v3/projects/7941e70fc4dd4ecb9c70a568789af856` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:38.166105 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750c1dfa-0923-4dfc-a900-5a22319854f1 None admin] RBAC: Authorizing `identity:get_project(project_id=7941e70fc4dd4ecb9c70a568789af856)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:38.167621 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750c1dfa-0923-4dfc-a900-5a22319854f1 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:38.169282 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 99/198] 10.222.0.17 () {56 vars in 1186 bytes} [Fri Oct 14 12:47:38 2022] GET /identity/v3/projects/7941e70fc4dd4ecb9c70a568789af856 => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:38.170069 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750c1dfa-0923-4dfc-a900-5a22319854f1 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:38.229124 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:38.242914 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ed2389-95ed-43ca-bf5c-0e1eca295d0f None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:38.260901 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:38.276706 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750c1dfa-0923-4dfc-a900-5a22319854f1 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:38.280843 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30e0d4a-48ca-41a5-bbcb-9c8c6f920e0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:38.281478 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30e0d4a-48ca-41a5-bbcb-9c8c6f920e0f None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:38.281753 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30e0d4a-48ca-41a5-bbcb-9c8c6f920e0f None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:38.282020 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30e0d4a-48ca-41a5-bbcb-9c8c6f920e0f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:38.283177 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30e0d4a-48ca-41a5-bbcb-9c8c6f920e0f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:38.284642 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30e0d4a-48ca-41a5-bbcb-9c8c6f920e0f None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:38.286903 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 100/199] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Oct 14 12:47:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:38.287692 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30e0d4a-48ca-41a5-bbcb-9c8c6f920e0f None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:38.315526 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7155b106-232c-497e-9a86-f5d15a3349d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:38.316137 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7155b106-232c-497e-9a86-f5d15a3349d9 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:38.316415 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7155b106-232c-497e-9a86-f5d15a3349d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:38.316731 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7155b106-232c-497e-9a86-f5d15a3349d9 None admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:38.317400 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7155b106-232c-497e-9a86-f5d15a3349d9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:38.317707 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7155b106-232c-497e-9a86-f5d15a3349d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:38.319129 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7155b106-232c-497e-9a86-f5d15a3349d9 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:38.327728 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 100/200] 10.222.0.17 () {56 vars in 1101 bytes} [Fri Oct 14 12:47:38 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:38.329775 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7155b106-232c-497e-9a86-f5d15a3349d9 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:38.416983 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30e0d4a-48ca-41a5-bbcb-9c8c6f920e0f None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:38.442856 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7155b106-232c-497e-9a86-f5d15a3349d9 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:38.458537 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28e95ff-7987-4a42-bd04-bbaa0db20d34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:38.459577 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28e95ff-7987-4a42-bd04-bbaa0db20d34 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:38.460073 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28e95ff-7987-4a42-bd04-bbaa0db20d34 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:38.460576 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28e95ff-7987-4a42-bd04-bbaa0db20d34 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:38.461140 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:38.461970 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28e95ff-7987-4a42-bd04-bbaa0db20d34 None admin] RBAC: Adding query filter params (role.id=5e8849303a75425b9eaa2681cc031af1, scope.project.id=7941e70fc4dd4ecb9c70a568789af856, user.id=025a71affd64465d8ef8f07a3a7d130f) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:38.462572 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28e95ff-7987-4a42-bd04-bbaa0db20d34 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:38.464259 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28e95ff-7987-4a42-bd04-bbaa0db20d34 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:38.470931 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 101/201] 10.222.0.17 () {56 vars in 1374 bytes} [Fri Oct 14 12:47:38 2022] GET /identity/v3/role_assignments?user.id=025a71affd64465d8ef8f07a3a7d130f&scope.project.id=7941e70fc4dd4ecb9c70a568789af856&role.id=5e8849303a75425b9eaa2681cc031af1 => generated 608 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:38.471781 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28e95ff-7987-4a42-bd04-bbaa0db20d34 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:38.481878 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0dd84a-c209-492b-ab66-61ca16fda762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:38.483426 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0dd84a-c209-492b-ab66-61ca16fda762 None admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:38.483426 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0dd84a-c209-492b-ab66-61ca16fda762 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:38.483426 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0dd84a-c209-492b-ab66-61ca16fda762 None admin] PATH_INFO: `/v3/users` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:38.483999 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0dd84a-c209-492b-ab66-61ca16fda762 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:38.485538 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0dd84a-c209-492b-ab66-61ca16fda762 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:38.522159 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 101/202] 10.222.0.17 () {60 vars in 1132 bytes} [Fri Oct 14 12:47:38 2022] POST /identity/v3/users => generated 293 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 12:47:38.553833 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:38.639912 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28e95ff-7987-4a42-bd04-bbaa0db20d34 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:38.683434 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e936b6d6-20d9-4432-a26d-7d10fd03791f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:38.684156 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e936b6d6-20d9-4432-a26d-7d10fd03791f None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:38.684442 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e936b6d6-20d9-4432-a26d-7d10fd03791f None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:38.684717 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e936b6d6-20d9-4432-a26d-7d10fd03791f None admin] PATH_INFO: `/v3/users/a4fba1b6f31547129f3ed3024eb16f55` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:38.700748 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e936b6d6-20d9-4432-a26d-7d10fd03791f None admin] RBAC: Authorizing `identity:get_user(user_id=a4fba1b6f31547129f3ed3024eb16f55)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:38.702303 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e936b6d6-20d9-4432-a26d-7d10fd03791f None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:38.704029 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 102/203] 10.222.0.17 () {56 vars in 1177 bytes} [Fri Oct 14 12:47:38 2022] GET /identity/v3/users/a4fba1b6f31547129f3ed3024eb16f55 => generated 297 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:38.712945 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0dd84a-c209-492b-ab66-61ca16fda762 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:38.848951 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0dd84a-c209-492b-ab66-61ca16fda762 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:38.889102 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfd7383-8f5b-4df4-b399-74cef96887c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:38.889835 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfd7383-8f5b-4df4-b399-74cef96887c0 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:38.890087 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfd7383-8f5b-4df4-b399-74cef96887c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:38.890409 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfd7383-8f5b-4df4-b399-74cef96887c0 None admin] PATH_INFO: `/v3/projects/7941e70fc4dd4ecb9c70a568789af856` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:38.891570 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfd7383-8f5b-4df4-b399-74cef96887c0 None admin] RBAC: Authorizing `identity:get_project(project_id=7941e70fc4dd4ecb9c70a568789af856)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:38.893110 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfd7383-8f5b-4df4-b399-74cef96887c0 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:38.897241 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 102/204] 10.222.0.17 () {56 vars in 1186 bytes} [Fri Oct 14 12:47:38 2022] GET /identity/v3/projects/7941e70fc4dd4ecb9c70a568789af856 => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:38.900859 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e936b6d6-20d9-4432-a26d-7d10fd03791f None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:39.019650 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e936b6d6-20d9-4432-a26d-7d10fd03791f None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:39.028238 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:39.063543 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94c60de-7727-4762-a9c7-e572b407ca55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:39.064205 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94c60de-7727-4762-a9c7-e572b407ca55 None admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:39.064480 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94c60de-7727-4762-a9c7-e572b407ca55 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:39.064753 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94c60de-7727-4762-a9c7-e572b407ca55 None admin] PATH_INFO: `/v3/projects/7941e70fc4dd4ecb9c70a568789af856/users/a4fba1b6f31547129f3ed3024eb16f55/roles/8cab83b8007b48b1934e19126b3170a6` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:39.066753 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94c60de-7727-4762-a9c7-e572b407ca55 None admin] RBAC: Authorizing `identity:create_grant(project_id=7941e70fc4dd4ecb9c70a568789af856, user_id=a4fba1b6f31547129f3ed3024eb16f55, role_id=8cab83b8007b48b1934e19126b3170a6)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:39.069272 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94c60de-7727-4762-a9c7-e572b407ca55 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:39.084304 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 103/205] 10.222.0.17 () {58 vars in 1439 bytes} [Fri Oct 14 12:47:38 2022] PUT /identity/v3/projects/7941e70fc4dd4ecb9c70a568789af856/users/a4fba1b6f31547129f3ed3024eb16f55/roles/8cab83b8007b48b1934e19126b3170a6 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 12:47:40.890527 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236e9bdf-818a-4615-b931-7cede2f7e01a None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:40.891048 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236e9bdf-818a-4615-b931-7cede2f7e01a None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:40.891149 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236e9bdf-818a-4615-b931-7cede2f7e01a None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:40.892540 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 103/206] 10.222.0.17 () {54 vars in 927 bytes} [Fri Oct 14 12:47:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:47:40.898557 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04fcf38-665b-472a-a97e-e2577e554f86 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:40.899057 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04fcf38-665b-472a-a97e-e2577e554f86 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:40.899133 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04fcf38-665b-472a-a97e-e2577e554f86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:40.920183 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-e04fcf38-665b-472a-a97e-e2577e554f86 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:47:40.922413 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-e04fcf38-665b-472a-a97e-e2577e554f86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:47:40.972460 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaecd86-1076-4340-a2e2-2d48e4343d2d None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:40.972776 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaecd86-1076-4340-a2e2-2d48e4343d2d None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:40.973065 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaecd86-1076-4340-a2e2-2d48e4343d2d None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:40.974855 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 104/207] 10.222.0.17 () {54 vars in 927 bytes} [Fri Oct 14 12:47:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 14 12:47:40.981864 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414450a6-8e1f-4a7a-b503-c543df35991e None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:40.982174 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414450a6-8e1f-4a7a-b503-c543df35991e None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:40.982460 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414450a6-8e1f-4a7a-b503-c543df35991e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:41.003495 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-414450a6-8e1f-4a7a-b503-c543df35991e None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:47:41.005391 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-414450a6-8e1f-4a7a-b503-c543df35991e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:47:41.010032 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 104/208] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Oct 14 12:47:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 12:47:41.057393 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:41.102309 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 105/209] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Oct 14 12:47:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 14 12:47:41.298094 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04fcf38-665b-472a-a97e-e2577e554f86 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:41.300101 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cd687e-50a4-47ae-b347-9013512a0b38 None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:41.300396 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cd687e-50a4-47ae-b347-9013512a0b38 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:41.300670 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cd687e-50a4-47ae-b347-9013512a0b38 None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:41.303781 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 106/210] 10.222.0.17 () {54 vars in 927 bytes} [Fri Oct 14 12:47:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 14 12:47:41.308257 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c50562-7669-405b-83ce-9a1acf271c08 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:41.308548 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c50562-7669-405b-83ce-9a1acf271c08 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:41.308820 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c50562-7669-405b-83ce-9a1acf271c08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:41.328581 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-88c50562-7669-405b-83ce-9a1acf271c08 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:47:41.329790 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-88c50562-7669-405b-83ce-9a1acf271c08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:47:41.413700 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:41.418385 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 107/211] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Oct 14 12:47:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 14 12:47:41.422185 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c50562-7669-405b-83ce-9a1acf271c08 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:41.425344 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04fcf38-665b-472a-a97e-e2577e554f86 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:41.469327 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d231710-9d36-49f7-8167-813bce88315a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:41.470304 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d231710-9d36-49f7-8167-813bce88315a None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:41.471001 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d231710-9d36-49f7-8167-813bce88315a None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:41.471286 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d231710-9d36-49f7-8167-813bce88315a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:41.485142 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d231710-9d36-49f7-8167-813bce88315a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 12:47:41.490098 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-7d231710-9d36-49f7-8167-813bce88315a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 14 12:47:41.490098 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:47:41.490098 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:47:41.490098 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:47:41.490098 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:47:41.490098 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:47:41.490098 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:47:41.490098 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:47:41.490098 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:47:41.490098 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:47:41.490098 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:47:41.490098 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:47:41.490098 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 12:47:41.490098 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 12:47:41.490098 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 12:47:41.490098 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 12:47:41.491026 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 12:47:41.491026 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 12:47:41.491026 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 12:47:41.491026 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 12:47:41.491026 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:47:41.491026 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:47:41.491026 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:47:41.491026 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:47:41.491026 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:47:41.491026 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:47:41.491026 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:47:41.491026 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 14 12:47:41.491026 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:47:41.491026 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:47:41.491026 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:47:41.491026 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:47:41.491804 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:47:41.491804 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:47:41.491804 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:47:41.491804 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:47:41.491804 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 12:47:41.491804 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 12:47:41.491804 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 12:47:41.491804 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 12:47:41.491804 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 12:47:41.491804 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 12:47:41.491804 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 14 12:47:41.491804 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 14 12:47:41.491804 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 105/212] 10.222.0.17 () {56 vars in 1099 bytes} [Fri Oct 14 12:47:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:47:41.497235 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d231710-9d36-49f7-8167-813bce88315a None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:41.529044 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c50562-7669-405b-83ce-9a1acf271c08 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:41.530734 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:41.568983 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d524f61-c6b4-4a86-86d0-16739d509033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:41.569564 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d524f61-c6b4-4a86-86d0-16739d509033 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:41.569846 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d524f61-c6b4-4a86-86d0-16739d509033 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:41.570138 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d524f61-c6b4-4a86-86d0-16739d509033 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:41.571410 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d524f61-c6b4-4a86-86d0-16739d509033 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:41.572907 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d524f61-c6b4-4a86-86d0-16739d509033 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:41.574684 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 108/213] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Oct 14 12:47:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:41.580732 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d524f61-c6b4-4a86-86d0-16739d509033 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:41.622238 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d231710-9d36-49f7-8167-813bce88315a None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:41.664712 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735e42c2-2819-494f-9148-b85b781522ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:41.665329 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735e42c2-2819-494f-9148-b85b781522ef None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:41.665605 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735e42c2-2819-494f-9148-b85b781522ef None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:41.665872 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735e42c2-2819-494f-9148-b85b781522ef None admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:41.666573 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735e42c2-2819-494f-9148-b85b781522ef None admin] RBAC: Adding query filter params (name=member) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:41.666898 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735e42c2-2819-494f-9148-b85b781522ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:41.668295 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735e42c2-2819-494f-9148-b85b781522ef None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:41.684985 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 106/214] 10.222.0.17 () {56 vars in 1101 bytes} [Fri Oct 14 12:47:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 12:47:41.685836 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735e42c2-2819-494f-9148-b85b781522ef None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:41.697881 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d524f61-c6b4-4a86-86d0-16739d509033 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:41.705171 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:41.738461 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147f3ffe-6fc3-4b6a-b640-53eb92e826b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:41.739080 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147f3ffe-6fc3-4b6a-b640-53eb92e826b4 None admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:41.739356 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147f3ffe-6fc3-4b6a-b640-53eb92e826b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:41.739623 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147f3ffe-6fc3-4b6a-b640-53eb92e826b4 None admin] PATH_INFO: `/v3/users` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:41.740289 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147f3ffe-6fc3-4b6a-b640-53eb92e826b4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:41.741747 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147f3ffe-6fc3-4b6a-b640-53eb92e826b4 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:41.763235 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 109/215] 10.222.0.17 () {60 vars in 1132 bytes} [Fri Oct 14 12:47:41 2022] POST /identity/v3/users => generated 293 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 12:47:41.764078 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147f3ffe-6fc3-4b6a-b640-53eb92e826b4 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:41.801746 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:41.838098 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735e42c2-2819-494f-9148-b85b781522ef None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:41.893560 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3b042f-c570-4f3b-bbfc-6e6f2be84224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:41.894463 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3b042f-c570-4f3b-bbfc-6e6f2be84224 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:41.894978 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3b042f-c570-4f3b-bbfc-6e6f2be84224 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:41.895376 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3b042f-c570-4f3b-bbfc-6e6f2be84224 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:41.911687 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3b042f-c570-4f3b-bbfc-6e6f2be84224 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 12:47:41.917469 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-2c3b042f-c570-4f3b-bbfc-6e6f2be84224 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 14 12:47:41.917469 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:47:41.917469 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:47:41.917469 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:47:41.917469 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:47:41.917469 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:47:41.917469 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:47:41.917469 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:47:41.917469 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:47:41.917469 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:47:41.917469 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:47:41.917469 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:47:41.917469 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 12:47:41.917469 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 12:47:41.917469 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 12:47:41.917469 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 12:47:41.919488 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 12:47:41.919488 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 12:47:41.919488 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 12:47:41.919488 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 12:47:41.919488 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:47:41.919488 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:47:41.919488 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:47:41.919488 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:47:41.919488 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:47:41.919488 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:47:41.919488 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:47:41.919488 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 14 12:47:41.919488 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:47:41.919488 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:47:41.919488 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:47:41.919488 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:47:41.921077 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:47:41.921077 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:47:41.921077 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:47:41.921077 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:47:41.921077 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 12:47:41.921077 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 12:47:41.921077 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 12:47:41.921077 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 12:47:41.921077 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 12:47:41.921077 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 12:47:41.921077 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 14 12:47:41.921077 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 14 12:47:41.921077 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 107/216] 10.222.0.17 () {56 vars in 1099 bytes} [Fri Oct 14 12:47:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 14 12:47:41.924602 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3b042f-c570-4f3b-bbfc-6e6f2be84224 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:41.932481 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147f3ffe-6fc3-4b6a-b640-53eb92e826b4 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:41.992831 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb50289-7a21-4968-aac4-e3340987b5c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:41.993503 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb50289-7a21-4968-aac4-e3340987b5c3 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:41.993786 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb50289-7a21-4968-aac4-e3340987b5c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:41.994054 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb50289-7a21-4968-aac4-e3340987b5c3 None admin] PATH_INFO: `/v3/users/764aba2a3c8c40f0ae20e4640b16de92` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:42.009541 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb50289-7a21-4968-aac4-e3340987b5c3 None admin] RBAC: Authorizing `identity:get_user(user_id=764aba2a3c8c40f0ae20e4640b16de92)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:42.011446 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb50289-7a21-4968-aac4-e3340987b5c3 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:42.013283 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 110/217] 10.222.0.17 () {56 vars in 1177 bytes} [Fri Oct 14 12:47:41 2022] GET /identity/v3/users/764aba2a3c8c40f0ae20e4640b16de92 => generated 293 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:42.020593 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb50289-7a21-4968-aac4-e3340987b5c3 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:42.035847 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:42.071512 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3b042f-c570-4f3b-bbfc-6e6f2be84224 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:42.124136 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7610df5-c116-4601-9caa-6a4a3b3f7f44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:42.124586 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7610df5-c116-4601-9caa-6a4a3b3f7f44 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:42.124873 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7610df5-c116-4601-9caa-6a4a3b3f7f44 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:42.125323 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7610df5-c116-4601-9caa-6a4a3b3f7f44 None admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:42.126864 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7610df5-c116-4601-9caa-6a4a3b3f7f44 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:42.127404 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7610df5-c116-4601-9caa-6a4a3b3f7f44 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:42.130982 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7610df5-c116-4601-9caa-6a4a3b3f7f44 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:42.137840 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:42.141576 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 108/218] 10.222.0.17 () {56 vars in 1101 bytes} [Fri Oct 14 12:47:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:42.147420 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7610df5-c116-4601-9caa-6a4a3b3f7f44 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:42.162973 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb50289-7a21-4968-aac4-e3340987b5c3 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:42.209360 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811a2065-b9ac-4be4-b940-ef4afca4a4b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:42.210103 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811a2065-b9ac-4be4-b940-ef4afca4a4b5 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:42.210502 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811a2065-b9ac-4be4-b940-ef4afca4a4b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:42.210845 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811a2065-b9ac-4be4-b940-ef4afca4a4b5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:42.211658 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811a2065-b9ac-4be4-b940-ef4afca4a4b5 None admin] RBAC: Adding query filter params (role.id=5e8849303a75425b9eaa2681cc031af1, user.id=764aba2a3c8c40f0ae20e4640b16de92, scope.system=all) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:42.212098 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811a2065-b9ac-4be4-b940-ef4afca4a4b5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:42.213710 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811a2065-b9ac-4be4-b940-ef4afca4a4b5 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:42.220196 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 111/219] 10.222.0.17 () {56 vars in 1308 bytes} [Fri Oct 14 12:47:42 2022] GET /identity/v3/role_assignments?user.id=764aba2a3c8c40f0ae20e4640b16de92&scope.system=all&role.id=5e8849303a75425b9eaa2681cc031af1 => generated 226 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 12:47:42.279081 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7610df5-c116-4601-9caa-6a4a3b3f7f44 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:42.320486 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5de0309-469c-4147-a007-460283dc828d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:42.321160 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5de0309-469c-4147-a007-460283dc828d None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:42.321437 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5de0309-469c-4147-a007-460283dc828d None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:42.321707 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5de0309-469c-4147-a007-460283dc828d None admin] PATH_INFO: `/v3/users/a4fba1b6f31547129f3ed3024eb16f55` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:42.323091 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5de0309-469c-4147-a007-460283dc828d None admin] RBAC: Authorizing `identity:get_user(user_id=a4fba1b6f31547129f3ed3024eb16f55)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:42.324687 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5de0309-469c-4147-a007-460283dc828d None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:42.326832 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 109/220] 10.222.0.17 () {56 vars in 1177 bytes} [Fri Oct 14 12:47:42 2022] GET /identity/v3/users/a4fba1b6f31547129f3ed3024eb16f55 => generated 297 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 12:47:42.334817 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811a2065-b9ac-4be4-b940-ef4afca4a4b5 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:42.474773 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811a2065-b9ac-4be4-b940-ef4afca4a4b5 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:42.512734 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaae283-fb4f-4b77-acd6-20ac5e05e92d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:42.513679 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaae283-fb4f-4b77-acd6-20ac5e05e92d None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:42.514154 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaae283-fb4f-4b77-acd6-20ac5e05e92d None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:42.514601 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaae283-fb4f-4b77-acd6-20ac5e05e92d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:42.534611 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:42.588392 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eaae283-fb4f-4b77-acd6-20ac5e05e92d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:42.590179 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eaae283-fb4f-4b77-acd6-20ac5e05e92d None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:42.698951 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 112/221] 10.222.0.17 () {58 vars in 1282 bytes} [Fri Oct 14 12:47:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 14 12:47:42.705012 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5de0309-469c-4147-a007-460283dc828d None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:42.726587 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:42.827293 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5de0309-469c-4147-a007-460283dc828d None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:42.876746 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01652ab6-7355-4e6e-9c06-558dba080c73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:42.877404 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01652ab6-7355-4e6e-9c06-558dba080c73 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:42.877687 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01652ab6-7355-4e6e-9c06-558dba080c73 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:42.877967 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01652ab6-7355-4e6e-9c06-558dba080c73 None admin] PATH_INFO: `/v3/projects/7941e70fc4dd4ecb9c70a568789af856` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:42.879725 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01652ab6-7355-4e6e-9c06-558dba080c73 None admin] RBAC: Authorizing `identity:get_project(project_id=7941e70fc4dd4ecb9c70a568789af856)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:42.881189 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01652ab6-7355-4e6e-9c06-558dba080c73 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:42.882961 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 110/222] 10.222.0.17 () {56 vars in 1186 bytes} [Fri Oct 14 12:47:42 2022] GET /identity/v3/projects/7941e70fc4dd4ecb9c70a568789af856 => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 12:47:42.891299 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaae283-fb4f-4b77-acd6-20ac5e05e92d None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:42.943800 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:43.002690 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaae283-fb4f-4b77-acd6-20ac5e05e92d None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:43.039318 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0cc06e-59f4-4a9e-b0e3-898e9746402c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:43.040268 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0cc06e-59f4-4a9e-b0e3-898e9746402c None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:43.040687 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0cc06e-59f4-4a9e-b0e3-898e9746402c None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:43.041105 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0cc06e-59f4-4a9e-b0e3-898e9746402c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:43.041977 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0cc06e-59f4-4a9e-b0e3-898e9746402c None admin] RBAC: Adding query filter params (role.id=8cab83b8007b48b1934e19126b3170a6, scope.project.id=7941e70fc4dd4ecb9c70a568789af856, user.id=a4fba1b6f31547129f3ed3024eb16f55) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:43.042451 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0cc06e-59f4-4a9e-b0e3-898e9746402c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:43.044072 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0cc06e-59f4-4a9e-b0e3-898e9746402c None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:43.051366 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 113/223] 10.222.0.17 () {56 vars in 1374 bytes} [Fri Oct 14 12:47:42 2022] GET /identity/v3/role_assignments?user.id=a4fba1b6f31547129f3ed3024eb16f55&scope.project.id=7941e70fc4dd4ecb9c70a568789af856&role.id=8cab83b8007b48b1934e19126b3170a6 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:44.200150 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad316d6b-a300-4efe-a3d1-f01b4fab3968 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:44.200684 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad316d6b-a300-4efe-a3d1-f01b4fab3968 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:44.200684 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad316d6b-a300-4efe-a3d1-f01b4fab3968 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:44.202346 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 111/224] 10.222.0.17 () {54 vars in 927 bytes} [Fri Oct 14 12:47:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:47:44.209173 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b980dfc1-85fb-4f3c-b19c-d9388a912dcc None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:44.209818 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b980dfc1-85fb-4f3c-b19c-d9388a912dcc None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:44.209818 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b980dfc1-85fb-4f3c-b19c-d9388a912dcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:44.229845 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-b980dfc1-85fb-4f3c-b19c-d9388a912dcc None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:47:44.231138 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-b980dfc1-85fb-4f3c-b19c-d9388a912dcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:47:44.319371 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 114/225] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Oct 14 12:47:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 12:47:44.328128 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02287b6-90aa-4f8d-a06b-a307c67ee969 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:44.328476 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02287b6-90aa-4f8d-a06b-a307c67ee969 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:44.328690 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02287b6-90aa-4f8d-a06b-a307c67ee969 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:44.330773 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 112/226] 10.222.0.17 () {54 vars in 927 bytes} [Fri Oct 14 12:47:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:47:44.336427 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcd88d0-6d52-4500-b598-48362926f206 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:44.336706 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcd88d0-6d52-4500-b598-48362926f206 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:44.336983 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcd88d0-6d52-4500-b598-48362926f206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:44.357306 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-cfcd88d0-6d52-4500-b598-48362926f206 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:47:44.358704 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-cfcd88d0-6d52-4500-b598-48362926f206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:47:44.408871 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:44.459220 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 115/227] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Oct 14 12:47:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 12:47:44.538537 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be7ebb3-88ad-4be1-89c4-ec64a9c71ff8 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:44.538855 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be7ebb3-88ad-4be1-89c4-ec64a9c71ff8 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:44.539081 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be7ebb3-88ad-4be1-89c4-ec64a9c71ff8 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:44.540580 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 113/228] 10.222.0.17 () {54 vars in 927 bytes} [Fri Oct 14 12:47:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:47:44.545852 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876f1ade-ecd5-4925-9207-979e13b80081 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:44.546172 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876f1ade-ecd5-4925-9207-979e13b80081 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:44.546439 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876f1ade-ecd5-4925-9207-979e13b80081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:44.566209 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-876f1ade-ecd5-4925-9207-979e13b80081 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:47:44.567709 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-876f1ade-ecd5-4925-9207-979e13b80081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:47:44.596738 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be7ebb3-88ad-4be1-89c4-ec64a9c71ff8 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:44.648653 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 116/229] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Oct 14 12:47:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 14 12:47:44.682263 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:44.713728 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be7ebb3-88ad-4be1-89c4-ec64a9c71ff8 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:44.740550 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876f1ade-ecd5-4925-9207-979e13b80081 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:44.760246 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685580a7-709b-486e-abaf-029731a8bff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:44.761174 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685580a7-709b-486e-abaf-029731a8bff2 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:44.761589 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685580a7-709b-486e-abaf-029731a8bff2 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:44.762053 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685580a7-709b-486e-abaf-029731a8bff2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:44.776289 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685580a7-709b-486e-abaf-029731a8bff2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 12:47:44.782321 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-685580a7-709b-486e-abaf-029731a8bff2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 14 12:47:44.782321 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:47:44.782321 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:47:44.782321 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:47:44.782321 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:47:44.782321 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:47:44.782321 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:47:44.782321 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:47:44.782321 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:47:44.782321 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:47:44.782321 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:47:44.782321 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:47:44.782321 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 12:47:44.782321 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 12:47:44.782321 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 12:47:44.782321 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 12:47:44.783408 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 12:47:44.783408 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 12:47:44.783408 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 12:47:44.783408 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 12:47:44.783408 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:47:44.783408 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:47:44.783408 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:47:44.783408 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:47:44.783408 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:47:44.783408 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:47:44.783408 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:47:44.783408 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 14 12:47:44.783408 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:47:44.783408 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:47:44.783408 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:47:44.783408 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:47:44.784308 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:47:44.784308 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:47:44.784308 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:47:44.784308 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:47:44.784308 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 12:47:44.784308 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 12:47:44.784308 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 12:47:44.784308 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 12:47:44.784308 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 12:47:44.784308 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 12:47:44.784308 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 14 12:47:44.784308 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 14 12:47:44.789490 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 114/230] 10.222.0.17 () {56 vars in 1099 bytes} [Fri Oct 14 12:47:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 14 12:47:44.790423 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685580a7-709b-486e-abaf-029731a8bff2 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:44.892661 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876f1ade-ecd5-4925-9207-979e13b80081 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:44.895659 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:44.933099 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685580a7-709b-486e-abaf-029731a8bff2 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:44.945160 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25a2786-0f55-4186-8042-b093f36892d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:44.946366 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25a2786-0f55-4186-8042-b093f36892d5 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:44.951257 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25a2786-0f55-4186-8042-b093f36892d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:44.951619 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25a2786-0f55-4186-8042-b093f36892d5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:44.952779 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25a2786-0f55-4186-8042-b093f36892d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:44.954248 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25a2786-0f55-4186-8042-b093f36892d5 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:44.955863 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 117/231] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Oct 14 12:47:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 12:47:44.959056 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25a2786-0f55-4186-8042-b093f36892d5 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:44.972343 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dc5118-7258-48f2-878c-74e604735174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:44.973492 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dc5118-7258-48f2-878c-74e604735174 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:44.973749 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dc5118-7258-48f2-878c-74e604735174 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:44.974019 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dc5118-7258-48f2-878c-74e604735174 None admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:44.974726 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dc5118-7258-48f2-878c-74e604735174 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:44.975028 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dc5118-7258-48f2-878c-74e604735174 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:44.976409 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dc5118-7258-48f2-878c-74e604735174 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:44.978879 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:44.987852 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 115/232] 10.222.0.17 () {56 vars in 1101 bytes} [Fri Oct 14 12:47:44 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:44.988667 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dc5118-7258-48f2-878c-74e604735174 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:45.069664 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25a2786-0f55-4186-8042-b093f36892d5 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:45.098041 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dc5118-7258-48f2-878c-74e604735174 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:45.106327 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4599833b-f27e-444c-b30a-8875ee2bc2aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:45.106964 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4599833b-f27e-444c-b30a-8875ee2bc2aa None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:45.107253 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4599833b-f27e-444c-b30a-8875ee2bc2aa None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:45.107522 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4599833b-f27e-444c-b30a-8875ee2bc2aa None admin] PATH_INFO: `/v3/roles/member` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:45.119308 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4599833b-f27e-444c-b30a-8875ee2bc2aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 12:47:45.124595 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-4599833b-f27e-444c-b30a-8875ee2bc2aa None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 14 12:47:45.124595 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:47:45.124595 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:47:45.124595 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:47:45.124595 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:47:45.124595 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:47:45.124595 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:47:45.124595 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:47:45.124595 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:47:45.124595 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:47:45.124595 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:47:45.124595 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:47:45.124595 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 12:47:45.124595 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 12:47:45.124595 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 12:47:45.124595 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 12:47:45.125570 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 12:47:45.125570 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 12:47:45.125570 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 12:47:45.125570 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 12:47:45.125570 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:47:45.125570 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:47:45.125570 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:47:45.125570 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:47:45.125570 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:47:45.125570 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:47:45.125570 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:47:45.125570 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 14 12:47:45.125570 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:47:45.125570 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:47:45.125570 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:47:45.125570 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:47:45.126406 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:47:45.126406 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:47:45.126406 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:47:45.126406 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:47:45.126406 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 12:47:45.126406 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 12:47:45.126406 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 12:47:45.126406 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 12:47:45.126406 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 12:47:45.126406 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 12:47:45.126406 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 14 12:47:45.126406 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 14 12:47:45.126406 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 118/233] 10.222.0.17 () {56 vars in 1099 bytes} [Fri Oct 14 12:47:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:47:45.127048 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4599833b-f27e-444c-b30a-8875ee2bc2aa None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:45.136158 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f07e0b-d932-41e0-a5a0-37e83ab0884b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:45.136775 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f07e0b-d932-41e0-a5a0-37e83ab0884b None admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:45.137055 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f07e0b-d932-41e0-a5a0-37e83ab0884b None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:45.137324 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f07e0b-d932-41e0-a5a0-37e83ab0884b None admin] PATH_INFO: `/v3/groups` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:45.137980 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f07e0b-d932-41e0-a5a0-37e83ab0884b None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:45.139460 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f07e0b-d932-41e0-a5a0-37e83ab0884b None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:45.155756 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 116/234] 10.222.0.17 () {60 vars in 1134 bytes} [Fri Oct 14 12:47:44 2022] POST /identity/v3/groups => generated 229 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 12:47:45.156416 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f07e0b-d932-41e0-a5a0-37e83ab0884b None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:45.165239 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:45.229228 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:45.265538 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4599833b-f27e-444c-b30a-8875ee2bc2aa None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:45.287792 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f07e0b-d932-41e0-a5a0-37e83ab0884b None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:45.309725 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d62835-8911-4528-a0ed-d8e25ac8fa69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:45.310479 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d62835-8911-4528-a0ed-d8e25ac8fa69 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:45.310764 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d62835-8911-4528-a0ed-d8e25ac8fa69 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:45.311042 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d62835-8911-4528-a0ed-d8e25ac8fa69 None admin] PATH_INFO: `/v3/users/bc96983c0bc343a18f0f1fe16a41ad64` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:45.326837 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d62835-8911-4528-a0ed-d8e25ac8fa69 None admin] RBAC: Authorizing `identity:get_user(user_id=bc96983c0bc343a18f0f1fe16a41ad64)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:45.328365 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d62835-8911-4528-a0ed-d8e25ac8fa69 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:45.330168 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 119/235] 10.222.0.17 () {56 vars in 1177 bytes} [Fri Oct 14 12:47:45 2022] GET /identity/v3/users/bc96983c0bc343a18f0f1fe16a41ad64 => generated 293 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:45.330999 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68568ce1-2485-449f-bd49-703348634a1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:45.331636 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68568ce1-2485-449f-bd49-703348634a1a None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:45.331917 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68568ce1-2485-449f-bd49-703348634a1a None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:45.332872 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68568ce1-2485-449f-bd49-703348634a1a None admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:45.334533 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68568ce1-2485-449f-bd49-703348634a1a None admin] RBAC: Adding query filter params (name=member) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:45.334533 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68568ce1-2485-449f-bd49-703348634a1a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:45.335930 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68568ce1-2485-449f-bd49-703348634a1a None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:45.336886 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d62835-8911-4528-a0ed-d8e25ac8fa69 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:45.350783 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 117/236] 10.222.0.17 () {56 vars in 1101 bytes} [Fri Oct 14 12:47:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:45.352177 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68568ce1-2485-449f-bd49-703348634a1a None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:45.453839 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:45.471056 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d62835-8911-4528-a0ed-d8e25ac8fa69 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:45.474474 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68568ce1-2485-449f-bd49-703348634a1a None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:45.496396 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:45.512010 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3385d21b-a7da-41bb-9735-f75e13e83c7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:45.512647 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3385d21b-a7da-41bb-9735-f75e13e83c7a None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:45.512947 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3385d21b-a7da-41bb-9735-f75e13e83c7a None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:45.513211 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3385d21b-a7da-41bb-9735-f75e13e83c7a None admin] PATH_INFO: `/v3/users/764aba2a3c8c40f0ae20e4640b16de92` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:45.514364 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3385d21b-a7da-41bb-9735-f75e13e83c7a None admin] RBAC: Authorizing `identity:get_user(user_id=764aba2a3c8c40f0ae20e4640b16de92)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:45.515815 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3385d21b-a7da-41bb-9735-f75e13e83c7a None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:45.517355 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d348ae5-4db7-46b8-a74a-615f2b3f55b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:45.517481 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 118/237] 10.222.0.17 () {56 vars in 1177 bytes} [Fri Oct 14 12:47:45 2022] GET /identity/v3/users/764aba2a3c8c40f0ae20e4640b16de92 => generated 293 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 12:47:45.518256 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d348ae5-4db7-46b8-a74a-615f2b3f55b2 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:45.518681 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d348ae5-4db7-46b8-a74a-615f2b3f55b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:45.519092 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d348ae5-4db7-46b8-a74a-615f2b3f55b2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:45.520033 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d348ae5-4db7-46b8-a74a-615f2b3f55b2 None admin] RBAC: Adding query filter params (role.id=8cab83b8007b48b1934e19126b3170a6, user.id=bc96983c0bc343a18f0f1fe16a41ad64, scope.system=all) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:45.520489 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d348ae5-4db7-46b8-a74a-615f2b3f55b2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:45.522082 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d348ae5-4db7-46b8-a74a-615f2b3f55b2 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:45.523324 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3385d21b-a7da-41bb-9735-f75e13e83c7a None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:45.527823 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 120/238] 10.222.0.17 () {56 vars in 1308 bytes} [Fri Oct 14 12:47:45 2022] GET /identity/v3/role_assignments?user.id=bc96983c0bc343a18f0f1fe16a41ad64&scope.system=all&role.id=8cab83b8007b48b1934e19126b3170a6 => generated 226 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:45.640478 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3385d21b-a7da-41bb-9735-f75e13e83c7a None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:45.692826 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7642b0-bb74-4b03-8ace-40d93033b4c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:45.693780 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7642b0-bb74-4b03-8ace-40d93033b4c7 None admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:45.694058 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7642b0-bb74-4b03-8ace-40d93033b4c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:45.694372 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7642b0-bb74-4b03-8ace-40d93033b4c7 None admin] PATH_INFO: `/v3/system/users/764aba2a3c8c40f0ae20e4640b16de92/roles/5e8849303a75425b9eaa2681cc031af1` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:45.695893 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7642b0-bb74-4b03-8ace-40d93033b4c7 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=764aba2a3c8c40f0ae20e4640b16de92, role_id=5e8849303a75425b9eaa2681cc031af1)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:45.697314 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7642b0-bb74-4b03-8ace-40d93033b4c7 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:45.707917 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 119/239] 10.222.0.17 () {58 vars in 1334 bytes} [Fri Oct 14 12:47:45 2022] PUT /identity/v3/system/users/764aba2a3c8c40f0ae20e4640b16de92/roles/5e8849303a75425b9eaa2681cc031af1 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 12:47:47.532967 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca18a11f-2f1e-433c-a444-0f408dee6187 None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:47.533457 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca18a11f-2f1e-433c-a444-0f408dee6187 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:47.533457 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca18a11f-2f1e-433c-a444-0f408dee6187 None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:47.534850 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 121/240] 10.222.0.17 () {54 vars in 927 bytes} [Fri Oct 14 12:47:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:47:47.541329 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9115de40-262a-4195-bb15-66aef80e41b7 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:47.541823 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9115de40-262a-4195-bb15-66aef80e41b7 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:47.541902 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9115de40-262a-4195-bb15-66aef80e41b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:47.560145 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-9115de40-262a-4195-bb15-66aef80e41b7 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:47:47.561351 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-9115de40-262a-4195-bb15-66aef80e41b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:47:47.613330 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:47.640080 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 120/241] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Oct 14 12:47:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 12:47:47.797675 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29fb6c6-9e4c-4131-a3dd-28c6464918f8 None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:47.797962 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29fb6c6-9e4c-4131-a3dd-28c6464918f8 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:47.798162 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29fb6c6-9e4c-4131-a3dd-28c6464918f8 None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:47.799618 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 122/242] 10.222.0.17 () {54 vars in 927 bytes} [Fri Oct 14 12:47:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:47:47.805709 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f64500f-a26c-4604-97cf-fba50f34afdc None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:47.805991 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f64500f-a26c-4604-97cf-fba50f34afdc None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:47.806296 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f64500f-a26c-4604-97cf-fba50f34afdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:47.824717 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-2f64500f-a26c-4604-97cf-fba50f34afdc None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:47:47.825894 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-2f64500f-a26c-4604-97cf-fba50f34afdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:47:47.894620 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 121/243] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Oct 14 12:47:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 12:47:47.912227 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29fb6c6-9e4c-4131-a3dd-28c6464918f8 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:48.014891 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29fb6c6-9e4c-4131-a3dd-28c6464918f8 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:48.015574 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69b693a-4d07-462b-96a6-37517ade58b6 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:48.015863 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69b693a-4d07-462b-96a6-37517ade58b6 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:48.016138 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69b693a-4d07-462b-96a6-37517ade58b6 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:48.017491 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 122/244] 10.222.0.17 () {54 vars in 927 bytes} [Fri Oct 14 12:47:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:47:48.022605 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7f3b5c-7fbd-4067-8ee5-46176a4a7f42 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:48.022934 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7f3b5c-7fbd-4067-8ee5-46176a4a7f42 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:48.023176 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7f3b5c-7fbd-4067-8ee5-46176a4a7f42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:48.041632 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-9f7f3b5c-7fbd-4067-8ee5-46176a4a7f42 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:47:48.042846 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-9f7f3b5c-7fbd-4067-8ee5-46176a4a7f42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:47:48.052068 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc059639-4046-469c-b53b-91e00fa03d0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:48.052906 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc059639-4046-469c-b53b-91e00fa03d0d None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:48.053358 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc059639-4046-469c-b53b-91e00fa03d0d None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:48.053802 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc059639-4046-469c-b53b-91e00fa03d0d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:48.055117 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc059639-4046-469c-b53b-91e00fa03d0d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:48.056904 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc059639-4046-469c-b53b-91e00fa03d0d None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:48.059619 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 123/245] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Oct 14 12:47:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:48.064683 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc059639-4046-469c-b53b-91e00fa03d0d None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:48.095262 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:48.124415 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 123/246] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Oct 14 12:47:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 14 12:47:48.171336 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7f3b5c-7fbd-4067-8ee5-46176a4a7f42 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:48.175384 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc059639-4046-469c-b53b-91e00fa03d0d None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:48.226923 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f12fb07-49b2-4715-a78f-fffb48e9dcc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:48.227558 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f12fb07-49b2-4715-a78f-fffb48e9dcc3 None admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:48.228077 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:48.228186 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f12fb07-49b2-4715-a78f-fffb48e9dcc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:48.228413 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f12fb07-49b2-4715-a78f-fffb48e9dcc3 None admin] PATH_INFO: `/v3/groups` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:48.229344 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f12fb07-49b2-4715-a78f-fffb48e9dcc3 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:48.231059 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f12fb07-49b2-4715-a78f-fffb48e9dcc3 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:48.262493 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 124/247] 10.222.0.17 () {60 vars in 1134 bytes} [Fri Oct 14 12:47:48 2022] POST /identity/v3/groups => generated 226 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 12:47:48.309085 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7f3b5c-7fbd-4067-8ee5-46176a4a7f42 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:48.354867 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6760f880-9fb9-42ad-b5ed-6eb972e99a5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:48.355784 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6760f880-9fb9-42ad-b5ed-6eb972e99a5d None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:48.356227 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6760f880-9fb9-42ad-b5ed-6eb972e99a5d None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:48.356669 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6760f880-9fb9-42ad-b5ed-6eb972e99a5d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:48.372633 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6760f880-9fb9-42ad-b5ed-6eb972e99a5d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 12:47:48.377739 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-6760f880-9fb9-42ad-b5ed-6eb972e99a5d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 14 12:47:48.377739 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:47:48.377739 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:47:48.377739 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:47:48.377739 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:47:48.377739 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:47:48.377739 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:47:48.377739 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:47:48.377739 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:47:48.377739 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:47:48.377739 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:47:48.377739 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:47:48.377739 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 12:47:48.377739 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 12:47:48.377739 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 12:47:48.377739 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 12:47:48.378770 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 12:47:48.378770 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 12:47:48.378770 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 12:47:48.378770 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 12:47:48.378770 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:47:48.378770 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:47:48.378770 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:47:48.378770 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:47:48.378770 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:47:48.378770 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:47:48.378770 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:47:48.378770 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 14 12:47:48.378770 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:47:48.378770 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:47:48.378770 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:47:48.378770 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:47:48.380127 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:47:48.380127 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:47:48.380127 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:47:48.380127 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:47:48.380127 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 12:47:48.380127 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 12:47:48.380127 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 12:47:48.380127 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 12:47:48.380127 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 12:47:48.380127 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 12:47:48.380127 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 14 12:47:48.380127 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 14 12:47:48.380127 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 124/248] 10.222.0.17 () {56 vars in 1099 bytes} [Fri Oct 14 12:47:48 2022] GET /identity/v3/roles/reader => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 14 12:47:48.387326 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f12fb07-49b2-4715-a78f-fffb48e9dcc3 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:48.451188 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6760f880-9fb9-42ad-b5ed-6eb972e99a5d None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:48.489260 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:48.514227 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f12fb07-49b2-4715-a78f-fffb48e9dcc3 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:48.553407 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d111f08-8349-4568-80e0-552ff9c321ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:48.554724 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d111f08-8349-4568-80e0-552ff9c321ad None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:48.555174 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d111f08-8349-4568-80e0-552ff9c321ad None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:48.555588 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d111f08-8349-4568-80e0-552ff9c321ad None admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:48.556407 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d111f08-8349-4568-80e0-552ff9c321ad None admin] RBAC: Adding query filter params (name=reader) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:48.556856 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d111f08-8349-4568-80e0-552ff9c321ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:48.558446 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d111f08-8349-4568-80e0-552ff9c321ad None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:48.567977 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 125/249] 10.222.0.17 () {56 vars in 1101 bytes} [Fri Oct 14 12:47:48 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:48.575228 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d111f08-8349-4568-80e0-552ff9c321ad None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:48.581742 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6760f880-9fb9-42ad-b5ed-6eb972e99a5d None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:48.584056 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:48.626133 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0272f911-5db4-424e-a644-0d45e6eb5624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:48.626904 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0272f911-5db4-424e-a644-0d45e6eb5624 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:48.627193 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0272f911-5db4-424e-a644-0d45e6eb5624 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:48.628004 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0272f911-5db4-424e-a644-0d45e6eb5624 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:48.639819 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0272f911-5db4-424e-a644-0d45e6eb5624 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 12:47:48.644847 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-0272f911-5db4-424e-a644-0d45e6eb5624 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 14 12:47:48.644847 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:47:48.644847 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:47:48.644847 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:47:48.644847 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:47:48.644847 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:47:48.644847 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:47:48.644847 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:47:48.644847 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:47:48.644847 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:47:48.644847 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:47:48.644847 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:47:48.644847 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 12:47:48.644847 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 12:47:48.644847 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 12:47:48.644847 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 12:47:48.645741 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 12:47:48.645741 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 12:47:48.645741 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 12:47:48.645741 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 12:47:48.645741 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:47:48.645741 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:47:48.645741 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:47:48.645741 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:47:48.645741 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:47:48.645741 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:47:48.645741 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:47:48.645741 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 14 12:47:48.645741 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:47:48.645741 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:47:48.645741 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:47:48.645741 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:47:48.646555 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:47:48.646555 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:47:48.646555 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:47:48.646555 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:47:48.646555 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 12:47:48.646555 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 12:47:48.646555 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 12:47:48.646555 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 12:47:48.646555 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 12:47:48.646555 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 12:47:48.646555 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 14 12:47:48.646555 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 14 12:47:48.646555 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 125/250] 10.222.0.17 () {56 vars in 1099 bytes} [Fri Oct 14 12:47:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:47:48.651718 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0272f911-5db4-424e-a644-0d45e6eb5624 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:48.715857 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d111f08-8349-4568-80e0-552ff9c321ad None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:48.759229 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617f3fe2-beb6-4e02-9fb1-f04278c90c94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:48.760007 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617f3fe2-beb6-4e02-9fb1-f04278c90c94 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:48.760491 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617f3fe2-beb6-4e02-9fb1-f04278c90c94 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:48.760867 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617f3fe2-beb6-4e02-9fb1-f04278c90c94 None admin] PATH_INFO: `/v3/users/bc96983c0bc343a18f0f1fe16a41ad64` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:48.762375 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617f3fe2-beb6-4e02-9fb1-f04278c90c94 None admin] RBAC: Authorizing `identity:get_user(user_id=bc96983c0bc343a18f0f1fe16a41ad64)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:48.763956 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617f3fe2-beb6-4e02-9fb1-f04278c90c94 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:48.770241 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 126/251] 10.222.0.17 () {56 vars in 1177 bytes} [Fri Oct 14 12:47:48 2022] GET /identity/v3/users/bc96983c0bc343a18f0f1fe16a41ad64 => generated 293 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:48.771936 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617f3fe2-beb6-4e02-9fb1-f04278c90c94 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:48.780614 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0272f911-5db4-424e-a644-0d45e6eb5624 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:48.786576 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:48.836009 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4180c167-83dd-404b-8e0b-bbff8b6eeb4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:48.836631 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4180c167-83dd-404b-8e0b-bbff8b6eeb4a None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:48.836909 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4180c167-83dd-404b-8e0b-bbff8b6eeb4a None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:48.837179 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4180c167-83dd-404b-8e0b-bbff8b6eeb4a None admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:48.837856 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4180c167-83dd-404b-8e0b-bbff8b6eeb4a None admin] RBAC: Adding query filter params (name=member) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:48.838179 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4180c167-83dd-404b-8e0b-bbff8b6eeb4a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:48.839801 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4180c167-83dd-404b-8e0b-bbff8b6eeb4a None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:48.851116 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 126/252] 10.222.0.17 () {56 vars in 1101 bytes} [Fri Oct 14 12:47:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 12:47:48.858677 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4180c167-83dd-404b-8e0b-bbff8b6eeb4a None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:48.887055 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:48.899097 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617f3fe2-beb6-4e02-9fb1-f04278c90c94 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:48.939724 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b799e49-1acd-4b70-87c8-1127ea08c833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:48.940438 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b799e49-1acd-4b70-87c8-1127ea08c833 None admin] REQUEST_METHOD: `PUT` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:48.940725 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b799e49-1acd-4b70-87c8-1127ea08c833 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:48.941008 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b799e49-1acd-4b70-87c8-1127ea08c833 None admin] PATH_INFO: `/v3/system/users/bc96983c0bc343a18f0f1fe16a41ad64/roles/8cab83b8007b48b1934e19126b3170a6` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:48.943396 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b799e49-1acd-4b70-87c8-1127ea08c833 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=bc96983c0bc343a18f0f1fe16a41ad64, role_id=8cab83b8007b48b1934e19126b3170a6)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:48.944815 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b799e49-1acd-4b70-87c8-1127ea08c833 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:48.955255 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 127/253] 10.222.0.17 () {58 vars in 1334 bytes} [Fri Oct 14 12:47:48 2022] PUT /identity/v3/system/users/bc96983c0bc343a18f0f1fe16a41ad64/roles/8cab83b8007b48b1934e19126b3170a6 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 12:47:48.977073 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4180c167-83dd-404b-8e0b-bbff8b6eeb4a None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:49.017096 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a7dfd0-713c-4e74-8e5e-40c0fa71ff7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:49.018059 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a7dfd0-713c-4e74-8e5e-40c0fa71ff7c None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:49.018587 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a7dfd0-713c-4e74-8e5e-40c0fa71ff7c None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:49.019037 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a7dfd0-713c-4e74-8e5e-40c0fa71ff7c None admin] PATH_INFO: `/v3/users/764aba2a3c8c40f0ae20e4640b16de92` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:49.021087 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a7dfd0-713c-4e74-8e5e-40c0fa71ff7c None admin] RBAC: Authorizing `identity:get_user(user_id=764aba2a3c8c40f0ae20e4640b16de92)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:49.022879 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a7dfd0-713c-4e74-8e5e-40c0fa71ff7c None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:49.024848 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 127/254] 10.222.0.17 () {56 vars in 1177 bytes} [Fri Oct 14 12:47:48 2022] GET /identity/v3/users/764aba2a3c8c40f0ae20e4640b16de92 => generated 293 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:49.031305 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b799e49-1acd-4b70-87c8-1127ea08c833 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:49.143475 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:49.183157 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b799e49-1acd-4b70-87c8-1127ea08c833 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:49.226850 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b738f063-a7b9-48d9-804d-38d47925995a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:49.227423 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b738f063-a7b9-48d9-804d-38d47925995a None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:49.227707 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b738f063-a7b9-48d9-804d-38d47925995a None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:49.227982 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b738f063-a7b9-48d9-804d-38d47925995a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:49.228793 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b738f063-a7b9-48d9-804d-38d47925995a None admin] RBAC: Adding query filter params (role.id=5e8849303a75425b9eaa2681cc031af1, user.id=764aba2a3c8c40f0ae20e4640b16de92, scope.system=all) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:49.229107 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b738f063-a7b9-48d9-804d-38d47925995a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:49.230621 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b738f063-a7b9-48d9-804d-38d47925995a None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:49.246553 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 128/255] 10.222.0.17 () {56 vars in 1308 bytes} [Fri Oct 14 12:47:49 2022] GET /identity/v3/role_assignments?user.id=764aba2a3c8c40f0ae20e4640b16de92&scope.system=all&role.id=5e8849303a75425b9eaa2681cc031af1 => generated 510 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:50.903828 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e8d5f3-b592-4668-9208-30c472bdd043 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:50.904931 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e8d5f3-b592-4668-9208-30c472bdd043 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:50.905444 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e8d5f3-b592-4668-9208-30c472bdd043 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:50.907309 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 128/256] 10.222.0.17 () {54 vars in 927 bytes} [Fri Oct 14 12:47:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:47:50.913529 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0f8e23-b83b-4b44-b846-62bf696e1a6a None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:50.914030 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0f8e23-b83b-4b44-b846-62bf696e1a6a None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:50.914104 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0f8e23-b83b-4b44-b846-62bf696e1a6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:50.944201 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-be0f8e23-b83b-4b44-b846-62bf696e1a6a None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:47:50.945467 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-be0f8e23-b83b-4b44-b846-62bf696e1a6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:47:51.030730 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ef1d3e-0e18-4594-adef-c50134012cb6 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:51.031227 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ef1d3e-0e18-4594-adef-c50134012cb6 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:51.031968 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ef1d3e-0e18-4594-adef-c50134012cb6 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:51.035472 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 129/257] 10.222.0.17 () {54 vars in 927 bytes} [Fri Oct 14 12:47:51 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:47:51.040724 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1968eb4-18d7-4638-97d5-0f185934cc3e None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:51.040939 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 129/258] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Oct 14 12:47:50 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 14 12:47:51.041074 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1968eb4-18d7-4638-97d5-0f185934cc3e None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:51.041310 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1968eb4-18d7-4638-97d5-0f185934cc3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:51.061644 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-a1968eb4-18d7-4638-97d5-0f185934cc3e None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:47:51.062882 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-a1968eb4-18d7-4638-97d5-0f185934cc3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:47:51.072243 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 130/259] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Oct 14 12:47:51 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Oct 14 12:47:51.410691 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0f8e23-b83b-4b44-b846-62bf696e1a6a None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:51.422271 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0f8e23-b83b-4b44-b846-62bf696e1a6a None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:51.431706 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b10fe5e-e59c-4bc3-86a9-93bc5bdab1fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:51.432360 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b10fe5e-e59c-4bc3-86a9-93bc5bdab1fe admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:51.432635 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b10fe5e-e59c-4bc3-86a9-93bc5bdab1fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:51.432903 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b10fe5e-e59c-4bc3-86a9-93bc5bdab1fe admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:51.448484 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b10fe5e-e59c-4bc3-86a9-93bc5bdab1fe admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 12:47:51.453346 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-6b10fe5e-e59c-4bc3-86a9-93bc5bdab1fe admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 14 12:47:51.453346 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:47:51.453346 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:47:51.453346 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:47:51.453346 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:47:51.453346 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:47:51.453346 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:47:51.453346 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:47:51.453346 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:47:51.453346 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:47:51.453346 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:47:51.453346 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:47:51.453346 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 12:47:51.453346 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 12:47:51.453346 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 12:47:51.453346 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 12:47:51.454277 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 12:47:51.454277 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 12:47:51.454277 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 12:47:51.454277 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 12:47:51.454277 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:47:51.454277 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:47:51.454277 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:47:51.454277 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:47:51.454277 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:47:51.454277 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:47:51.454277 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:47:51.454277 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 14 12:47:51.454277 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:47:51.454277 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:47:51.454277 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:47:51.454277 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:47:51.455059 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:47:51.455059 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:47:51.455059 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:47:51.455059 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:47:51.455059 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 12:47:51.455059 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 12:47:51.455059 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 12:47:51.455059 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 12:47:51.455059 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 12:47:51.455059 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 12:47:51.455059 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 14 12:47:51.455059 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 14 12:47:51.455059 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 130/260] 10.222.0.17 () {56 vars in 1135 bytes} [Fri Oct 14 12:47:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:47:51.460628 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1968eb4-18d7-4638-97d5-0f185934cc3e None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:51.475312 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1968eb4-18d7-4638-97d5-0f185934cc3e None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:51.483982 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71aa205c-a4f4-4854-9e5f-4fcc1ce56368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:51.484604 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aa205c-a4f4-4854-9e5f-4fcc1ce56368 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:51.484885 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aa205c-a4f4-4854-9e5f-4fcc1ce56368 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:51.485154 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aa205c-a4f4-4854-9e5f-4fcc1ce56368 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:51.485823 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71aa205c-a4f4-4854-9e5f-4fcc1ce56368 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:51.486142 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71aa205c-a4f4-4854-9e5f-4fcc1ce56368 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:51.487953 dv-cinder-820994-7-smb devstack@keystone.service[81438]: WARNING py.warnings [None req-71aa205c-a4f4-4854-9e5f-4fcc1ce56368 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 14 12:47:51.487953 dv-cinder-820994-7-smb devstack@keystone.service[81438]: warnings.warn(msg) Oct 14 12:47:51.487953 dv-cinder-820994-7-smb devstack@keystone.service[81438]: Oct 14 12:47:51.489733 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71aa205c-a4f4-4854-9e5f-4fcc1ce56368 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:51.501747 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 131/261] 10.222.0.17 () {56 vars in 1132 bytes} [Fri Oct 14 12:47:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:51.507616 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b10fe5e-e59c-4bc3-86a9-93bc5bdab1fe admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:51.524092 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b10fe5e-e59c-4bc3-86a9-93bc5bdab1fe admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:51.532166 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca63b8d-c2af-4b5c-97ea-f93f5432c0c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:51.532807 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca63b8d-c2af-4b5c-97ea-f93f5432c0c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:51.533082 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca63b8d-c2af-4b5c-97ea-f93f5432c0c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:51.533353 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca63b8d-c2af-4b5c-97ea-f93f5432c0c0 admin admin] PATH_INFO: `/v3/groups/36aeee9d421d4c37b5d3782a99cc836c` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:51.544858 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca63b8d-c2af-4b5c-97ea-f93f5432c0c0 admin admin] RBAC: Authorizing `identity:get_group(group_id=36aeee9d421d4c37b5d3782a99cc836c)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:51.547043 dv-cinder-820994-7-smb devstack@keystone.service[81439]: WARNING py.warnings [None req-bca63b8d-c2af-4b5c-97ea-f93f5432c0c0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 14 12:47:51.547043 dv-cinder-820994-7-smb devstack@keystone.service[81439]: warnings.warn(msg) Oct 14 12:47:51.547043 dv-cinder-820994-7-smb devstack@keystone.service[81439]: Oct 14 12:47:51.547938 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca63b8d-c2af-4b5c-97ea-f93f5432c0c0 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:51.549925 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 131/262] 10.222.0.17 () {56 vars in 1201 bytes} [Fri Oct 14 12:47:51 2022] GET /identity/v3/groups/36aeee9d421d4c37b5d3782a99cc836c => generated 226 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:51.555464 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71aa205c-a4f4-4854-9e5f-4fcc1ce56368 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:51.565469 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71aa205c-a4f4-4854-9e5f-4fcc1ce56368 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:51.570684 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2fed2a-97c1-4561-9f7a-e0dbe5ae8215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:51.571342 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2fed2a-97c1-4561-9f7a-e0dbe5ae8215 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:51.571755 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2fed2a-97c1-4561-9f7a-e0dbe5ae8215 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:51.572037 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2fed2a-97c1-4561-9f7a-e0dbe5ae8215 admin admin] PATH_INFO: `/v3/projects/bb069426c7f5452ebe72633778574267` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:51.575191 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2fed2a-97c1-4561-9f7a-e0dbe5ae8215 admin admin] RBAC: Authorizing `identity:get_project(project_id=bb069426c7f5452ebe72633778574267)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:51.577420 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2fed2a-97c1-4561-9f7a-e0dbe5ae8215 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:51.579575 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 132/263] 10.222.0.17 () {56 vars in 1207 bytes} [Fri Oct 14 12:47:51 2022] GET /identity/v3/projects/bb069426c7f5452ebe72633778574267 => generated 298 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:51.586582 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca63b8d-c2af-4b5c-97ea-f93f5432c0c0 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:51.597311 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca63b8d-c2af-4b5c-97ea-f93f5432c0c0 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:51.604384 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7668e2-77a2-48fc-81fd-4fd3145a1400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:51.605113 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7668e2-77a2-48fc-81fd-4fd3145a1400 admin admin] REQUEST_METHOD: `PUT` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:51.605395 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7668e2-77a2-48fc-81fd-4fd3145a1400 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:51.605719 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7668e2-77a2-48fc-81fd-4fd3145a1400 admin admin] PATH_INFO: `/v3/projects/bb069426c7f5452ebe72633778574267/groups/36aeee9d421d4c37b5d3782a99cc836c/roles/251e12cde1564a10b367cc385e58b828` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:51.607962 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7668e2-77a2-48fc-81fd-4fd3145a1400 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb069426c7f5452ebe72633778574267, group_id=36aeee9d421d4c37b5d3782a99cc836c, role_id=251e12cde1564a10b367cc385e58b828)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:51.609381 dv-cinder-820994-7-smb devstack@keystone.service[81439]: WARNING py.warnings [None req-8f7668e2-77a2-48fc-81fd-4fd3145a1400 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 14 12:47:51.609381 dv-cinder-820994-7-smb devstack@keystone.service[81439]: warnings.warn(msg) Oct 14 12:47:51.609381 dv-cinder-820994-7-smb devstack@keystone.service[81439]: Oct 14 12:47:51.611415 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7668e2-77a2-48fc-81fd-4fd3145a1400 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:51.634294 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 132/264] 10.222.0.17 () {58 vars in 1463 bytes} [Fri Oct 14 12:47:51 2022] PUT /identity/v3/projects/bb069426c7f5452ebe72633778574267/groups/36aeee9d421d4c37b5d3782a99cc836c/roles/251e12cde1564a10b367cc385e58b828 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 12:47:51.641483 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2fed2a-97c1-4561-9f7a-e0dbe5ae8215 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:51.653387 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2fed2a-97c1-4561-9f7a-e0dbe5ae8215 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:51.725417 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f408ea12-7149-41cc-8c13-5e1a589250c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:51.725971 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f408ea12-7149-41cc-8c13-5e1a589250c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:51.726274 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f408ea12-7149-41cc-8c13-5e1a589250c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:51.726540 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f408ea12-7149-41cc-8c13-5e1a589250c6 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:51.739802 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f408ea12-7149-41cc-8c13-5e1a589250c6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 12:47:51.744876 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-f408ea12-7149-41cc-8c13-5e1a589250c6 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 14 12:47:51.744876 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:47:51.744876 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:47:51.744876 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:47:51.744876 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:47:51.744876 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:47:51.744876 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:47:51.744876 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:47:51.744876 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:47:51.744876 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:47:51.744876 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:47:51.744876 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:47:51.744876 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 12:47:51.744876 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 12:47:51.744876 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 12:47:51.744876 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 12:47:51.745803 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 12:47:51.745803 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 12:47:51.745803 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 12:47:51.745803 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 12:47:51.745803 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:47:51.745803 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:47:51.745803 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:47:51.745803 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:47:51.745803 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:47:51.745803 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:47:51.745803 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:47:51.745803 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 14 12:47:51.745803 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:47:51.745803 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:47:51.745803 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:47:51.745803 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:47:51.746674 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:47:51.746674 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:47:51.746674 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:47:51.746674 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:47:51.746674 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 12:47:51.746674 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 12:47:51.746674 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 12:47:51.746674 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 12:47:51.746674 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 12:47:51.746674 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 12:47:51.746674 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 14 12:47:51.746674 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 14 12:47:51.748711 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 133/265] 10.222.0.17 () {56 vars in 1120 bytes} [Fri Oct 14 12:47:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 108 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:47:51.752292 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7668e2-77a2-48fc-81fd-4fd3145a1400 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:51.765129 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7668e2-77a2-48fc-81fd-4fd3145a1400 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:51.772041 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fef3f4-afcb-4e55-b0e2-30ede111bd48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:51.772790 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fef3f4-afcb-4e55-b0e2-30ede111bd48 admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:51.773285 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fef3f4-afcb-4e55-b0e2-30ede111bd48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:51.773564 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fef3f4-afcb-4e55-b0e2-30ede111bd48 admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:51.774331 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fef3f4-afcb-4e55-b0e2-30ede111bd48 admin admin] RBAC: Adding query filter params (name=member) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:51.774695 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fef3f4-afcb-4e55-b0e2-30ede111bd48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:51.775840 dv-cinder-820994-7-smb devstack@keystone.service[81439]: WARNING py.warnings [None req-98fef3f4-afcb-4e55-b0e2-30ede111bd48 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 14 12:47:51.775840 dv-cinder-820994-7-smb devstack@keystone.service[81439]: warnings.warn(msg) Oct 14 12:47:51.775840 dv-cinder-820994-7-smb devstack@keystone.service[81439]: Oct 14 12:47:51.776744 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fef3f4-afcb-4e55-b0e2-30ede111bd48 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:51.790825 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 133/266] 10.222.0.17 () {56 vars in 1122 bytes} [Fri Oct 14 12:47:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:51.796772 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f408ea12-7149-41cc-8c13-5e1a589250c6 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:51.808879 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f408ea12-7149-41cc-8c13-5e1a589250c6 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:51.815468 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46babc96-4372-446e-82f7-94aaa9e57095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:51.816111 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46babc96-4372-446e-82f7-94aaa9e57095 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:51.816952 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46babc96-4372-446e-82f7-94aaa9e57095 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:51.817220 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46babc96-4372-446e-82f7-94aaa9e57095 admin admin] PATH_INFO: `/v3/groups/36aeee9d421d4c37b5d3782a99cc836c` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:51.818737 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46babc96-4372-446e-82f7-94aaa9e57095 admin admin] RBAC: Authorizing `identity:get_group(group_id=36aeee9d421d4c37b5d3782a99cc836c)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:51.819899 dv-cinder-820994-7-smb devstack@keystone.service[81438]: WARNING py.warnings [None req-46babc96-4372-446e-82f7-94aaa9e57095 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 14 12:47:51.819899 dv-cinder-820994-7-smb devstack@keystone.service[81438]: warnings.warn(msg) Oct 14 12:47:51.819899 dv-cinder-820994-7-smb devstack@keystone.service[81438]: Oct 14 12:47:51.821228 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46babc96-4372-446e-82f7-94aaa9e57095 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:51.823167 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 134/267] 10.222.0.17 () {56 vars in 1201 bytes} [Fri Oct 14 12:47:51 2022] GET /identity/v3/groups/36aeee9d421d4c37b5d3782a99cc836c => generated 226 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:51.829294 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fef3f4-afcb-4e55-b0e2-30ede111bd48 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:51.841005 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fef3f4-afcb-4e55-b0e2-30ede111bd48 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:51.847121 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dd88a7-6108-4940-a6b0-5146ecdb6fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:51.848744 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dd88a7-6108-4940-a6b0-5146ecdb6fa2 admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:51.849065 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dd88a7-6108-4940-a6b0-5146ecdb6fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:51.849347 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dd88a7-6108-4940-a6b0-5146ecdb6fa2 admin admin] PATH_INFO: `/v3/projects/bb069426c7f5452ebe72633778574267` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:51.850837 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dd88a7-6108-4940-a6b0-5146ecdb6fa2 admin admin] RBAC: Authorizing `identity:get_project(project_id=bb069426c7f5452ebe72633778574267)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:51.853050 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dd88a7-6108-4940-a6b0-5146ecdb6fa2 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:51.855152 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 134/268] 10.222.0.17 () {56 vars in 1207 bytes} [Fri Oct 14 12:47:51 2022] GET /identity/v3/projects/bb069426c7f5452ebe72633778574267 => generated 298 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:51.861440 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46babc96-4372-446e-82f7-94aaa9e57095 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:51.872551 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46babc96-4372-446e-82f7-94aaa9e57095 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:51.879255 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638af0ea-1ba4-4a2f-9701-b479c9b57649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:51.880043 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638af0ea-1ba4-4a2f-9701-b479c9b57649 admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:51.880326 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638af0ea-1ba4-4a2f-9701-b479c9b57649 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:51.880700 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638af0ea-1ba4-4a2f-9701-b479c9b57649 admin admin] PATH_INFO: `/v3/projects/bb069426c7f5452ebe72633778574267/groups/36aeee9d421d4c37b5d3782a99cc836c/roles/5e8849303a75425b9eaa2681cc031af1` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:51.882792 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638af0ea-1ba4-4a2f-9701-b479c9b57649 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb069426c7f5452ebe72633778574267, group_id=36aeee9d421d4c37b5d3782a99cc836c, role_id=5e8849303a75425b9eaa2681cc031af1)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:51.883956 dv-cinder-820994-7-smb devstack@keystone.service[81438]: WARNING py.warnings [None req-638af0ea-1ba4-4a2f-9701-b479c9b57649 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 14 12:47:51.883956 dv-cinder-820994-7-smb devstack@keystone.service[81438]: warnings.warn(msg) Oct 14 12:47:51.883956 dv-cinder-820994-7-smb devstack@keystone.service[81438]: Oct 14 12:47:51.886148 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638af0ea-1ba4-4a2f-9701-b479c9b57649 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:51.890531 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:51.904933 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 135/269] 10.222.0.17 () {58 vars in 1463 bytes} [Fri Oct 14 12:47:51 2022] PUT /identity/v3/projects/bb069426c7f5452ebe72633778574267/groups/36aeee9d421d4c37b5d3782a99cc836c/roles/5e8849303a75425b9eaa2681cc031af1 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 12:47:52.049956 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f44873-5e72-46d4-bf68-93c2435e7bd2 None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:52.050707 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f44873-5e72-46d4-bf68-93c2435e7bd2 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:52.050707 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f44873-5e72-46d4-bf68-93c2435e7bd2 None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:52.052491 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 135/270] 10.222.0.17 () {54 vars in 927 bytes} [Fri Oct 14 12:47:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:47:52.063316 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a6f3f5-87f7-4cbd-aa54-479f836f24b8 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:52.063643 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a6f3f5-87f7-4cbd-aa54-479f836f24b8 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:52.063848 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a6f3f5-87f7-4cbd-aa54-479f836f24b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:52.097533 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-a0a6f3f5-87f7-4cbd-aa54-479f836f24b8 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:47:52.097533 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-a0a6f3f5-87f7-4cbd-aa54-479f836f24b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:47:52.171593 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 136/271] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Oct 14 12:47:52 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 14 12:47:52.551543 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f44873-5e72-46d4-bf68-93c2435e7bd2 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:52.568585 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f44873-5e72-46d4-bf68-93c2435e7bd2 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:52.573259 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8446fa79-91c5-4577-8fa0-7e8397a60ba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:52.573934 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8446fa79-91c5-4577-8fa0-7e8397a60ba9 admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:52.574230 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8446fa79-91c5-4577-8fa0-7e8397a60ba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:52.574503 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8446fa79-91c5-4577-8fa0-7e8397a60ba9 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:52.591398 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8446fa79-91c5-4577-8fa0-7e8397a60ba9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 12:47:52.596357 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-8446fa79-91c5-4577-8fa0-7e8397a60ba9 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 14 12:47:52.596357 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:47:52.596357 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:47:52.596357 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:47:52.596357 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:47:52.596357 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:47:52.596357 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:47:52.596357 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:47:52.596357 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:47:52.596357 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:47:52.596357 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:47:52.596357 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:47:52.596357 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 12:47:52.596357 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 12:47:52.596357 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 12:47:52.596357 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 12:47:52.597226 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 12:47:52.597226 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 12:47:52.597226 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 12:47:52.597226 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 12:47:52.597226 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:47:52.597226 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:47:52.597226 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:47:52.597226 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:47:52.597226 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:47:52.597226 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:47:52.597226 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:47:52.597226 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 14 12:47:52.597226 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:47:52.597226 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:47:52.597226 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:47:52.597226 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:47:52.598052 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:47:52.598052 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:47:52.598052 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:47:52.598052 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:47:52.598052 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 12:47:52.598052 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 12:47:52.598052 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 12:47:52.598052 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 12:47:52.598052 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 12:47:52.598052 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 12:47:52.598052 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 14 12:47:52.598052 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 14 12:47:52.598800 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 136/272] 10.222.0.17 () {56 vars in 1120 bytes} [Fri Oct 14 12:47:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:47:52.605296 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a6f3f5-87f7-4cbd-aa54-479f836f24b8 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:52.619830 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a6f3f5-87f7-4cbd-aa54-479f836f24b8 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:52.624661 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dd968d-987a-43d9-930e-f055271ba82b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:52.625287 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dd968d-987a-43d9-930e-f055271ba82b admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:52.625567 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dd968d-987a-43d9-930e-f055271ba82b admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:52.625847 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dd968d-987a-43d9-930e-f055271ba82b admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:52.626575 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dd968d-987a-43d9-930e-f055271ba82b admin admin] RBAC: Adding query filter params (name=member) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:52.626880 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dd968d-987a-43d9-930e-f055271ba82b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:52.628548 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dd968d-987a-43d9-930e-f055271ba82b admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:52.642391 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 137/273] 10.222.0.17 () {56 vars in 1122 bytes} [Fri Oct 14 12:47:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:52.648830 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8446fa79-91c5-4577-8fa0-7e8397a60ba9 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:52.665990 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8446fa79-91c5-4577-8fa0-7e8397a60ba9 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:52.673607 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319a46af-c6e2-482d-ad0c-b8d48e500d44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:52.674286 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319a46af-c6e2-482d-ad0c-b8d48e500d44 admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:52.674571 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319a46af-c6e2-482d-ad0c-b8d48e500d44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:52.674841 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319a46af-c6e2-482d-ad0c-b8d48e500d44 admin admin] PATH_INFO: `/v3/groups/36aeee9d421d4c37b5d3782a99cc836c` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:52.676076 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319a46af-c6e2-482d-ad0c-b8d48e500d44 admin admin] RBAC: Authorizing `identity:get_group(group_id=36aeee9d421d4c37b5d3782a99cc836c)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:52.678016 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319a46af-c6e2-482d-ad0c-b8d48e500d44 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:52.679687 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 137/274] 10.222.0.17 () {56 vars in 1201 bytes} [Fri Oct 14 12:47:52 2022] GET /identity/v3/groups/36aeee9d421d4c37b5d3782a99cc836c => generated 226 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:52.686526 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dd968d-987a-43d9-930e-f055271ba82b admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:52.699893 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dd968d-987a-43d9-930e-f055271ba82b admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:52.708617 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78eb3898-584c-4a8d-986f-e0cf8e804f20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:52.709376 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eb3898-584c-4a8d-986f-e0cf8e804f20 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:52.709663 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eb3898-584c-4a8d-986f-e0cf8e804f20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:52.709943 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eb3898-584c-4a8d-986f-e0cf8e804f20 admin admin] PATH_INFO: `/v3/projects/7941e70fc4dd4ecb9c70a568789af856` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:52.711191 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78eb3898-584c-4a8d-986f-e0cf8e804f20 admin admin] RBAC: Authorizing `identity:get_project(project_id=7941e70fc4dd4ecb9c70a568789af856)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:52.713287 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78eb3898-584c-4a8d-986f-e0cf8e804f20 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:52.715673 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 138/275] 10.222.0.17 () {56 vars in 1207 bytes} [Fri Oct 14 12:47:52 2022] GET /identity/v3/projects/7941e70fc4dd4ecb9c70a568789af856 => generated 302 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:52.721856 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319a46af-c6e2-482d-ad0c-b8d48e500d44 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:52.736215 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319a46af-c6e2-482d-ad0c-b8d48e500d44 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:52.742231 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7489ae-d5cb-4cde-ba23-f8c2fddf6f97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:52.742927 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7489ae-d5cb-4cde-ba23-f8c2fddf6f97 admin admin] REQUEST_METHOD: `PUT` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:52.743210 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7489ae-d5cb-4cde-ba23-f8c2fddf6f97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:52.743492 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7489ae-d5cb-4cde-ba23-f8c2fddf6f97 admin admin] PATH_INFO: `/v3/projects/7941e70fc4dd4ecb9c70a568789af856/groups/36aeee9d421d4c37b5d3782a99cc836c/roles/5e8849303a75425b9eaa2681cc031af1` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:52.746351 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7489ae-d5cb-4cde-ba23-f8c2fddf6f97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7941e70fc4dd4ecb9c70a568789af856, group_id=36aeee9d421d4c37b5d3782a99cc836c, role_id=5e8849303a75425b9eaa2681cc031af1)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:52.749086 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7489ae-d5cb-4cde-ba23-f8c2fddf6f97 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:52.769048 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 138/276] 10.222.0.17 () {58 vars in 1463 bytes} [Fri Oct 14 12:47:52 2022] PUT /identity/v3/projects/7941e70fc4dd4ecb9c70a568789af856/groups/36aeee9d421d4c37b5d3782a99cc836c/roles/5e8849303a75425b9eaa2681cc031af1 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 12:47:53.025038 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d4b3af-0963-4d32-8788-c967587d6e1e None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:53.026067 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d4b3af-0963-4d32-8788-c967587d6e1e None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:53.026067 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d4b3af-0963-4d32-8788-c967587d6e1e None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:53.027095 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 139/277] 10.222.0.17 () {54 vars in 927 bytes} [Fri Oct 14 12:47:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:47:53.032973 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb760eb0-098e-437c-8273-b28b23c237e3 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:53.033265 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb760eb0-098e-437c-8273-b28b23c237e3 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:53.033547 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb760eb0-098e-437c-8273-b28b23c237e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:53.046265 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:53.063136 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-fb760eb0-098e-437c-8273-b28b23c237e3 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:47:53.064363 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-fb760eb0-098e-437c-8273-b28b23c237e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:47:53.164541 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 139/278] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Oct 14 12:47:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 12:47:53.430971 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e166fa90-5cfd-4b55-8689-c9a94967f933 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:53.431345 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e166fa90-5cfd-4b55-8689-c9a94967f933 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:53.431522 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e166fa90-5cfd-4b55-8689-c9a94967f933 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:53.433104 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 140/279] 10.222.0.17 () {54 vars in 927 bytes} [Fri Oct 14 12:47:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:47:53.438288 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc5ac76-7e6f-4d62-aa06-e462c4d87b03 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:53.438579 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc5ac76-7e6f-4d62-aa06-e462c4d87b03 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:53.438859 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc5ac76-7e6f-4d62-aa06-e462c4d87b03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:53.467193 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-2cc5ac76-7e6f-4d62-aa06-e462c4d87b03 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:47:53.468424 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-2cc5ac76-7e6f-4d62-aa06-e462c4d87b03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:47:53.549617 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 140/280] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Oct 14 12:47:53 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 14 12:47:53.559569 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e166fa90-5cfd-4b55-8689-c9a94967f933 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:53.748799 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e166fa90-5cfd-4b55-8689-c9a94967f933 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:53.791043 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:53.801499 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc25770-2b62-4227-8bc6-ad951683d0a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:53.802189 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc25770-2b62-4227-8bc6-ad951683d0a2 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:53.802421 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc25770-2b62-4227-8bc6-ad951683d0a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:53.802693 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc25770-2b62-4227-8bc6-ad951683d0a2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:53.817438 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc25770-2b62-4227-8bc6-ad951683d0a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 12:47:53.822401 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-ecc25770-2b62-4227-8bc6-ad951683d0a2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 14 12:47:53.822401 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:47:53.822401 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:47:53.822401 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:47:53.822401 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:47:53.822401 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:47:53.822401 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:47:53.822401 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:47:53.822401 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:47:53.822401 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:47:53.822401 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:47:53.822401 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:47:53.822401 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 12:47:53.822401 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 12:47:53.822401 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 12:47:53.822401 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 12:47:53.823277 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 12:47:53.823277 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 12:47:53.823277 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 12:47:53.823277 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 12:47:53.823277 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:47:53.823277 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:47:53.823277 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:47:53.823277 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:47:53.823277 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:47:53.823277 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:47:53.823277 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:47:53.823277 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 14 12:47:53.823277 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:47:53.823277 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:47:53.823277 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:47:53.823277 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:47:53.824074 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:47:53.824074 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:47:53.824074 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:47:53.824074 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:47:53.824074 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 12:47:53.824074 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 12:47:53.824074 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 12:47:53.824074 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 12:47:53.824074 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 12:47:53.824074 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 12:47:53.824074 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 14 12:47:53.824074 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 14 12:47:53.824074 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 141/281] 10.222.0.17 () {56 vars in 1099 bytes} [Fri Oct 14 12:47:53 2022] GET /identity/v3/roles/reader => generated 84 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:47:53.829390 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc5ac76-7e6f-4d62-aa06-e462c4d87b03 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:53.964252 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:53.999270 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc5ac76-7e6f-4d62-aa06-e462c4d87b03 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:54.059077 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a8fb7e-0755-4529-8d3c-d239ca27820e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:54.059725 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a8fb7e-0755-4529-8d3c-d239ca27820e None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:54.060011 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a8fb7e-0755-4529-8d3c-d239ca27820e None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:54.060288 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a8fb7e-0755-4529-8d3c-d239ca27820e None admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:54.060978 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a8fb7e-0755-4529-8d3c-d239ca27820e None admin] RBAC: Adding query filter params (name=reader) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:54.061287 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a8fb7e-0755-4529-8d3c-d239ca27820e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:54.062799 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a8fb7e-0755-4529-8d3c-d239ca27820e None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:54.073322 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 141/282] 10.222.0.17 () {56 vars in 1101 bytes} [Fri Oct 14 12:47:53 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:54.079097 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc25770-2b62-4227-8bc6-ad951683d0a2 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:54.223292 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc25770-2b62-4227-8bc6-ad951683d0a2 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:54.226061 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cb4c73-7742-4e71-84b1-425533719b69 None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:54.226387 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cb4c73-7742-4e71-84b1-425533719b69 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:54.226670 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cb4c73-7742-4e71-84b1-425533719b69 None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:54.228226 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 142/283] 10.222.0.17 () {54 vars in 927 bytes} [Fri Oct 14 12:47:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 14 12:47:54.234609 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cf5171-e92f-48ef-af28-d0085e822323 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:54.234960 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cf5171-e92f-48ef-af28-d0085e822323 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:54.235172 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cf5171-e92f-48ef-af28-d0085e822323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:54.274788 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be60368-f1e1-4ac8-8ceb-168f6c46a069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:54.275774 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be60368-f1e1-4ac8-8ceb-168f6c46a069 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:54.276355 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be60368-f1e1-4ac8-8ceb-168f6c46a069 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:54.276831 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be60368-f1e1-4ac8-8ceb-168f6c46a069 None admin] PATH_INFO: `/v3/users/bc96983c0bc343a18f0f1fe16a41ad64` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:54.278246 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-b0cf5171-e92f-48ef-af28-d0085e822323 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:47:54.278360 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be60368-f1e1-4ac8-8ceb-168f6c46a069 None admin] RBAC: Authorizing `identity:get_user(user_id=bc96983c0bc343a18f0f1fe16a41ad64)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:54.279491 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-b0cf5171-e92f-48ef-af28-d0085e822323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:47:54.280283 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be60368-f1e1-4ac8-8ceb-168f6c46a069 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:54.282551 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 142/284] 10.222.0.17 () {56 vars in 1177 bytes} [Fri Oct 14 12:47:54 2022] GET /identity/v3/users/bc96983c0bc343a18f0f1fe16a41ad64 => generated 293 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:54.283632 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be60368-f1e1-4ac8-8ceb-168f6c46a069 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:54.295624 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be60368-f1e1-4ac8-8ceb-168f6c46a069 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:54.299866 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 143/285] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Oct 14 12:47:54 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Oct 14 12:47:54.299866 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cf5171-e92f-48ef-af28-d0085e822323 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:54.305448 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9970dc2d-98ac-4afb-94c8-03435455f065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:54.306433 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9970dc2d-98ac-4afb-94c8-03435455f065 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:54.308000 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9970dc2d-98ac-4afb-94c8-03435455f065 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:54.308576 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9970dc2d-98ac-4afb-94c8-03435455f065 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:54.323678 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9970dc2d-98ac-4afb-94c8-03435455f065 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 12:47:54.330172 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-9970dc2d-98ac-4afb-94c8-03435455f065 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 14 12:47:54.330172 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:47:54.330172 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:47:54.330172 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:47:54.330172 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:47:54.330172 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:47:54.330172 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:47:54.330172 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:47:54.330172 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:47:54.330172 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:47:54.330172 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:47:54.330172 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:47:54.330172 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 12:47:54.330172 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 12:47:54.330172 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 12:47:54.330172 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 12:47:54.331094 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 12:47:54.331094 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 12:47:54.331094 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 12:47:54.331094 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 12:47:54.331094 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:47:54.331094 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:47:54.331094 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:47:54.331094 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:47:54.331094 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:47:54.331094 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:47:54.331094 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:47:54.331094 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 14 12:47:54.331094 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:47:54.331094 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:47:54.331094 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:47:54.331094 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:47:54.332403 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:47:54.332403 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:47:54.332403 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:47:54.332403 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:47:54.332403 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 12:47:54.332403 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 12:47:54.332403 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 12:47:54.332403 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 12:47:54.332403 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 12:47:54.332403 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 12:47:54.332403 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 14 12:47:54.332403 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 14 12:47:54.338930 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 143/286] 10.222.0.17 () {56 vars in 1135 bytes} [Fri Oct 14 12:47:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:47:54.377089 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9970dc2d-98ac-4afb-94c8-03435455f065 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:54.397214 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9970dc2d-98ac-4afb-94c8-03435455f065 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:54.409192 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4677dc-00dd-447c-b8d8-5309e588ac72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:54.410274 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4677dc-00dd-447c-b8d8-5309e588ac72 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:54.410825 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4677dc-00dd-447c-b8d8-5309e588ac72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:54.411345 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4677dc-00dd-447c-b8d8-5309e588ac72 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:54.412270 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4677dc-00dd-447c-b8d8-5309e588ac72 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:54.412776 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4677dc-00dd-447c-b8d8-5309e588ac72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:54.418797 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4677dc-00dd-447c-b8d8-5309e588ac72 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:54.429635 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 144/287] 10.222.0.17 () {56 vars in 1132 bytes} [Fri Oct 14 12:47:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 12:47:54.435579 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4677dc-00dd-447c-b8d8-5309e588ac72 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:54.451383 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4677dc-00dd-447c-b8d8-5309e588ac72 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:54.454306 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cf5171-e92f-48ef-af28-d0085e822323 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:54.460053 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a096bc-1512-4588-afed-a30ede303ef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:54.461039 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a096bc-1512-4588-afed-a30ede303ef1 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:54.461520 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a096bc-1512-4588-afed-a30ede303ef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:54.462046 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a096bc-1512-4588-afed-a30ede303ef1 admin admin] PATH_INFO: `/v3/groups/36aeee9d421d4c37b5d3782a99cc836c` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:54.464914 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a096bc-1512-4588-afed-a30ede303ef1 admin admin] RBAC: Authorizing `identity:get_group(group_id=36aeee9d421d4c37b5d3782a99cc836c)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:54.467361 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a096bc-1512-4588-afed-a30ede303ef1 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:54.469639 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 145/288] 10.222.0.17 () {56 vars in 1201 bytes} [Fri Oct 14 12:47:54 2022] GET /identity/v3/groups/36aeee9d421d4c37b5d3782a99cc836c => generated 226 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:54.475547 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a096bc-1512-4588-afed-a30ede303ef1 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:54.488532 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a096bc-1512-4588-afed-a30ede303ef1 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:54.493738 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b287685-8d56-4a41-ab59-aca8f562bfca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:54.494738 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b287685-8d56-4a41-ab59-aca8f562bfca admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:54.495257 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b287685-8d56-4a41-ab59-aca8f562bfca admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:54.495730 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b287685-8d56-4a41-ab59-aca8f562bfca admin admin] PATH_INFO: `/v3/projects/7941e70fc4dd4ecb9c70a568789af856` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:54.497163 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b287685-8d56-4a41-ab59-aca8f562bfca admin admin] RBAC: Authorizing `identity:get_project(project_id=7941e70fc4dd4ecb9c70a568789af856)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:54.499678 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b287685-8d56-4a41-ab59-aca8f562bfca admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:54.501960 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 146/289] 10.222.0.17 () {56 vars in 1207 bytes} [Fri Oct 14 12:47:54 2022] GET /identity/v3/projects/7941e70fc4dd4ecb9c70a568789af856 => generated 302 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:54.508086 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b287685-8d56-4a41-ab59-aca8f562bfca admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:54.508245 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c3eddf-d9c5-4508-aad8-ea8d9daed64a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:54.508850 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c3eddf-d9c5-4508-aad8-ea8d9daed64a None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:54.509145 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c3eddf-d9c5-4508-aad8-ea8d9daed64a None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:54.509409 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c3eddf-d9c5-4508-aad8-ea8d9daed64a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:54.510174 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c3eddf-d9c5-4508-aad8-ea8d9daed64a None admin] RBAC: Adding query filter params (role.id=8cab83b8007b48b1934e19126b3170a6, user.id=bc96983c0bc343a18f0f1fe16a41ad64, scope.system=all) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:54.510493 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c3eddf-d9c5-4508-aad8-ea8d9daed64a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:54.512115 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c3eddf-d9c5-4508-aad8-ea8d9daed64a None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:54.515467 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:54.522840 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b287685-8d56-4a41-ab59-aca8f562bfca admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:54.528257 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b858e7f2-33e1-4344-85b3-6a61b8ed776b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:54.529255 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b858e7f2-33e1-4344-85b3-6a61b8ed776b admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:54.529753 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b858e7f2-33e1-4344-85b3-6a61b8ed776b admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:54.530342 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b858e7f2-33e1-4344-85b3-6a61b8ed776b admin admin] PATH_INFO: `/v3/projects/7941e70fc4dd4ecb9c70a568789af856/groups/36aeee9d421d4c37b5d3782a99cc836c/roles/251e12cde1564a10b367cc385e58b828` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:54.532941 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b858e7f2-33e1-4344-85b3-6a61b8ed776b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7941e70fc4dd4ecb9c70a568789af856, group_id=36aeee9d421d4c37b5d3782a99cc836c, role_id=251e12cde1564a10b367cc385e58b828)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:54.536228 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b858e7f2-33e1-4344-85b3-6a61b8ed776b admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:54.538462 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 144/290] 10.222.0.17 () {56 vars in 1308 bytes} [Fri Oct 14 12:47:54 2022] GET /identity/v3/role_assignments?user.id=bc96983c0bc343a18f0f1fe16a41ad64&scope.system=all&role.id=8cab83b8007b48b1934e19126b3170a6 => generated 510 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:54.553499 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 147/291] 10.222.0.17 () {58 vars in 1463 bytes} [Fri Oct 14 12:47:54 2022] PUT /identity/v3/projects/7941e70fc4dd4ecb9c70a568789af856/groups/36aeee9d421d4c37b5d3782a99cc836c/roles/251e12cde1564a10b367cc385e58b828 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 12:47:55.007075 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c3eddf-d9c5-4508-aad8-ea8d9daed64a None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:55.086157 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c3eddf-d9c5-4508-aad8-ea8d9daed64a None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:55.091306 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5e3561-e15d-43d6-a780-f4bf5614571b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:55.091306 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5e3561-e15d-43d6-a780-f4bf5614571b admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:55.091533 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5e3561-e15d-43d6-a780-f4bf5614571b admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:55.091814 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5e3561-e15d-43d6-a780-f4bf5614571b admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:55.110700 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5e3561-e15d-43d6-a780-f4bf5614571b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 12:47:55.116285 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-ae5e3561-e15d-43d6-a780-f4bf5614571b admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 14 12:47:55.116285 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:47:55.116285 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:47:55.116285 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:47:55.116285 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:47:55.116285 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:47:55.116285 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:47:55.116285 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:47:55.116285 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:47:55.116285 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:47:55.116285 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:47:55.116285 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:47:55.116285 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 12:47:55.116285 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 12:47:55.116285 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 12:47:55.116285 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 12:47:55.117201 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 12:47:55.117201 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 12:47:55.117201 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 12:47:55.117201 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 12:47:55.117201 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:47:55.117201 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:47:55.117201 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:47:55.117201 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:47:55.117201 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:47:55.117201 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:47:55.117201 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:47:55.117201 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 14 12:47:55.117201 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:47:55.117201 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:47:55.117201 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:47:55.117201 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:47:55.117991 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:47:55.117991 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:47:55.117991 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:47:55.117991 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:47:55.117991 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 12:47:55.117991 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 12:47:55.117991 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 12:47:55.117991 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 12:47:55.117991 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 12:47:55.117991 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 12:47:55.117991 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 14 12:47:55.117991 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 14 12:47:55.117991 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 145/292] 10.222.0.17 () {56 vars in 1117 bytes} [Fri Oct 14 12:47:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 111 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:47:55.124611 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b858e7f2-33e1-4344-85b3-6a61b8ed776b admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:55.145182 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b858e7f2-33e1-4344-85b3-6a61b8ed776b admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:55.149847 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5aad8f-2e7c-4b0a-a884-eb2388518ffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:55.150463 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5aad8f-2e7c-4b0a-a884-eb2388518ffe admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:55.150743 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5aad8f-2e7c-4b0a-a884-eb2388518ffe admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:55.151014 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5aad8f-2e7c-4b0a-a884-eb2388518ffe admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:55.151690 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5aad8f-2e7c-4b0a-a884-eb2388518ffe admin admin] RBAC: Adding query filter params (name=admin) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:55.151987 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5aad8f-2e7c-4b0a-a884-eb2388518ffe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:55.153605 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5aad8f-2e7c-4b0a-a884-eb2388518ffe admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:55.171604 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 148/293] 10.222.0.17 () {56 vars in 1120 bytes} [Fri Oct 14 12:47:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:55.178067 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5e3561-e15d-43d6-a780-f4bf5614571b admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:55.193990 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5e3561-e15d-43d6-a780-f4bf5614571b admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:55.198950 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b52a761-d29e-4025-97bf-5840749b628d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:55.199584 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b52a761-d29e-4025-97bf-5840749b628d admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:55.199861 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b52a761-d29e-4025-97bf-5840749b628d admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:55.200132 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b52a761-d29e-4025-97bf-5840749b628d admin admin] PATH_INFO: `/v3/groups/00473bb943ed46a4b68fa5b9ba7e86d4` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:55.214857 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b52a761-d29e-4025-97bf-5840749b628d admin admin] RBAC: Authorizing `identity:get_group(group_id=00473bb943ed46a4b68fa5b9ba7e86d4)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:55.216840 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b52a761-d29e-4025-97bf-5840749b628d admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:55.218931 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 146/294] 10.222.0.17 () {56 vars in 1201 bytes} [Fri Oct 14 12:47:55 2022] GET /identity/v3/groups/00473bb943ed46a4b68fa5b9ba7e86d4 => generated 229 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:55.224204 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5aad8f-2e7c-4b0a-a884-eb2388518ffe admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:55.232106 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:55.236209 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5aad8f-2e7c-4b0a-a884-eb2388518ffe admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:55.247803 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599f9620-89b4-41da-8612-317f0c825ca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:55.248459 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599f9620-89b4-41da-8612-317f0c825ca6 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:55.248735 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599f9620-89b4-41da-8612-317f0c825ca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:55.249006 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599f9620-89b4-41da-8612-317f0c825ca6 admin admin] PATH_INFO: `/v3/projects/fd0b9855003d4ec7b5e5abb80be13578` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:55.250365 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599f9620-89b4-41da-8612-317f0c825ca6 admin admin] RBAC: Authorizing `identity:get_project(project_id=fd0b9855003d4ec7b5e5abb80be13578)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:55.252760 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599f9620-89b4-41da-8612-317f0c825ca6 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:55.255087 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 149/295] 10.222.0.17 () {56 vars in 1207 bytes} [Fri Oct 14 12:47:55 2022] GET /identity/v3/projects/fd0b9855003d4ec7b5e5abb80be13578 => generated 344 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:55.260611 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b52a761-d29e-4025-97bf-5840749b628d admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:55.271356 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b52a761-d29e-4025-97bf-5840749b628d admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:55.282217 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f3d76e-3ca9-4a9c-99cf-9040b8df6620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:55.282887 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f3d76e-3ca9-4a9c-99cf-9040b8df6620 admin admin] REQUEST_METHOD: `PUT` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:55.283168 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f3d76e-3ca9-4a9c-99cf-9040b8df6620 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:55.283445 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f3d76e-3ca9-4a9c-99cf-9040b8df6620 admin admin] PATH_INFO: `/v3/projects/fd0b9855003d4ec7b5e5abb80be13578/groups/00473bb943ed46a4b68fa5b9ba7e86d4/roles/7f6e29e390bc41f7a9af17659a2e95d1` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:55.287810 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f3d76e-3ca9-4a9c-99cf-9040b8df6620 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd0b9855003d4ec7b5e5abb80be13578, group_id=00473bb943ed46a4b68fa5b9ba7e86d4, role_id=7f6e29e390bc41f7a9af17659a2e95d1)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:55.290524 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f3d76e-3ca9-4a9c-99cf-9040b8df6620 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:55.320406 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 147/296] 10.222.0.17 () {58 vars in 1463 bytes} [Fri Oct 14 12:47:55 2022] PUT /identity/v3/projects/fd0b9855003d4ec7b5e5abb80be13578/groups/00473bb943ed46a4b68fa5b9ba7e86d4/roles/7f6e29e390bc41f7a9af17659a2e95d1 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 12:47:55.682010 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1f5da4-46de-4a38-89ce-3369f51ec5bf None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:55.682439 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1f5da4-46de-4a38-89ce-3369f51ec5bf None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:55.682619 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1f5da4-46de-4a38-89ce-3369f51ec5bf None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:55.684461 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 150/297] 10.222.0.17 () {54 vars in 927 bytes} [Fri Oct 14 12:47:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:47:55.692308 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a446c9-84a3-4368-8a05-7f71d9eb5947 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:55.692792 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a446c9-84a3-4368-8a05-7f71d9eb5947 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:55.693080 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a446c9-84a3-4368-8a05-7f71d9eb5947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:55.722172 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-b2a446c9-84a3-4368-8a05-7f71d9eb5947 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:47:55.723743 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-b2a446c9-84a3-4368-8a05-7f71d9eb5947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:47:55.795163 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bbeaf5-fdc8-4b70-a07b-446567cc5c9e None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:55.795511 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bbeaf5-fdc8-4b70-a07b-446567cc5c9e None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:55.795715 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bbeaf5-fdc8-4b70-a07b-446567cc5c9e None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:55.797353 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 151/298] 10.222.0.17 () {54 vars in 927 bytes} [Fri Oct 14 12:47:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:47:55.804331 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 148/299] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Oct 14 12:47:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 12:47:55.823085 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba2ce7a-751a-492c-a386-c8f2ca0cbc64 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:55.823405 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba2ce7a-751a-492c-a386-c8f2ca0cbc64 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:55.823711 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba2ce7a-751a-492c-a386-c8f2ca0cbc64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:55.825692 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3506a14f-637f-4a0e-9a30-57dc40577c94 None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:55.825983 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3506a14f-637f-4a0e-9a30-57dc40577c94 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:55.826289 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3506a14f-637f-4a0e-9a30-57dc40577c94 None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:55.827686 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 149/300] 10.222.0.17 () {54 vars in 927 bytes} [Fri Oct 14 12:47:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 14 12:47:55.834332 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd603178-a663-47d2-8068-2fb922f4b37e None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:55.834620 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd603178-a663-47d2-8068-2fb922f4b37e None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:55.834905 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd603178-a663-47d2-8068-2fb922f4b37e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:55.855327 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-bba2ce7a-751a-492c-a386-c8f2ca0cbc64 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:47:55.856530 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-bba2ce7a-751a-492c-a386-c8f2ca0cbc64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:47:55.856974 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-dd603178-a663-47d2-8068-2fb922f4b37e None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:47:55.858640 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-dd603178-a663-47d2-8068-2fb922f4b37e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:47:55.914719 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:55.953531 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 150/301] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Oct 14 12:47:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 12:47:55.992486 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 152/302] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Oct 14 12:47:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 12:47:56.258149 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd603178-a663-47d2-8068-2fb922f4b37e None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:56.322438 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba2ce7a-751a-492c-a386-c8f2ca0cbc64 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:56.389271 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd603178-a663-47d2-8068-2fb922f4b37e None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:56.468003 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4cc761-1aa5-45fb-982f-76675b3e2715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:56.470441 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4cc761-1aa5-45fb-982f-76675b3e2715 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:56.470730 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4cc761-1aa5-45fb-982f-76675b3e2715 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:56.470997 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4cc761-1aa5-45fb-982f-76675b3e2715 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:56.496365 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4cc761-1aa5-45fb-982f-76675b3e2715 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 12:47:56.511667 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-3d4cc761-1aa5-45fb-982f-76675b3e2715 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 14 12:47:56.511667 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:47:56.511667 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:47:56.511667 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:47:56.511667 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:47:56.511667 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:47:56.511667 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:47:56.511667 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:47:56.511667 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:47:56.511667 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:47:56.511667 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:47:56.511667 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:47:56.511667 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 12:47:56.511667 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 12:47:56.511667 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 12:47:56.511667 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 12:47:56.513539 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 12:47:56.513539 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 12:47:56.513539 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 12:47:56.513539 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 12:47:56.513539 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:47:56.513539 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:47:56.513539 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:47:56.513539 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:47:56.513539 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:47:56.513539 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:47:56.513539 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:47:56.513539 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 14 12:47:56.513539 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:47:56.513539 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:47:56.513539 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:47:56.513539 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:47:56.515250 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:47:56.515250 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:47:56.515250 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:47:56.515250 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:47:56.515250 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 12:47:56.515250 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 12:47:56.515250 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 12:47:56.515250 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 12:47:56.515250 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 12:47:56.515250 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 12:47:56.515250 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 14 12:47:56.515250 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 14 12:47:56.523429 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 151/303] 10.222.0.17 () {56 vars in 1114 bytes} [Fri Oct 14 12:47:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:47:56.524712 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba2ce7a-751a-492c-a386-c8f2ca0cbc64 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:56.525254 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4cc761-1aa5-45fb-982f-76675b3e2715 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:56.568430 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:56.575894 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22803de0-cf91-40d5-99fb-9175147ca40a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:56.577222 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22803de0-cf91-40d5-99fb-9175147ca40a None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:56.577577 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22803de0-cf91-40d5-99fb-9175147ca40a None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:56.577938 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22803de0-cf91-40d5-99fb-9175147ca40a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:56.592321 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22803de0-cf91-40d5-99fb-9175147ca40a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 12:47:56.594880 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:56.600473 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-22803de0-cf91-40d5-99fb-9175147ca40a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 14 12:47:56.600473 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:47:56.600473 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:47:56.600473 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:47:56.600473 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:47:56.600473 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:47:56.600473 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:47:56.600473 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:47:56.600473 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:47:56.600473 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:47:56.600473 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:47:56.600473 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:47:56.600473 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 12:47:56.600473 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 12:47:56.600473 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 12:47:56.600473 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 12:47:56.603677 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 12:47:56.603677 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 12:47:56.603677 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 12:47:56.603677 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 12:47:56.603677 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:47:56.603677 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:47:56.603677 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:47:56.603677 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:47:56.603677 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:47:56.603677 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:47:56.603677 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:47:56.603677 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 14 12:47:56.603677 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:47:56.603677 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:47:56.603677 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:47:56.603677 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:47:56.605428 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:47:56.605428 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:47:56.605428 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:47:56.605428 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:47:56.605428 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 12:47:56.605428 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 12:47:56.605428 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 12:47:56.605428 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 12:47:56.605428 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 12:47:56.605428 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 12:47:56.605428 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 14 12:47:56.605428 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 14 12:47:56.605428 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 153/304] 10.222.0.17 () {56 vars in 1099 bytes} [Fri Oct 14 12:47:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 14 12:47:56.607134 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22803de0-cf91-40d5-99fb-9175147ca40a None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:56.699502 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4cc761-1aa5-45fb-982f-76675b3e2715 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:56.753467 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22803de0-cf91-40d5-99fb-9175147ca40a None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:56.766352 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4390137f-1a35-411e-9ea1-f4c455aaada4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:56.768297 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4390137f-1a35-411e-9ea1-f4c455aaada4 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:56.769074 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4390137f-1a35-411e-9ea1-f4c455aaada4 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:56.770413 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4390137f-1a35-411e-9ea1-f4c455aaada4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:56.784687 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4390137f-1a35-411e-9ea1-f4c455aaada4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 12:47:56.791837 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-4390137f-1a35-411e-9ea1-f4c455aaada4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 14 12:47:56.791837 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:47:56.791837 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:47:56.791837 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:47:56.791837 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:47:56.791837 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:47:56.791837 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:47:56.791837 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:47:56.791837 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:47:56.791837 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:47:56.791837 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:47:56.791837 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:47:56.791837 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 12:47:56.791837 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 12:47:56.791837 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 12:47:56.791837 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 12:47:56.792775 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 12:47:56.792775 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 12:47:56.792775 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 12:47:56.792775 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 12:47:56.792775 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:47:56.792775 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:47:56.792775 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:47:56.792775 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:47:56.792775 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:47:56.792775 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:47:56.792775 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:47:56.792775 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 14 12:47:56.792775 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:47:56.792775 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:47:56.792775 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:47:56.792775 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:47:56.793547 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:47:56.793547 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:47:56.793547 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:47:56.793547 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:47:56.793547 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 12:47:56.793547 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 12:47:56.793547 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 12:47:56.793547 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 12:47:56.793547 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 12:47:56.793547 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 12:47:56.793547 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 14 12:47:56.793547 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 14 12:47:56.793547 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 152/305] 10.222.0.17 () {56 vars in 1099 bytes} [Fri Oct 14 12:47:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:47:56.794244 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4390137f-1a35-411e-9ea1-f4c455aaada4 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:56.808358 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044c5af4-3ed7-44db-a6e7-3e39a62c8c64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:56.809394 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044c5af4-3ed7-44db-a6e7-3e39a62c8c64 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:56.809879 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044c5af4-3ed7-44db-a6e7-3e39a62c8c64 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:56.810482 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044c5af4-3ed7-44db-a6e7-3e39a62c8c64 None admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:56.811547 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044c5af4-3ed7-44db-a6e7-3e39a62c8c64 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:56.812058 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044c5af4-3ed7-44db-a6e7-3e39a62c8c64 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:56.813815 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044c5af4-3ed7-44db-a6e7-3e39a62c8c64 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:56.827542 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 154/306] 10.222.0.17 () {56 vars in 1111 bytes} [Fri Oct 14 12:47:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:56.828877 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044c5af4-3ed7-44db-a6e7-3e39a62c8c64 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:56.893210 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:56.899961 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:56.907598 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4390137f-1a35-411e-9ea1-f4c455aaada4 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:56.948277 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff1b448-3cdc-41b1-a4cb-0c4fb9e95e2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:56.948901 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff1b448-3cdc-41b1-a4cb-0c4fb9e95e2b None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:56.949182 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff1b448-3cdc-41b1-a4cb-0c4fb9e95e2b None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:56.949456 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff1b448-3cdc-41b1-a4cb-0c4fb9e95e2b None admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:56.950248 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff1b448-3cdc-41b1-a4cb-0c4fb9e95e2b None admin] RBAC: Adding query filter params (name=member) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:56.950477 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff1b448-3cdc-41b1-a4cb-0c4fb9e95e2b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:56.951947 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff1b448-3cdc-41b1-a4cb-0c4fb9e95e2b None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:56.961791 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 153/307] 10.222.0.17 () {56 vars in 1101 bytes} [Fri Oct 14 12:47:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:56.962423 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044c5af4-3ed7-44db-a6e7-3e39a62c8c64 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:56.962678 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff1b448-3cdc-41b1-a4cb-0c4fb9e95e2b None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:57.004897 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f480dd0-d99e-4000-ac1e-901905b14d2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:57.006025 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f480dd0-d99e-4000-ac1e-901905b14d2e None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:57.006657 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f480dd0-d99e-4000-ac1e-901905b14d2e None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:57.007181 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f480dd0-d99e-4000-ac1e-901905b14d2e None admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:57.008347 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f480dd0-d99e-4000-ac1e-901905b14d2e None admin] RBAC: Adding query filter params (name=member) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:57.008970 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f480dd0-d99e-4000-ac1e-901905b14d2e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:57.011003 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f480dd0-d99e-4000-ac1e-901905b14d2e None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:57.023082 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 155/308] 10.222.0.17 () {56 vars in 1101 bytes} [Fri Oct 14 12:47:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:57.024688 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f480dd0-d99e-4000-ac1e-901905b14d2e None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:57.081725 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff1b448-3cdc-41b1-a4cb-0c4fb9e95e2b None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:57.125677 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa9c4aa-71dc-423d-8a9d-f57febd7e0ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:57.126487 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa9c4aa-71dc-423d-8a9d-f57febd7e0ba None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:57.126870 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa9c4aa-71dc-423d-8a9d-f57febd7e0ba None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:57.127244 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa9c4aa-71dc-423d-8a9d-f57febd7e0ba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:57.163211 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:57.175618 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f480dd0-d99e-4000-ac1e-901905b14d2e None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:57.198084 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:57.227183 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa9c4aa-71dc-423d-8a9d-f57febd7e0ba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:57.228819 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa9c4aa-71dc-423d-8a9d-f57febd7e0ba None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:57.229815 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8494ebf5-7781-4ed4-89c8-07cb3f87292b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:57.230938 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8494ebf5-7781-4ed4-89c8-07cb3f87292b None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:57.231494 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8494ebf5-7781-4ed4-89c8-07cb3f87292b None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:57.232033 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8494ebf5-7781-4ed4-89c8-07cb3f87292b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:57.319063 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8494ebf5-7781-4ed4-89c8-07cb3f87292b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:57.320680 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8494ebf5-7781-4ed4-89c8-07cb3f87292b None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:57.369038 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 154/309] 10.222.0.17 () {58 vars in 1282 bytes} [Fri Oct 14 12:47:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 14 12:47:57.370524 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa9c4aa-71dc-423d-8a9d-f57febd7e0ba None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:57.443352 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:57.452845 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 156/310] 10.222.0.17 () {58 vars in 1282 bytes} [Fri Oct 14 12:47:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 14 12:47:57.453958 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d811b7-b6f9-4f27-9b67-a731cdf24ef5 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:57.457493 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d811b7-b6f9-4f27-9b67-a731cdf24ef5 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:57.457493 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d811b7-b6f9-4f27-9b67-a731cdf24ef5 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:57.457493 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 157/311] 10.222.0.17 () {54 vars in 927 bytes} [Fri Oct 14 12:47:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:47:57.460675 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d811b7-b6f9-4f27-9b67-a731cdf24ef5 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:57.483977 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:57.502348 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa9c4aa-71dc-423d-8a9d-f57febd7e0ba None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:57.551639 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6c6cab-855d-4736-a71f-511a31577183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:57.552258 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6c6cab-855d-4736-a71f-511a31577183 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:57.552536 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6c6cab-855d-4736-a71f-511a31577183 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:57.553101 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6c6cab-855d-4736-a71f-511a31577183 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:57.619242 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d811b7-b6f9-4f27-9b67-a731cdf24ef5 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:57.652983 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6c6cab-855d-4736-a71f-511a31577183 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:57.655141 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6c6cab-855d-4736-a71f-511a31577183 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:57.660010 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d1619e-aa28-4354-bc90-4e6318165c87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:57.661040 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d1619e-aa28-4354-bc90-4e6318165c87 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:57.661322 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d1619e-aa28-4354-bc90-4e6318165c87 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:57.661598 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d1619e-aa28-4354-bc90-4e6318165c87 None admin] PATH_INFO: `/v3/projects/bb069426c7f5452ebe72633778574267` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:57.662826 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d1619e-aa28-4354-bc90-4e6318165c87 None admin] RBAC: Authorizing `identity:get_project(project_id=bb069426c7f5452ebe72633778574267)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:57.664308 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d1619e-aa28-4354-bc90-4e6318165c87 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:57.666213 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 158/312] 10.222.0.17 () {56 vars in 1186 bytes} [Fri Oct 14 12:47:57 2022] GET /identity/v3/projects/bb069426c7f5452ebe72633778574267 => generated 298 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:57.667173 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8566be-45c7-413f-926b-4854e157715d None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:57.667453 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8566be-45c7-413f-926b-4854e157715d None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:57.667726 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8566be-45c7-413f-926b-4854e157715d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:57.687543 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-fc8566be-45c7-413f-926b-4854e157715d None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:47:57.688746 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-fc8566be-45c7-413f-926b-4854e157715d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:47:57.736575 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:57.781015 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 159/313] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Oct 14 12:47:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 12:47:57.786172 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8566be-45c7-413f-926b-4854e157715d None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:57.795173 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 155/314] 10.222.0.17 () {58 vars in 1282 bytes} [Fri Oct 14 12:47:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 14 12:47:57.796169 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6c6cab-855d-4736-a71f-511a31577183 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:57.812395 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:57.923708 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8566be-45c7-413f-926b-4854e157715d None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:57.943033 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6c6cab-855d-4736-a71f-511a31577183 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:57.962918 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0496693-88ad-4937-ac34-1e5d205158cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:57.963706 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0496693-88ad-4937-ac34-1e5d205158cc None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:57.964097 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0496693-88ad-4937-ac34-1e5d205158cc None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:57.964617 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0496693-88ad-4937-ac34-1e5d205158cc None admin] PATH_INFO: `/v3/projects/7941e70fc4dd4ecb9c70a568789af856` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:57.965683 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0496693-88ad-4937-ac34-1e5d205158cc None admin] RBAC: Authorizing `identity:get_project(project_id=7941e70fc4dd4ecb9c70a568789af856)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:57.967322 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0496693-88ad-4937-ac34-1e5d205158cc None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:57.969383 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 160/315] 10.222.0.17 () {56 vars in 1186 bytes} [Fri Oct 14 12:47:57 2022] GET /identity/v3/projects/7941e70fc4dd4ecb9c70a568789af856 => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:57.975374 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0496693-88ad-4937-ac34-1e5d205158cc None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:57.990566 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447a1454-0395-4ec6-98bf-13b281f75aee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:57.991469 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447a1454-0395-4ec6-98bf-13b281f75aee None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:57.991889 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447a1454-0395-4ec6-98bf-13b281f75aee None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:57.992478 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447a1454-0395-4ec6-98bf-13b281f75aee None admin] PATH_INFO: `/v3/groups/36aeee9d421d4c37b5d3782a99cc836c` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:57.994072 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447a1454-0395-4ec6-98bf-13b281f75aee None admin] RBAC: Authorizing `identity:get_group(group_id=36aeee9d421d4c37b5d3782a99cc836c)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:57.996591 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447a1454-0395-4ec6-98bf-13b281f75aee None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:57.999462 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 156/316] 10.222.0.17 () {56 vars in 1180 bytes} [Fri Oct 14 12:47:57 2022] GET /identity/v3/groups/36aeee9d421d4c37b5d3782a99cc836c => generated 226 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:58.000406 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447a1454-0395-4ec6-98bf-13b281f75aee None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:58.037308 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:58.091577 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:58.116040 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0496693-88ad-4937-ac34-1e5d205158cc None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:58.139451 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447a1454-0395-4ec6-98bf-13b281f75aee None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:58.165912 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0788358d-340f-4e0d-9c82-e1ea2d8bf3b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:58.166722 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0788358d-340f-4e0d-9c82-e1ea2d8bf3b4 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:58.167172 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0788358d-340f-4e0d-9c82-e1ea2d8bf3b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:58.167590 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0788358d-340f-4e0d-9c82-e1ea2d8bf3b4 None admin] PATH_INFO: `/v3/projects/bb069426c7f5452ebe72633778574267` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:58.168748 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0788358d-340f-4e0d-9c82-e1ea2d8bf3b4 None admin] RBAC: Authorizing `identity:get_project(project_id=bb069426c7f5452ebe72633778574267)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:58.170332 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0788358d-340f-4e0d-9c82-e1ea2d8bf3b4 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:58.172291 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 161/317] 10.222.0.17 () {56 vars in 1186 bytes} [Fri Oct 14 12:47:57 2022] GET /identity/v3/projects/bb069426c7f5452ebe72633778574267 => generated 298 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:58.172854 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0788358d-340f-4e0d-9c82-e1ea2d8bf3b4 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:58.186405 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83922a1-0a39-4810-ad84-9025f3e90b1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:58.187913 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83922a1-0a39-4810-ad84-9025f3e90b1c None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:58.188392 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83922a1-0a39-4810-ad84-9025f3e90b1c None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:58.188868 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83922a1-0a39-4810-ad84-9025f3e90b1c None admin] PATH_INFO: `/v3/groups/36aeee9d421d4c37b5d3782a99cc836c` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:58.190845 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83922a1-0a39-4810-ad84-9025f3e90b1c None admin] RBAC: Authorizing `identity:get_group(group_id=36aeee9d421d4c37b5d3782a99cc836c)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:58.192617 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83922a1-0a39-4810-ad84-9025f3e90b1c None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:58.194915 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 157/318] 10.222.0.17 () {56 vars in 1180 bytes} [Fri Oct 14 12:47:57 2022] GET /identity/v3/groups/36aeee9d421d4c37b5d3782a99cc836c => generated 226 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:58.195940 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83922a1-0a39-4810-ad84-9025f3e90b1c None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:58.299324 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0788358d-340f-4e0d-9c82-e1ea2d8bf3b4 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:58.315318 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:58.327861 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83922a1-0a39-4810-ad84-9025f3e90b1c None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:58.344613 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f92c2a-c1ee-4b1c-ac50-8148324613b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:58.345384 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f92c2a-c1ee-4b1c-ac50-8148324613b6 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:58.346043 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f92c2a-c1ee-4b1c-ac50-8148324613b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:58.346350 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f92c2a-c1ee-4b1c-ac50-8148324613b6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:58.348904 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f92c2a-c1ee-4b1c-ac50-8148324613b6 None admin] RBAC: Adding query filter params (group.id=36aeee9d421d4c37b5d3782a99cc836c, role.id=251e12cde1564a10b367cc385e58b828, scope.project.id=bb069426c7f5452ebe72633778574267) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:58.348904 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f92c2a-c1ee-4b1c-ac50-8148324613b6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:58.350424 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f92c2a-c1ee-4b1c-ac50-8148324613b6 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:58.356545 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 162/319] 10.222.0.17 () {56 vars in 1376 bytes} [Fri Oct 14 12:47:58 2022] GET /identity/v3/role_assignments?group.id=36aeee9d421d4c37b5d3782a99cc836c&scope.project.id=bb069426c7f5452ebe72633778574267&role.id=251e12cde1564a10b367cc385e58b828 => generated 611 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:58.357361 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f92c2a-c1ee-4b1c-ac50-8148324613b6 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:58.376531 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cb9092-4031-4b45-ae06-12d9607132bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:58.377184 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:58.377964 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cb9092-4031-4b45-ae06-12d9607132bb None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:58.378274 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cb9092-4031-4b45-ae06-12d9607132bb None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:58.379448 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cb9092-4031-4b45-ae06-12d9607132bb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:58.394057 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cb9092-4031-4b45-ae06-12d9607132bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 12:47:58.400224 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-33cb9092-4031-4b45-ae06-12d9607132bb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 14 12:47:58.400224 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:47:58.400224 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:47:58.400224 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:47:58.400224 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:47:58.400224 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:47:58.400224 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:47:58.400224 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:47:58.400224 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:47:58.400224 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:47:58.400224 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:47:58.400224 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:47:58.400224 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 12:47:58.400224 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 12:47:58.400224 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 12:47:58.400224 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 12:47:58.401224 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 12:47:58.401224 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 12:47:58.401224 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 12:47:58.401224 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 12:47:58.401224 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:47:58.401224 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:47:58.401224 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:47:58.401224 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:47:58.401224 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:47:58.401224 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:47:58.401224 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:47:58.401224 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 14 12:47:58.401224 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:47:58.401224 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:47:58.401224 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:47:58.401224 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:47:58.402524 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:47:58.402524 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:47:58.402524 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:47:58.402524 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:47:58.402524 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 12:47:58.402524 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 12:47:58.402524 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 12:47:58.402524 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 12:47:58.402524 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 12:47:58.402524 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 12:47:58.402524 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 14 12:47:58.402524 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 14 12:47:58.402524 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 158/320] 10.222.0.17 () {56 vars in 1114 bytes} [Fri Oct 14 12:47:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:47:58.403217 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cb9092-4031-4b45-ae06-12d9607132bb None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:58.499660 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f92c2a-c1ee-4b1c-ac50-8148324613b6 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:58.543611 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c037a509-e442-4579-9f2f-c6d22c480966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:58.544253 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c037a509-e442-4579-9f2f-c6d22c480966 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:58.544534 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c037a509-e442-4579-9f2f-c6d22c480966 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:58.544805 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c037a509-e442-4579-9f2f-c6d22c480966 None admin] PATH_INFO: `/v3/groups/36aeee9d421d4c37b5d3782a99cc836c` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:58.545922 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c037a509-e442-4579-9f2f-c6d22c480966 None admin] RBAC: Authorizing `identity:get_group(group_id=36aeee9d421d4c37b5d3782a99cc836c)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:58.547406 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c037a509-e442-4579-9f2f-c6d22c480966 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:58.550954 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 163/321] 10.222.0.17 () {56 vars in 1180 bytes} [Fri Oct 14 12:47:58 2022] GET /identity/v3/groups/36aeee9d421d4c37b5d3782a99cc836c => generated 226 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:58.551745 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d09c367-76ce-4ca7-8b58-313fb15d9c23 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:58.552030 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d09c367-76ce-4ca7-8b58-313fb15d9c23 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:58.552305 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d09c367-76ce-4ca7-8b58-313fb15d9c23 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:58.553565 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 164/322] 10.222.0.17 () {54 vars in 927 bytes} [Fri Oct 14 12:47:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:47:58.553929 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cb9092-4031-4b45-ae06-12d9607132bb None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:58.554378 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d09c367-76ce-4ca7-8b58-313fb15d9c23 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:58.598342 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9715ef5-e854-4f6c-b38c-48c6a133bd1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:58.598952 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9715ef5-e854-4f6c-b38c-48c6a133bd1a None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:58.599232 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9715ef5-e854-4f6c-b38c-48c6a133bd1a None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:58.599506 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9715ef5-e854-4f6c-b38c-48c6a133bd1a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:58.600243 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9715ef5-e854-4f6c-b38c-48c6a133bd1a None admin] RBAC: Adding query filter params (group.id=36aeee9d421d4c37b5d3782a99cc836c, role.id=5e8849303a75425b9eaa2681cc031af1, scope.project.id=7941e70fc4dd4ecb9c70a568789af856) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:58.600554 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9715ef5-e854-4f6c-b38c-48c6a133bd1a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:58.602021 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9715ef5-e854-4f6c-b38c-48c6a133bd1a None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:58.608175 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 159/323] 10.222.0.17 () {56 vars in 1376 bytes} [Fri Oct 14 12:47:58 2022] GET /identity/v3/role_assignments?group.id=36aeee9d421d4c37b5d3782a99cc836c&scope.project.id=7941e70fc4dd4ecb9c70a568789af856&role.id=5e8849303a75425b9eaa2681cc031af1 => generated 611 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:58.609152 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9715ef5-e854-4f6c-b38c-48c6a133bd1a None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:58.634296 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:58.665714 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:58.688856 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d09c367-76ce-4ca7-8b58-313fb15d9c23 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:58.728953 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9e1256-6338-4e99-8e4c-12c1274fe783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:58.729591 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9e1256-6338-4e99-8e4c-12c1274fe783 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:58.729852 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9e1256-6338-4e99-8e4c-12c1274fe783 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:58.730255 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9e1256-6338-4e99-8e4c-12c1274fe783 None admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:58.730944 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9e1256-6338-4e99-8e4c-12c1274fe783 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:58.731247 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9e1256-6338-4e99-8e4c-12c1274fe783 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:58.732645 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9e1256-6338-4e99-8e4c-12c1274fe783 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:58.734765 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9715ef5-e854-4f6c-b38c-48c6a133bd1a None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:58.742785 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 165/324] 10.222.0.17 () {56 vars in 1111 bytes} [Fri Oct 14 12:47:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:58.744047 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b754c1e7-5e4f-46ca-9270-78246e8795e6 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:58.744340 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b754c1e7-5e4f-46ca-9270-78246e8795e6 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:58.744615 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b754c1e7-5e4f-46ca-9270-78246e8795e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:58.764315 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-b754c1e7-5e4f-46ca-9270-78246e8795e6 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:47:58.765475 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-b754c1e7-5e4f-46ca-9270-78246e8795e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:47:58.780707 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc69ab43-0fe9-47c1-9a9d-5de3f4e31a5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:58.781330 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc69ab43-0fe9-47c1-9a9d-5de3f4e31a5b None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:58.781612 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc69ab43-0fe9-47c1-9a9d-5de3f4e31a5b None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:58.781885 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc69ab43-0fe9-47c1-9a9d-5de3f4e31a5b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:58.782650 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc69ab43-0fe9-47c1-9a9d-5de3f4e31a5b None admin] RBAC: Adding query filter params (group.id=36aeee9d421d4c37b5d3782a99cc836c, role.id=5e8849303a75425b9eaa2681cc031af1, scope.project.id=bb069426c7f5452ebe72633778574267) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:58.782965 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc69ab43-0fe9-47c1-9a9d-5de3f4e31a5b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:58.784432 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc69ab43-0fe9-47c1-9a9d-5de3f4e31a5b None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:58.791217 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 160/325] 10.222.0.17 () {56 vars in 1376 bytes} [Fri Oct 14 12:47:58 2022] GET /identity/v3/role_assignments?group.id=36aeee9d421d4c37b5d3782a99cc836c&scope.project.id=bb069426c7f5452ebe72633778574267&role.id=5e8849303a75425b9eaa2681cc031af1 => generated 611 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:58.793019 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc69ab43-0fe9-47c1-9a9d-5de3f4e31a5b None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:58.860991 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 166/326] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Oct 14 12:47:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 12:47:58.908427 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:58.930384 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc69ab43-0fe9-47c1-9a9d-5de3f4e31a5b None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:58.967616 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47eb70a-8773-44fe-9dfc-17e8de4748ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:58.968331 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47eb70a-8773-44fe-9dfc-17e8de4748ba None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:58.968539 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47eb70a-8773-44fe-9dfc-17e8de4748ba None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:58.968771 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47eb70a-8773-44fe-9dfc-17e8de4748ba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:59.044715 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47eb70a-8773-44fe-9dfc-17e8de4748ba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:59.046099 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47eb70a-8773-44fe-9dfc-17e8de4748ba None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:59.133661 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:59.136867 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b754c1e7-5e4f-46ca-9270-78246e8795e6 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:59.157815 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 161/327] 10.222.0.17 () {58 vars in 1282 bytes} [Fri Oct 14 12:47:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 14 12:47:59.164006 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47eb70a-8773-44fe-9dfc-17e8de4748ba None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:59.221624 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:59.255594 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b754c1e7-5e4f-46ca-9270-78246e8795e6 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:59.289081 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47eb70a-8773-44fe-9dfc-17e8de4748ba None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:59.294342 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f61d2cb-5627-4415-818c-fc1018fea22c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:59.295262 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f61d2cb-5627-4415-818c-fc1018fea22c None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:59.295366 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f61d2cb-5627-4415-818c-fc1018fea22c None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:59.296617 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f61d2cb-5627-4415-818c-fc1018fea22c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:59.307679 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f61d2cb-5627-4415-818c-fc1018fea22c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 12:47:59.312680 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-3f61d2cb-5627-4415-818c-fc1018fea22c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 14 12:47:59.312680 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:47:59.312680 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:47:59.312680 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:47:59.312680 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:47:59.312680 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:47:59.312680 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:47:59.312680 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:47:59.312680 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:47:59.312680 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:47:59.312680 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:47:59.312680 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:47:59.312680 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 12:47:59.312680 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 12:47:59.312680 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 12:47:59.312680 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 12:47:59.313725 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 12:47:59.313725 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 12:47:59.313725 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 12:47:59.313725 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 12:47:59.313725 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:47:59.313725 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:47:59.313725 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:47:59.313725 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:47:59.313725 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:47:59.313725 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:47:59.313725 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:47:59.313725 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 14 12:47:59.313725 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:47:59.313725 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:47:59.313725 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:47:59.313725 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:47:59.314660 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:47:59.314660 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:47:59.314660 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:47:59.314660 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:47:59.314660 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 12:47:59.314660 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 12:47:59.314660 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 12:47:59.314660 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 12:47:59.314660 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 12:47:59.314660 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 12:47:59.314660 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 14 12:47:59.314660 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 14 12:47:59.315247 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 167/328] 10.222.0.17 () {56 vars in 1096 bytes} [Fri Oct 14 12:47:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:47:59.321038 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f61d2cb-5627-4415-818c-fc1018fea22c None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:59.337347 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3656b3f9-5c49-4405-ade6-d7b2395f9dd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:59.338004 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3656b3f9-5c49-4405-ade6-d7b2395f9dd8 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:59.338461 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3656b3f9-5c49-4405-ade6-d7b2395f9dd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:59.338716 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3656b3f9-5c49-4405-ade6-d7b2395f9dd8 None admin] PATH_INFO: `/v3/projects/7941e70fc4dd4ecb9c70a568789af856` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:59.340726 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3656b3f9-5c49-4405-ade6-d7b2395f9dd8 None admin] RBAC: Authorizing `identity:get_project(project_id=7941e70fc4dd4ecb9c70a568789af856)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:59.341237 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3656b3f9-5c49-4405-ade6-d7b2395f9dd8 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:59.343307 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 162/329] 10.222.0.17 () {56 vars in 1186 bytes} [Fri Oct 14 12:47:59 2022] GET /identity/v3/projects/7941e70fc4dd4ecb9c70a568789af856 => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 12:47:59.349462 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3656b3f9-5c49-4405-ade6-d7b2395f9dd8 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:59.411501 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:59.451093 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f61d2cb-5627-4415-818c-fc1018fea22c None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:59.479710 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3656b3f9-5c49-4405-ade6-d7b2395f9dd8 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:59.491831 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:59.499641 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1004b018-adde-48b9-9c36-2bfab6c083c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:59.500122 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1004b018-adde-48b9-9c36-2bfab6c083c9 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:59.500644 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1004b018-adde-48b9-9c36-2bfab6c083c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:59.500644 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1004b018-adde-48b9-9c36-2bfab6c083c9 None admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:59.501411 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1004b018-adde-48b9-9c36-2bfab6c083c9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:59.501720 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1004b018-adde-48b9-9c36-2bfab6c083c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:59.504374 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1004b018-adde-48b9-9c36-2bfab6c083c9 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:59.512796 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 168/330] 10.222.0.17 () {56 vars in 1099 bytes} [Fri Oct 14 12:47:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 12:47:59.518299 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c0ee5b-7de0-4907-a0a2-51ad986bcdc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:59.518479 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1004b018-adde-48b9-9c36-2bfab6c083c9 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:59.518932 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c0ee5b-7de0-4907-a0a2-51ad986bcdc0 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:59.519743 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c0ee5b-7de0-4907-a0a2-51ad986bcdc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:59.520551 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c0ee5b-7de0-4907-a0a2-51ad986bcdc0 None admin] PATH_INFO: `/v3/groups/36aeee9d421d4c37b5d3782a99cc836c` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:59.521674 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c0ee5b-7de0-4907-a0a2-51ad986bcdc0 None admin] RBAC: Authorizing `identity:get_group(group_id=36aeee9d421d4c37b5d3782a99cc836c)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:59.523158 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c0ee5b-7de0-4907-a0a2-51ad986bcdc0 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:59.524715 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 163/331] 10.222.0.17 () {56 vars in 1180 bytes} [Fri Oct 14 12:47:59 2022] GET /identity/v3/groups/36aeee9d421d4c37b5d3782a99cc836c => generated 226 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 12:47:59.530396 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c0ee5b-7de0-4907-a0a2-51ad986bcdc0 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:59.621046 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1004b018-adde-48b9-9c36-2bfab6c083c9 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:59.631022 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c0ee5b-7de0-4907-a0a2-51ad986bcdc0 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:59.647384 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:59.655407 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1b7582-7500-40e8-99a0-fa962d969d47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:59.656010 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1b7582-7500-40e8-99a0-fa962d969d47 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:59.656282 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1b7582-7500-40e8-99a0-fa962d969d47 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:59.656550 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1b7582-7500-40e8-99a0-fa962d969d47 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:59.666455 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c234ff93-7680-4dc9-9590-d1723f3ced70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:59.667053 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c234ff93-7680-4dc9-9590-d1723f3ced70 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:59.667335 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c234ff93-7680-4dc9-9590-d1723f3ced70 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:59.667610 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c234ff93-7680-4dc9-9590-d1723f3ced70 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:59.668328 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c234ff93-7680-4dc9-9590-d1723f3ced70 None admin] RBAC: Adding query filter params (group.id=36aeee9d421d4c37b5d3782a99cc836c, role.id=251e12cde1564a10b367cc385e58b828, scope.project.id=7941e70fc4dd4ecb9c70a568789af856) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:47:59.668637 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c234ff93-7680-4dc9-9590-d1723f3ced70 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:59.670065 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c234ff93-7680-4dc9-9590-d1723f3ced70 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:59.675787 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 164/332] 10.222.0.17 () {56 vars in 1376 bytes} [Fri Oct 14 12:47:59 2022] GET /identity/v3/role_assignments?group.id=36aeee9d421d4c37b5d3782a99cc836c&scope.project.id=7941e70fc4dd4ecb9c70a568789af856&role.id=251e12cde1564a10b367cc385e58b828 => generated 611 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 12:47:59.718832 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:47:59.727857 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1b7582-7500-40e8-99a0-fa962d969d47 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:59.729376 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1b7582-7500-40e8-99a0-fa962d969d47 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:59.837082 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 169/333] 10.222.0.17 () {58 vars in 1282 bytes} [Fri Oct 14 12:47:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 14 12:47:59.842760 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c234ff93-7680-4dc9-9590-d1723f3ced70 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:47:59.948137 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c234ff93-7680-4dc9-9590-d1723f3ced70 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:47:59.983002 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eaf2aa-6cd6-4739-9420-e70a48d57df0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:47:59.983893 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eaf2aa-6cd6-4739-9420-e70a48d57df0 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:47:59.984164 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eaf2aa-6cd6-4739-9420-e70a48d57df0 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:47:59.984431 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eaf2aa-6cd6-4739-9420-e70a48d57df0 None admin] PATH_INFO: `/v3/projects/fd0b9855003d4ec7b5e5abb80be13578` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:47:59.985552 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3eaf2aa-6cd6-4739-9420-e70a48d57df0 None admin] RBAC: Authorizing `identity:get_project(project_id=fd0b9855003d4ec7b5e5abb80be13578)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:47:59.987019 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3eaf2aa-6cd6-4739-9420-e70a48d57df0 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:47:59.988676 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 165/334] 10.222.0.17 () {56 vars in 1186 bytes} [Fri Oct 14 12:47:59 2022] GET /identity/v3/projects/fd0b9855003d4ec7b5e5abb80be13578 => generated 344 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:47:59.994297 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1b7582-7500-40e8-99a0-fa962d969d47 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:00.091349 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:00.099266 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1b7582-7500-40e8-99a0-fa962d969d47 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:00.132902 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4806ae5f-7557-467b-abda-9f4609bf789f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:00.133522 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4806ae5f-7557-467b-abda-9f4609bf789f None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:00.133802 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4806ae5f-7557-467b-abda-9f4609bf789f None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:00.134077 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4806ae5f-7557-467b-abda-9f4609bf789f None admin] PATH_INFO: `/v3/groups/00473bb943ed46a4b68fa5b9ba7e86d4` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:00.135218 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4806ae5f-7557-467b-abda-9f4609bf789f None admin] RBAC: Authorizing `identity:get_group(group_id=00473bb943ed46a4b68fa5b9ba7e86d4)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:00.136654 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4806ae5f-7557-467b-abda-9f4609bf789f None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:00.138275 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 170/335] 10.222.0.17 () {56 vars in 1180 bytes} [Fri Oct 14 12:47:59 2022] GET /identity/v3/groups/00473bb943ed46a4b68fa5b9ba7e86d4 => generated 229 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:00.144089 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eaf2aa-6cd6-4739-9420-e70a48d57df0 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:00.191585 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:00.240298 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eaf2aa-6cd6-4739-9420-e70a48d57df0 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:00.272123 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d8bac8-8d55-429c-8c7c-189d6ada561d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:00.272730 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d8bac8-8d55-429c-8c7c-189d6ada561d None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:00.273008 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d8bac8-8d55-429c-8c7c-189d6ada561d None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:00.273276 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d8bac8-8d55-429c-8c7c-189d6ada561d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:00.273994 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d8bac8-8d55-429c-8c7c-189d6ada561d None admin] RBAC: Adding query filter params (group.id=00473bb943ed46a4b68fa5b9ba7e86d4, role.id=7f6e29e390bc41f7a9af17659a2e95d1, scope.project.id=fd0b9855003d4ec7b5e5abb80be13578) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:00.274325 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d8bac8-8d55-429c-8c7c-189d6ada561d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:00.275764 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d8bac8-8d55-429c-8c7c-189d6ada561d None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:00.281567 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 166/336] 10.222.0.17 () {56 vars in 1376 bytes} [Fri Oct 14 12:48:00 2022] GET /identity/v3/role_assignments?group.id=00473bb943ed46a4b68fa5b9ba7e86d4&scope.project.id=fd0b9855003d4ec7b5e5abb80be13578&role.id=7f6e29e390bc41f7a9af17659a2e95d1 => generated 611 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:02.943067 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93fb53c-e167-40db-b039-3a4c380491a9 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:02.943616 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93fb53c-e167-40db-b039-3a4c380491a9 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:02.943616 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93fb53c-e167-40db-b039-3a4c380491a9 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:02.945332 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 171/337] 10.222.0.17 () {54 vars in 927 bytes} [Fri Oct 14 12:48:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:48:02.951060 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e94f59-0924-4e34-8022-edb0f9851989 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:02.951893 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e94f59-0924-4e34-8022-edb0f9851989 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:02.952374 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e94f59-0924-4e34-8022-edb0f9851989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:02.979188 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-85e94f59-0924-4e34-8022-edb0f9851989 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:48:02.980758 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-85e94f59-0924-4e34-8022-edb0f9851989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:48:03.080385 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 167/338] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Oct 14 12:48:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 12:48:03.396941 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddaa550-97dc-49a2-8c28-20b4fb2aa60c None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:03.397219 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddaa550-97dc-49a2-8c28-20b4fb2aa60c None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:03.397773 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddaa550-97dc-49a2-8c28-20b4fb2aa60c None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:03.399733 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 172/339] 10.222.0.17 () {54 vars in 927 bytes} [Fri Oct 14 12:48:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:48:03.406680 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f4d4ee-b160-4083-873d-4efb4ecf97f1 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:03.407236 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f4d4ee-b160-4083-873d-4efb4ecf97f1 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:03.407721 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f4d4ee-b160-4083-873d-4efb4ecf97f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:03.431557 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-39f4d4ee-b160-4083-873d-4efb4ecf97f1 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:48:03.433091 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-39f4d4ee-b160-4083-873d-4efb4ecf97f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:48:03.463759 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6da2fa7-705d-44dc-ab7f-893d84bf3b43 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:03.464404 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6da2fa7-705d-44dc-ab7f-893d84bf3b43 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:03.464895 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6da2fa7-705d-44dc-ab7f-893d84bf3b43 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:03.466742 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 173/340] 10.222.0.17 () {54 vars in 927 bytes} [Fri Oct 14 12:48:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:48:03.472216 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4bdebc-b391-448a-bbac-d136c44542d0 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:03.472772 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4bdebc-b391-448a-bbac-d136c44542d0 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:03.473443 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4bdebc-b391-448a-bbac-d136c44542d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:03.494489 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:03.506235 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-6a4bdebc-b391-448a-bbac-d136c44542d0 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:48:03.507446 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-6a4bdebc-b391-448a-bbac-d136c44542d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:48:03.536723 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 168/341] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Oct 14 12:48:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 12:48:03.538630 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f4d4ee-b160-4083-873d-4efb4ecf97f1 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:03.632510 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 174/342] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Oct 14 12:48:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 14 12:48:03.674469 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f4d4ee-b160-4083-873d-4efb4ecf97f1 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:03.715309 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a36ab2-763b-445a-b048-879229721fba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:03.716327 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a36ab2-763b-445a-b048-879229721fba None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:03.716890 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a36ab2-763b-445a-b048-879229721fba None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:03.717365 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a36ab2-763b-445a-b048-879229721fba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:03.728366 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a36ab2-763b-445a-b048-879229721fba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:03.730260 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a36ab2-763b-445a-b048-879229721fba None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:03.745704 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-64a36ab2-763b-445a-b048-879229721fba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:48:03.745704 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:03.745704 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:48:03.745704 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:48:03.745704 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:48:03.745704 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:48:03.745704 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:48:03.745704 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:48:03.745704 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:48:03.745704 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:48:03.745704 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:48:03.745704 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:48:03.745704 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 12:48:03.745704 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 12:48:03.745704 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 12:48:03.745704 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 12:48:03.746690 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:48:03.746690 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:48:03.746690 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:48:03.746690 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:48:03.746690 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:48:03.746690 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:48:03.746690 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:48:03.746690 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 14 12:48:03.746690 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:48:03.746690 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:48:03.746690 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:48:03.746690 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:48:03.746690 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:48:03.746690 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:48:03.746690 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:48:03.746690 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:48:03.746690 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 12:48:03.747514 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 12:48:03.747514 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:48:03.747514 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 14 12:48:03.749653 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 169/343] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Oct 14 12:48:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:48:03.759276 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4bdebc-b391-448a-bbac-d136c44542d0 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:03.826586 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a36ab2-763b-445a-b048-879229721fba None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:03.870160 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:03.904819 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:03.925345 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4bdebc-b391-448a-bbac-d136c44542d0 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:03.977763 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a36ab2-763b-445a-b048-879229721fba None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:04.013019 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdefc65e-6f90-4354-ba84-0e7056da294b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:04.014352 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdefc65e-6f90-4354-ba84-0e7056da294b None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:04.014834 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdefc65e-6f90-4354-ba84-0e7056da294b None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:04.015300 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdefc65e-6f90-4354-ba84-0e7056da294b None admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:04.015431 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b22744-8f19-41cb-8790-c241ca6b685a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:04.016082 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b22744-8f19-41cb-8790-c241ca6b685a None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:04.016368 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b22744-8f19-41cb-8790-c241ca6b685a None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:04.016645 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b22744-8f19-41cb-8790-c241ca6b685a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:04.016925 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdefc65e-6f90-4354-ba84-0e7056da294b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:04.017421 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdefc65e-6f90-4354-ba84-0e7056da294b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:04.023116 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdefc65e-6f90-4354-ba84-0e7056da294b None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:04.029013 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b22744-8f19-41cb-8790-c241ca6b685a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:04.031002 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b22744-8f19-41cb-8790-c241ca6b685a None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:04.035820 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 175/344] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Oct 14 12:48:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:04.037081 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccecad22-2ae0-4446-b01f-8a23c71180cd None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:04.037361 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccecad22-2ae0-4446-b01f-8a23c71180cd None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:04.037634 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccecad22-2ae0-4446-b01f-8a23c71180cd None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:04.043334 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 176/345] 10.222.0.17 () {54 vars in 927 bytes} [Fri Oct 14 12:48:04 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:48:04.044051 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccecad22-2ae0-4446-b01f-8a23c71180cd None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:04.047476 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-46b22744-8f19-41cb-8790-c241ca6b685a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:48:04.047476 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:04.047476 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:48:04.047476 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:48:04.047476 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:48:04.047476 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:48:04.047476 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:48:04.047476 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:48:04.047476 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:48:04.047476 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:48:04.047476 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:48:04.047476 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:48:04.047476 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 12:48:04.047476 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 12:48:04.047476 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 12:48:04.047476 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 12:48:04.048315 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:48:04.048315 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:48:04.048315 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:48:04.048315 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:48:04.048315 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:48:04.048315 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:48:04.048315 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:48:04.048315 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 14 12:48:04.048315 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:48:04.048315 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:48:04.048315 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:48:04.048315 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:48:04.048315 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:48:04.048315 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:48:04.048315 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:48:04.048315 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:48:04.048315 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 12:48:04.049727 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 12:48:04.049727 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:48:04.049727 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 14 12:48:04.049727 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 170/346] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Oct 14 12:48:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:48:04.055598 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c29c3c2-0375-4b48-b5f7-ee8b0a132682 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:04.055885 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c29c3c2-0375-4b48-b5f7-ee8b0a132682 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:04.056159 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c29c3c2-0375-4b48-b5f7-ee8b0a132682 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:04.076060 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-4c29c3c2-0375-4b48-b5f7-ee8b0a132682 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:48:04.077307 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-4c29c3c2-0375-4b48-b5f7-ee8b0a132682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:48:04.155044 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 171/347] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Oct 14 12:48:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 12:48:04.155749 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c29c3c2-0375-4b48-b5f7-ee8b0a132682 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:04.178332 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:04.180904 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccecad22-2ae0-4446-b01f-8a23c71180cd None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:04.221393 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159a6236-d856-43b2-917f-548f20693486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:04.222602 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159a6236-d856-43b2-917f-548f20693486 None admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:04.223084 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159a6236-d856-43b2-917f-548f20693486 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:04.223554 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159a6236-d856-43b2-917f-548f20693486 None admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:04.224400 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159a6236-d856-43b2-917f-548f20693486 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:04.226040 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159a6236-d856-43b2-917f-548f20693486 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:04.251288 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 177/348] 10.222.0.17 () {60 vars in 1132 bytes} [Fri Oct 14 12:48:04 2022] POST /identity/v3/users => generated 246 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 12:48:04.252832 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159a6236-d856-43b2-917f-548f20693486 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:04.269705 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:04.301881 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c29c3c2-0375-4b48-b5f7-ee8b0a132682 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:04.368209 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e021a8f6-aeef-4c45-898c-79b4482e95b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:04.368847 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e021a8f6-aeef-4c45-898c-79b4482e95b7 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:04.369130 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e021a8f6-aeef-4c45-898c-79b4482e95b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:04.373612 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e021a8f6-aeef-4c45-898c-79b4482e95b7 None admin] PATH_INFO: `/v3/domains` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:04.374375 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e021a8f6-aeef-4c45-898c-79b4482e95b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:04.374751 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e021a8f6-aeef-4c45-898c-79b4482e95b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:04.376181 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e021a8f6-aeef-4c45-898c-79b4482e95b7 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:04.406448 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 172/349] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Oct 14 12:48:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:04.413187 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e021a8f6-aeef-4c45-898c-79b4482e95b7 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:04.465663 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159a6236-d856-43b2-917f-548f20693486 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:04.514880 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:04.524124 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bd0a29-c246-4cbe-810d-9f7422d41b10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:04.525080 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bd0a29-c246-4cbe-810d-9f7422d41b10 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:04.525365 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bd0a29-c246-4cbe-810d-9f7422d41b10 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:04.525639 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bd0a29-c246-4cbe-810d-9f7422d41b10 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:04.545682 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bd0a29-c246-4cbe-810d-9f7422d41b10 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:04.547476 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bd0a29-c246-4cbe-810d-9f7422d41b10 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:04.550843 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e021a8f6-aeef-4c45-898c-79b4482e95b7 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:04.563530 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-52bd0a29-c246-4cbe-810d-9f7422d41b10 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:48:04.563530 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:04.563530 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:48:04.563530 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:48:04.563530 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:48:04.563530 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:48:04.563530 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:48:04.563530 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:48:04.563530 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:48:04.563530 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:48:04.563530 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:48:04.563530 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:48:04.563530 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 12:48:04.563530 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 12:48:04.563530 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 12:48:04.563530 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 12:48:04.564421 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:48:04.564421 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:48:04.564421 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:48:04.564421 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:48:04.564421 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:48:04.564421 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:48:04.564421 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:48:04.564421 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 14 12:48:04.564421 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:48:04.564421 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:48:04.564421 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:48:04.564421 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:48:04.564421 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:48:04.564421 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:48:04.564421 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:48:04.564421 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:48:04.564421 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 12:48:04.565238 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 12:48:04.565238 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:48:04.565238 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 14 12:48:04.567482 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 178/350] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Oct 14 12:48:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:48:04.568438 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bd0a29-c246-4cbe-810d-9f7422d41b10 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:04.591866 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d654ae53-a158-4322-8ea0-c0a1b75e084e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:04.592483 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d654ae53-a158-4322-8ea0-c0a1b75e084e None admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:04.592758 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d654ae53-a158-4322-8ea0-c0a1b75e084e None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:04.593028 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d654ae53-a158-4322-8ea0-c0a1b75e084e None admin] PATH_INFO: `/v3/users` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:04.593668 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d654ae53-a158-4322-8ea0-c0a1b75e084e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:04.595121 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d654ae53-a158-4322-8ea0-c0a1b75e084e None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:04.618024 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 173/351] 10.222.0.17 () {60 vars in 1132 bytes} [Fri Oct 14 12:48:04 2022] POST /identity/v3/users => generated 248 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 12:48:04.619449 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4cf51b-5656-446c-b69a-fe3650320bfe None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:04.619559 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4cf51b-5656-446c-b69a-fe3650320bfe None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:04.619881 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4cf51b-5656-446c-b69a-fe3650320bfe None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:04.621236 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 174/352] 10.222.0.17 () {54 vars in 927 bytes} [Fri Oct 14 12:48:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:48:04.621822 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4cf51b-5656-446c-b69a-fe3650320bfe None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:04.640348 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:04.693770 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bd0a29-c246-4cbe-810d-9f7422d41b10 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:04.734100 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee165390-08bd-44de-9146-290d30fc8440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:04.734758 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee165390-08bd-44de-9146-290d30fc8440 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:04.735158 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee165390-08bd-44de-9146-290d30fc8440 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:04.735347 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee165390-08bd-44de-9146-290d30fc8440 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:04.748488 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee165390-08bd-44de-9146-290d30fc8440 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:04.750052 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee165390-08bd-44de-9146-290d30fc8440 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:04.767777 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-ee165390-08bd-44de-9146-290d30fc8440 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:48:04.767777 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:04.767777 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:48:04.767777 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:48:04.767777 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:48:04.767777 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:48:04.767777 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:48:04.767777 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:48:04.767777 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:48:04.767777 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:48:04.767777 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:48:04.767777 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:48:04.767777 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 12:48:04.767777 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 12:48:04.767777 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 12:48:04.767777 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 12:48:04.768719 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:48:04.768719 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:48:04.768719 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:48:04.768719 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:48:04.768719 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:48:04.768719 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:48:04.768719 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:48:04.768719 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 14 12:48:04.768719 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:48:04.768719 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:48:04.768719 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:48:04.768719 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:48:04.768719 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:48:04.768719 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:48:04.768719 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:48:04.768719 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:48:04.768719 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 12:48:04.770112 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 12:48:04.770112 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:48:04.770112 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 14 12:48:04.770112 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 179/353] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Oct 14 12:48:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:48:04.770912 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc694082-b651-4877-aad1-8c3e126fa31b None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:04.771194 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc694082-b651-4877-aad1-8c3e126fa31b None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:04.771465 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc694082-b651-4877-aad1-8c3e126fa31b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:04.789227 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4cf51b-5656-446c-b69a-fe3650320bfe None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:04.791529 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-cc694082-b651-4877-aad1-8c3e126fa31b None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:48:04.793603 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-cc694082-b651-4877-aad1-8c3e126fa31b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:48:04.823403 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:04.841298 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12e6003-bdce-4562-a9ea-1a8433643fa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:04.841915 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12e6003-bdce-4562-a9ea-1a8433643fa6 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:04.842238 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12e6003-bdce-4562-a9ea-1a8433643fa6 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:04.842587 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12e6003-bdce-4562-a9ea-1a8433643fa6 None admin] PATH_INFO: `/v3/domains` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:04.843246 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12e6003-bdce-4562-a9ea-1a8433643fa6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:04.843546 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12e6003-bdce-4562-a9ea-1a8433643fa6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:04.845153 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12e6003-bdce-4562-a9ea-1a8433643fa6 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:04.865130 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 175/354] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Oct 14 12:48:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:04.866106 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12e6003-bdce-4562-a9ea-1a8433643fa6 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:04.891746 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 180/355] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Oct 14 12:48:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 12:48:04.892610 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc694082-b651-4877-aad1-8c3e126fa31b None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:04.981876 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:04.991660 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12e6003-bdce-4562-a9ea-1a8433643fa6 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:05.058861 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ecb471-b4d5-443d-9d1f-b4d065111dc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:05.059493 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ecb471-b4d5-443d-9d1f-b4d065111dc1 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:05.059780 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ecb471-b4d5-443d-9d1f-b4d065111dc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:05.060059 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ecb471-b4d5-443d-9d1f-b4d065111dc1 None admin] PATH_INFO: `/v3/domains` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:05.060720 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ecb471-b4d5-443d-9d1f-b4d065111dc1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:05.061026 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ecb471-b4d5-443d-9d1f-b4d065111dc1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:05.062440 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ecb471-b4d5-443d-9d1f-b4d065111dc1 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:05.068640 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc694082-b651-4877-aad1-8c3e126fa31b None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:05.081883 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 176/356] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Oct 14 12:48:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:05.088447 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ecb471-b4d5-443d-9d1f-b4d065111dc1 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:05.119530 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e04428d-eff3-49a7-a950-4930e64f05e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:05.120165 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e04428d-eff3-49a7-a950-4930e64f05e3 None admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:05.120440 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e04428d-eff3-49a7-a950-4930e64f05e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:05.120711 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e04428d-eff3-49a7-a950-4930e64f05e3 None admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:05.121368 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e04428d-eff3-49a7-a950-4930e64f05e3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:05.124002 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e04428d-eff3-49a7-a950-4930e64f05e3 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:05.164290 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 181/357] 10.222.0.17 () {60 vars in 1132 bytes} [Fri Oct 14 12:48:04 2022] POST /identity/v3/users => generated 248 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 12:48:05.186572 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:05.255994 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ecb471-b4d5-443d-9d1f-b4d065111dc1 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:05.275044 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e04428d-eff3-49a7-a950-4930e64f05e3 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:05.335041 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf0b961-c382-4faa-83c4-f032f44bf840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:05.335671 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf0b961-c382-4faa-83c4-f032f44bf840 None admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:05.335957 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf0b961-c382-4faa-83c4-f032f44bf840 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:05.336228 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf0b961-c382-4faa-83c4-f032f44bf840 None admin] PATH_INFO: `/v3/users` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:05.336906 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf0b961-c382-4faa-83c4-f032f44bf840 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:05.338891 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf0b961-c382-4faa-83c4-f032f44bf840 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:05.385767 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 177/358] 10.222.0.17 () {60 vars in 1132 bytes} [Fri Oct 14 12:48:05 2022] POST /identity/v3/users => generated 249 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 12:48:05.448854 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:05.453735 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e04428d-eff3-49a7-a950-4930e64f05e3 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:05.500517 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648d1035-a7ca-4c5b-9159-8e6d39b2c9de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:05.501142 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648d1035-a7ca-4c5b-9159-8e6d39b2c9de None admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:05.501461 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648d1035-a7ca-4c5b-9159-8e6d39b2c9de None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:05.501735 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648d1035-a7ca-4c5b-9159-8e6d39b2c9de None admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:05.502449 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648d1035-a7ca-4c5b-9159-8e6d39b2c9de None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:05.504031 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648d1035-a7ca-4c5b-9159-8e6d39b2c9de None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:05.512542 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.sql.core [None req-648d1035-a7ca-4c5b-9159-8e6d39b2c9de None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 14 12:48:05.512542 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 14 12:48:05.512542 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [parameters: {'id': '31133d85f6c14d7798ffcfe840396d96', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 14 12:48:05.512542 dv-cinder-820994-7-smb devstack@keystone.service[81438]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81438) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 14 12:48:05.530480 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-648d1035-a7ca-4c5b-9159-8e6d39b2c9de None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 14 12:48:05.530480 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:05.530480 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 14 12:48:05.530480 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 14 12:48:05.530480 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 14 12:48:05.530480 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 14 12:48:05.530480 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 14 12:48:05.530480 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application result = self._query(query) Oct 14 12:48:05.530480 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 14 12:48:05.530480 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application conn.query(q) Oct 14 12:48:05.530480 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 14 12:48:05.530480 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 14 12:48:05.530480 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 14 12:48:05.530480 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application result.read() Oct 14 12:48:05.530480 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 14 12:48:05.531416 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 14 12:48:05.531416 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 14 12:48:05.531416 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 14 12:48:05.531416 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 14 12:48:05.531416 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 14 12:48:05.531416 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 14 12:48:05.531416 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 14 12:48:05.531416 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 14 12:48:05.531416 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 14 12:48:05.531416 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 14 12:48:05.531416 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 14 12:48:05.531416 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:05.531416 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 14 12:48:05.531416 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 14 12:48:05.531416 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Oct 14 12:48:05.531416 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return ref.to_dict() Oct 14 12:48:05.531416 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 14 12:48:05.531416 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application next(self.gen) Oct 14 12:48:05.532336 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 14 12:48:05.532336 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application yield resource Oct 14 12:48:05.532336 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 14 12:48:05.532336 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application next(self.gen) Oct 14 12:48:05.532336 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 14 12:48:05.532336 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application self.session.rollback() Oct 14 12:48:05.532336 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 14 12:48:05.532336 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application self.force_reraise() Oct 14 12:48:05.532336 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 14 12:48:05.532336 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise self.value Oct 14 12:48:05.532336 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 14 12:48:05.532336 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 14 12:48:05.532336 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 14 12:48:05.532336 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application session.commit() Oct 14 12:48:05.532336 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 14 12:48:05.532336 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 14 12:48:05.532336 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 14 12:48:05.533147 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application self._prepare_impl() Oct 14 12:48:05.533147 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 14 12:48:05.533147 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application self.session.flush() Oct 14 12:48:05.533147 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 14 12:48:05.533147 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application self._flush(objects) Oct 14 12:48:05.533147 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 14 12:48:05.533147 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 14 12:48:05.533147 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 14 12:48:05.533147 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application compat.raise_( Oct 14 12:48:05.533147 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 14 12:48:05.533147 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception Oct 14 12:48:05.533147 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 14 12:48:05.533147 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application flush_context.execute() Oct 14 12:48:05.533147 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 14 12:48:05.533147 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rec.execute(self) Oct 14 12:48:05.533147 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 14 12:48:05.533147 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 14 12:48:05.533980 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 14 12:48:05.533980 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 14 12:48:05.533980 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 14 12:48:05.533980 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 14 12:48:05.533980 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 14 12:48:05.533980 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 14 12:48:05.533980 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 14 12:48:05.533980 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 14 12:48:05.533980 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 14 12:48:05.533980 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 14 12:48:05.533980 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 14 12:48:05.533980 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 14 12:48:05.533980 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 14 12:48:05.533980 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 14 12:48:05.533980 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 14 12:48:05.533980 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception Oct 14 12:48:05.534930 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 14 12:48:05.534930 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 14 12:48:05.534930 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 14 12:48:05.534930 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 14 12:48:05.534930 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 14 12:48:05.534930 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application result = self._query(query) Oct 14 12:48:05.534930 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 14 12:48:05.534930 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application conn.query(q) Oct 14 12:48:05.534930 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 14 12:48:05.534930 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 14 12:48:05.534930 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 14 12:48:05.534930 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application result.read() Oct 14 12:48:05.534930 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 14 12:48:05.534930 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 14 12:48:05.534930 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 14 12:48:05.534930 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 14 12:48:05.537304 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 14 12:48:05.537304 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 14 12:48:05.537304 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 14 12:48:05.537304 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 14 12:48:05.537304 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 14 12:48:05.537304 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 14 12:48:05.537304 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [parameters: {'id': '31133d85f6c14d7798ffcfe840396d96', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 14 12:48:05.537304 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 14 12:48:05.537304 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 14 12:48:05.537304 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 14 12:48:05.537304 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 14 12:48:05.537304 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:05.537304 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:48:05.537304 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:48:05.537304 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:48:05.537304 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:48:05.539447 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:48:05.539447 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:48:05.539447 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:48:05.539447 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:48:05.539447 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:48:05.539447 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:48:05.539447 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Oct 14 12:48:05.539447 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Oct 14 12:48:05.539447 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:48:05.539447 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:48:05.539447 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Oct 14 12:48:05.539447 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Oct 14 12:48:05.539447 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 14 12:48:05.539447 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 14 12:48:05.539447 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 14 12:48:05.539447 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 14 12:48:05.541418 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 182/359] 10.222.0.17 () {60 vars in 1131 bytes} [Fri Oct 14 12:48:05 2022] POST /identity/v3/roles => generated 144 bytes in 258 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Oct 14 12:48:05.541571 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf0b961-c382-4faa-83c4-f032f44bf840 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:05.648239 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:05.652537 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf0b961-c382-4faa-83c4-f032f44bf840 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:05.691926 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e1b46a-eb22-46b6-b365-4b94ab709c12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:05.692595 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e1b46a-eb22-46b6-b365-4b94ab709c12 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:05.692874 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e1b46a-eb22-46b6-b365-4b94ab709c12 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:05.693150 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e1b46a-eb22-46b6-b365-4b94ab709c12 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:05.704683 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e1b46a-eb22-46b6-b365-4b94ab709c12 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 12:48:05.710045 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-33e1b46a-eb22-46b6-b365-4b94ab709c12 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 14 12:48:05.710045 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:05.710045 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:48:05.710045 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:48:05.710045 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:48:05.710045 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:48:05.710045 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:48:05.710045 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:48:05.710045 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:48:05.710045 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:48:05.710045 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:48:05.710045 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:48:05.710045 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 12:48:05.710045 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 12:48:05.710045 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 12:48:05.710045 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 12:48:05.711937 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 12:48:05.711937 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 12:48:05.711937 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 12:48:05.711937 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 12:48:05.711937 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:48:05.711937 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:48:05.711937 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:48:05.711937 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:48:05.711937 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:48:05.711937 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:48:05.711937 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:48:05.711937 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 14 12:48:05.711937 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:48:05.711937 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:48:05.711937 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:48:05.711937 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:48:05.712957 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:48:05.712957 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:48:05.712957 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:48:05.712957 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:48:05.712957 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 12:48:05.712957 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 12:48:05.712957 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 12:48:05.712957 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 12:48:05.712957 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 12:48:05.712957 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 12:48:05.712957 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 14 12:48:05.712957 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 14 12:48:05.712957 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 178/360] 10.222.0.17 () {56 vars in 1114 bytes} [Fri Oct 14 12:48:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:48:05.719196 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648d1035-a7ca-4c5b-9159-8e6d39b2c9de None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:05.864550 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648d1035-a7ca-4c5b-9159-8e6d39b2c9de None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:05.912623 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1468dd-0793-441a-8cd9-c0eaa208625a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:05.913245 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1468dd-0793-441a-8cd9-c0eaa208625a None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:05.913522 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1468dd-0793-441a-8cd9-c0eaa208625a None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:05.913783 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1468dd-0793-441a-8cd9-c0eaa208625a None admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:05.914478 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1468dd-0793-441a-8cd9-c0eaa208625a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:05.914775 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1468dd-0793-441a-8cd9-c0eaa208625a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:05.916151 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1468dd-0793-441a-8cd9-c0eaa208625a None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:05.929425 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 183/361] 10.222.0.17 () {56 vars in 1111 bytes} [Fri Oct 14 12:48:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:06.804819 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d29d02-f84e-423c-916d-3d28a597d614 None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:06.805330 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d29d02-f84e-423c-916d-3d28a597d614 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:06.805405 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d29d02-f84e-423c-916d-3d28a597d614 None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:06.806984 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 179/362] 10.222.0.17 () {54 vars in 927 bytes} [Fri Oct 14 12:48:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:48:06.813964 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e9f404-0c08-40f9-9096-0a82f8707c92 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:06.814852 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e9f404-0c08-40f9-9096-0a82f8707c92 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:06.815265 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e9f404-0c08-40f9-9096-0a82f8707c92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:06.837230 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-c3e9f404-0c08-40f9-9096-0a82f8707c92 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:48:06.838819 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-c3e9f404-0c08-40f9-9096-0a82f8707c92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:48:06.865305 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:06.927881 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 184/363] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Oct 14 12:48:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 12:48:07.234521 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d29d02-f84e-423c-916d-3d28a597d614 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:07.377975 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d29d02-f84e-423c-916d-3d28a597d614 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:07.427383 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf42973f-d3d6-482d-8cd2-5f77413c51b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:07.428356 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf42973f-d3d6-482d-8cd2-5f77413c51b7 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:07.428815 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf42973f-d3d6-482d-8cd2-5f77413c51b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:07.429265 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf42973f-d3d6-482d-8cd2-5f77413c51b7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:07.445200 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf42973f-d3d6-482d-8cd2-5f77413c51b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 12:48:07.448310 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c79e23-5b32-49d0-a6c4-f4d3cb20388f None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:07.448600 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c79e23-5b32-49d0-a6c4-f4d3cb20388f None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:07.448880 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c79e23-5b32-49d0-a6c4-f4d3cb20388f None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:07.450712 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 185/364] 10.222.0.17 () {54 vars in 927 bytes} [Fri Oct 14 12:48:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:48:07.451555 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-bf42973f-d3d6-482d-8cd2-5f77413c51b7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 14 12:48:07.451555 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:07.451555 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:48:07.451555 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:48:07.451555 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:48:07.451555 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:48:07.451555 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:48:07.451555 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:48:07.451555 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:48:07.451555 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:48:07.451555 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:48:07.451555 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:48:07.451555 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 12:48:07.451555 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 12:48:07.451555 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 12:48:07.451555 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 12:48:07.452416 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 12:48:07.452416 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 12:48:07.452416 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 12:48:07.452416 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 12:48:07.452416 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:48:07.452416 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:48:07.452416 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:48:07.452416 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:48:07.452416 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:48:07.452416 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:48:07.452416 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:48:07.452416 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 14 12:48:07.452416 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:48:07.452416 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:48:07.452416 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:48:07.452416 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:48:07.453186 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:48:07.453186 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:48:07.453186 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:48:07.453186 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:48:07.453186 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 12:48:07.453186 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 12:48:07.453186 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 12:48:07.453186 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 12:48:07.453186 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 12:48:07.453186 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 12:48:07.453186 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 14 12:48:07.453186 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 14 12:48:07.458168 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fb4b1d-193c-44bf-850a-ca313cd06c19 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:07.458168 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fb4b1d-193c-44bf-850a-ca313cd06c19 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:07.458168 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fb4b1d-193c-44bf-850a-ca313cd06c19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:07.459579 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 180/365] 10.222.0.17 () {56 vars in 1102 bytes} [Fri Oct 14 12:48:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:48:07.465819 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf42973f-d3d6-482d-8cd2-5f77413c51b7 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:07.482732 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-30fb4b1d-193c-44bf-850a-ca313cd06c19 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:48:07.484573 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-30fb4b1d-193c-44bf-850a-ca313cd06c19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:48:07.492656 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:07.599734 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 186/366] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Oct 14 12:48:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 14 12:48:07.634564 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf42973f-d3d6-482d-8cd2-5f77413c51b7 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:07.689184 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75b1669-248d-4fed-9aa1-630d86831c2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:07.690226 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75b1669-248d-4fed-9aa1-630d86831c2f None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:07.691262 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75b1669-248d-4fed-9aa1-630d86831c2f None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:07.691772 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75b1669-248d-4fed-9aa1-630d86831c2f None admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:07.692817 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75b1669-248d-4fed-9aa1-630d86831c2f None admin] RBAC: Adding query filter params (name=service) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:07.693320 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75b1669-248d-4fed-9aa1-630d86831c2f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:07.694941 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75b1669-248d-4fed-9aa1-630d86831c2f None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:07.710112 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fb4b1d-193c-44bf-850a-ca313cd06c19 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:07.710748 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 181/367] 10.222.0.17 () {56 vars in 1103 bytes} [Fri Oct 14 12:48:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 12:48:07.838311 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:07.862244 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fb4b1d-193c-44bf-850a-ca313cd06c19 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:07.915475 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea3e073-9c54-4f93-ad9e-0ed67f40518c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:07.916028 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea3e073-9c54-4f93-ad9e-0ed67f40518c None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:07.916367 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea3e073-9c54-4f93-ad9e-0ed67f40518c None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:07.916641 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea3e073-9c54-4f93-ad9e-0ed67f40518c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:07.931164 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea3e073-9c54-4f93-ad9e-0ed67f40518c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:07.932638 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea3e073-9c54-4f93-ad9e-0ed67f40518c None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:07.952553 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-fea3e073-9c54-4f93-ad9e-0ed67f40518c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:48:07.952553 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:07.952553 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:48:07.952553 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:48:07.952553 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:48:07.952553 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:48:07.952553 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:48:07.952553 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:48:07.952553 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:48:07.952553 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:48:07.952553 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:48:07.952553 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:48:07.952553 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 12:48:07.952553 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 12:48:07.952553 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 12:48:07.952553 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 12:48:07.953497 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:48:07.953497 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:48:07.953497 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:48:07.953497 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:48:07.953497 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:48:07.953497 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:48:07.953497 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:48:07.953497 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 14 12:48:07.953497 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:48:07.953497 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:48:07.953497 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:48:07.953497 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:48:07.953497 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:48:07.953497 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:48:07.953497 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:48:07.953497 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:48:07.953497 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 12:48:07.954416 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 12:48:07.954416 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:48:07.954416 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 14 12:48:07.954416 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 187/368] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Oct 14 12:48:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 14 12:48:07.961760 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75b1669-248d-4fed-9aa1-630d86831c2f None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:07.985053 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a18bfe9-526e-48a1-810c-e7481685c64b None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:07.985393 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a18bfe9-526e-48a1-810c-e7481685c64b None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:07.985598 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a18bfe9-526e-48a1-810c-e7481685c64b None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:07.987155 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 188/369] 10.222.0.17 () {54 vars in 927 bytes} [Fri Oct 14 12:48:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 14 12:48:07.999355 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b582cde4-9196-4d77-8983-836bbe64ca42 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:07.999660 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b582cde4-9196-4d77-8983-836bbe64ca42 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:07.999900 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b582cde4-9196-4d77-8983-836bbe64ca42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:08.027327 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-b582cde4-9196-4d77-8983-836bbe64ca42 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:48:08.028851 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-b582cde4-9196-4d77-8983-836bbe64ca42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:48:08.074531 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:08.101012 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75b1669-248d-4fed-9aa1-630d86831c2f None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:08.115267 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 189/370] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Oct 14 12:48:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 12:48:08.115971 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b582cde4-9196-4d77-8983-836bbe64ca42 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:08.151594 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dd933e-d5ae-462e-9fbe-5586437f87cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:08.153413 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dd933e-d5ae-462e-9fbe-5586437f87cd None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:08.153895 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dd933e-d5ae-462e-9fbe-5586437f87cd None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:08.154412 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dd933e-d5ae-462e-9fbe-5586437f87cd None admin] PATH_INFO: `/v3/domains` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:08.155300 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dd933e-d5ae-462e-9fbe-5586437f87cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:08.155797 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dd933e-d5ae-462e-9fbe-5586437f87cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:08.157450 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dd933e-d5ae-462e-9fbe-5586437f87cd None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:08.174745 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 182/371] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Oct 14 12:48:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:08.177835 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be15ae29-e55e-4330-9198-fa3d47078e7d None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:08.178416 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be15ae29-e55e-4330-9198-fa3d47078e7d None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:08.178830 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be15ae29-e55e-4330-9198-fa3d47078e7d None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:08.181223 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 183/372] 10.222.0.17 () {54 vars in 927 bytes} [Fri Oct 14 12:48:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:48:08.182150 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be15ae29-e55e-4330-9198-fa3d47078e7d None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:08.191574 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:08.233036 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b582cde4-9196-4d77-8983-836bbe64ca42 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:08.272607 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12816cc3-9ef8-4ff1-b34b-12283cf483d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:08.273456 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12816cc3-9ef8-4ff1-b34b-12283cf483d9 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:08.273864 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12816cc3-9ef8-4ff1-b34b-12283cf483d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:08.274351 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12816cc3-9ef8-4ff1-b34b-12283cf483d9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:08.287676 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12816cc3-9ef8-4ff1-b34b-12283cf483d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 12:48:08.293395 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-12816cc3-9ef8-4ff1-b34b-12283cf483d9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 14 12:48:08.293395 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:08.293395 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:48:08.293395 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:48:08.293395 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:48:08.293395 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:48:08.293395 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:48:08.293395 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:48:08.293395 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:48:08.293395 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:48:08.293395 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:48:08.293395 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:48:08.293395 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 12:48:08.293395 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 12:48:08.293395 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 12:48:08.293395 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 12:48:08.294502 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 12:48:08.294502 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 12:48:08.294502 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 12:48:08.294502 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 12:48:08.294502 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:48:08.294502 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:48:08.294502 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:48:08.294502 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:48:08.294502 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:48:08.294502 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:48:08.294502 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:48:08.294502 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 14 12:48:08.294502 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:48:08.294502 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:48:08.294502 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:48:08.294502 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:48:08.295484 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:48:08.295484 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:48:08.295484 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:48:08.295484 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:48:08.295484 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 12:48:08.295484 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 12:48:08.295484 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 12:48:08.295484 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 12:48:08.295484 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 12:48:08.295484 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 12:48:08.295484 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 14 12:48:08.295484 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 14 12:48:08.297331 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 190/373] 10.222.0.17 () {56 vars in 1102 bytes} [Fri Oct 14 12:48:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:48:08.302733 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c916865d-b759-4430-ab3b-43a147be5ce4 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:08.302733 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c916865d-b759-4430-ab3b-43a147be5ce4 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:08.302733 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c916865d-b759-4430-ab3b-43a147be5ce4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:08.326055 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be15ae29-e55e-4330-9198-fa3d47078e7d None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:08.327953 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-c916865d-b759-4430-ab3b-43a147be5ce4 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:48:08.329620 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-c916865d-b759-4430-ab3b-43a147be5ce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:48:08.371862 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc02be66-3300-416e-811a-09122732eec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:08.372657 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc02be66-3300-416e-811a-09122732eec2 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:08.373046 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc02be66-3300-416e-811a-09122732eec2 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:08.373471 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc02be66-3300-416e-811a-09122732eec2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:08.382956 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc02be66-3300-416e-811a-09122732eec2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:08.384571 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc02be66-3300-416e-811a-09122732eec2 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:08.388397 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:08.400811 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-fc02be66-3300-416e-811a-09122732eec2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 14 12:48:08.400811 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:08.400811 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:48:08.400811 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:48:08.400811 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:48:08.400811 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:48:08.400811 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:48:08.400811 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:48:08.400811 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:48:08.400811 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:48:08.400811 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:48:08.400811 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:48:08.400811 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 14 12:48:08.400811 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 14 12:48:08.400811 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 14 12:48:08.400811 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 14 12:48:08.401766 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:48:08.401766 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:48:08.401766 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 14 12:48:08.401766 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 12:48:08.401766 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 14 12:48:08.401766 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 12:48:08.401766 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:48:08.401766 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:48:08.401766 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:48:08.401766 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:48:08.401766 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:48:08.401766 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 14 12:48:08.401766 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:48:08.401766 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:48:08.401766 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:48:08.401766 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:48:08.401766 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:48:08.401766 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:48:08.402791 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:48:08.402791 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:48:08.402791 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 14 12:48:08.402791 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 14 12:48:08.402791 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 14 12:48:08.402791 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 14 12:48:08.402791 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 14 12:48:08.402791 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 14 12:48:08.402791 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 14 12:48:08.402791 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 14 12:48:08.402791 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 184/374] 10.222.0.17 () {56 vars in 1093 bytes} [Fri Oct 14 12:48:08 2022] GET /identity/v3/users/nova => generated 82 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:48:08.402791 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc02be66-3300-416e-811a-09122732eec2 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:08.416987 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 191/375] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Oct 14 12:48:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 12:48:08.418821 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c916865d-b759-4430-ab3b-43a147be5ce4 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:08.494253 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:08.521430 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc02be66-3300-416e-811a-09122732eec2 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:08.553855 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c916865d-b759-4430-ab3b-43a147be5ce4 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:08.560247 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eccf6d-109f-4ca7-8edb-250445afc7f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:08.561068 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eccf6d-109f-4ca7-8edb-250445afc7f8 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:08.561486 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eccf6d-109f-4ca7-8edb-250445afc7f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:08.561925 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eccf6d-109f-4ca7-8edb-250445afc7f8 None admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:08.562853 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6eccf6d-109f-4ca7-8edb-250445afc7f8 None admin] RBAC: Adding query filter params (name=service) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:08.563314 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6eccf6d-109f-4ca7-8edb-250445afc7f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:08.564837 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6eccf6d-109f-4ca7-8edb-250445afc7f8 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:08.574853 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 185/376] 10.222.0.17 () {56 vars in 1103 bytes} [Fri Oct 14 12:48:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:08.580219 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eccf6d-109f-4ca7-8edb-250445afc7f8 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:08.601857 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bd7962-1435-49c2-9cd1-e3d7500ef68d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:08.602542 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bd7962-1435-49c2-9cd1-e3d7500ef68d None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:08.602818 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bd7962-1435-49c2-9cd1-e3d7500ef68d None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:08.603087 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bd7962-1435-49c2-9cd1-e3d7500ef68d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:08.614985 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bd7962-1435-49c2-9cd1-e3d7500ef68d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 12:48:08.619994 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-16bd7962-1435-49c2-9cd1-e3d7500ef68d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 14 12:48:08.619994 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:08.619994 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:48:08.619994 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:48:08.619994 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:48:08.619994 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:48:08.619994 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:48:08.619994 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:48:08.619994 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:48:08.619994 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:48:08.619994 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:48:08.619994 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:48:08.619994 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 12:48:08.619994 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 12:48:08.619994 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 12:48:08.619994 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 12:48:08.620870 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 12:48:08.620870 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 12:48:08.620870 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 12:48:08.620870 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 12:48:08.620870 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:48:08.620870 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:48:08.620870 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:48:08.620870 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:48:08.620870 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:48:08.620870 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:48:08.620870 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:48:08.620870 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 14 12:48:08.620870 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:48:08.620870 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:48:08.620870 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:48:08.620870 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:48:08.626525 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:48:08.626525 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:48:08.626525 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:48:08.626525 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:48:08.626525 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 12:48:08.626525 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 12:48:08.626525 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 12:48:08.626525 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 12:48:08.626525 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 12:48:08.626525 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 12:48:08.626525 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 14 12:48:08.626525 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 14 12:48:08.626525 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 192/377] 10.222.0.17 () {56 vars in 1102 bytes} [Fri Oct 14 12:48:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:48:08.626525 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bd7962-1435-49c2-9cd1-e3d7500ef68d None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:08.669316 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:08.727821 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eccf6d-109f-4ca7-8edb-250445afc7f8 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:08.743918 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bd7962-1435-49c2-9cd1-e3d7500ef68d None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:08.762314 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8134e0db-32db-41ac-8f24-5ff1c7b786f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:08.762801 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8134e0db-32db-41ac-8f24-5ff1c7b786f0 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:08.763078 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8134e0db-32db-41ac-8f24-5ff1c7b786f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:08.763344 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8134e0db-32db-41ac-8f24-5ff1c7b786f0 None admin] PATH_INFO: `/v3/users` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:08.764048 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:08.764169 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8134e0db-32db-41ac-8f24-5ff1c7b786f0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:08.764356 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8134e0db-32db-41ac-8f24-5ff1c7b786f0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:08.765796 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8134e0db-32db-41ac-8f24-5ff1c7b786f0 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:08.783362 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f726c2a-000e-4490-a6e9-922e1ce5debd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:08.784160 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f726c2a-000e-4490-a6e9-922e1ce5debd None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:08.784539 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f726c2a-000e-4490-a6e9-922e1ce5debd None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:08.785387 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f726c2a-000e-4490-a6e9-922e1ce5debd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:08.797812 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f726c2a-000e-4490-a6e9-922e1ce5debd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:08.799342 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f726c2a-000e-4490-a6e9-922e1ce5debd None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:08.809474 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 186/378] 10.222.0.17 () {56 vars in 1133 bytes} [Fri Oct 14 12:48:08 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:08.809474 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8134e0db-32db-41ac-8f24-5ff1c7b786f0 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:08.819528 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-7f726c2a-000e-4490-a6e9-922e1ce5debd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:48:08.819528 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:08.819528 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:48:08.819528 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:48:08.819528 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:48:08.819528 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:48:08.819528 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:48:08.819528 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:48:08.819528 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:48:08.819528 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:48:08.819528 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:48:08.819528 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:48:08.819528 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 12:48:08.819528 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 12:48:08.819528 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 12:48:08.819528 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 12:48:08.820455 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:48:08.820455 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:48:08.820455 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:48:08.820455 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:48:08.820455 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:48:08.820455 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:48:08.820455 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:48:08.820455 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 14 12:48:08.820455 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:48:08.820455 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:48:08.820455 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:48:08.820455 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:48:08.820455 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:48:08.820455 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:48:08.820455 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:48:08.820455 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:48:08.820455 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 12:48:08.821331 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 12:48:08.821331 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:48:08.821331 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 14 12:48:08.821331 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 193/379] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Oct 14 12:48:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:48:08.822499 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f726c2a-000e-4490-a6e9-922e1ce5debd None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:08.920238 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8134e0db-32db-41ac-8f24-5ff1c7b786f0 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:08.943144 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f726c2a-000e-4490-a6e9-922e1ce5debd None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:08.943667 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:08.960002 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23045c85-c051-4510-b906-03ad11b2c2dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:08.960617 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23045c85-c051-4510-b906-03ad11b2c2dc None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:08.960898 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23045c85-c051-4510-b906-03ad11b2c2dc None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:08.961172 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23045c85-c051-4510-b906-03ad11b2c2dc None admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:08.961836 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23045c85-c051-4510-b906-03ad11b2c2dc None admin] RBAC: Adding query filter params (name=service) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:08.962389 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23045c85-c051-4510-b906-03ad11b2c2dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:08.963548 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23045c85-c051-4510-b906-03ad11b2c2dc None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:08.977502 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 187/380] 10.222.0.17 () {56 vars in 1103 bytes} [Fri Oct 14 12:48:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:08.977502 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23045c85-c051-4510-b906-03ad11b2c2dc None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:08.985576 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9a8c47-fe1e-4662-a7e2-836d5a338695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:08.986309 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9a8c47-fe1e-4662-a7e2-836d5a338695 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:08.986592 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9a8c47-fe1e-4662-a7e2-836d5a338695 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:08.986864 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9a8c47-fe1e-4662-a7e2-836d5a338695 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:08.999459 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9a8c47-fe1e-4662-a7e2-836d5a338695 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 12:48:09.005084 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-2f9a8c47-fe1e-4662-a7e2-836d5a338695 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 14 12:48:09.005084 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:09.005084 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:48:09.005084 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:48:09.005084 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:48:09.005084 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:48:09.005084 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:48:09.005084 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:48:09.005084 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:48:09.005084 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:48:09.005084 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:48:09.005084 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:48:09.005084 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 12:48:09.005084 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 12:48:09.005084 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 12:48:09.005084 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 12:48:09.006042 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 12:48:09.006042 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 12:48:09.006042 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 12:48:09.006042 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 12:48:09.006042 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:48:09.006042 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:48:09.006042 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:48:09.006042 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:48:09.006042 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:48:09.006042 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:48:09.006042 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:48:09.006042 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 14 12:48:09.006042 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:48:09.006042 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:48:09.006042 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:48:09.006042 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:48:09.006874 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:48:09.006874 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:48:09.006874 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:48:09.006874 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:48:09.006874 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 12:48:09.006874 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 12:48:09.006874 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 12:48:09.006874 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 12:48:09.006874 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 12:48:09.006874 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 12:48:09.006874 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 14 12:48:09.006874 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 14 12:48:09.006874 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 194/381] 10.222.0.17 () {56 vars in 1102 bytes} [Fri Oct 14 12:48:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:48:09.007550 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9a8c47-fe1e-4662-a7e2-836d5a338695 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:09.044579 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:09.094084 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23045c85-c051-4510-b906-03ad11b2c2dc None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:09.130894 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84faf00-bfda-4127-b57e-b538e2ceeb31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:09.131526 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84faf00-bfda-4127-b57e-b538e2ceeb31 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:09.131805 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84faf00-bfda-4127-b57e-b538e2ceeb31 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:09.132080 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84faf00-bfda-4127-b57e-b538e2ceeb31 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:09.140327 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9a8c47-fe1e-4662-a7e2-836d5a338695 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:09.143268 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84faf00-bfda-4127-b57e-b538e2ceeb31 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:09.145310 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84faf00-bfda-4127-b57e-b538e2ceeb31 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:09.159632 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-d84faf00-bfda-4127-b57e-b538e2ceeb31 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:48:09.159632 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:09.159632 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:48:09.159632 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:48:09.159632 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:48:09.159632 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:48:09.159632 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:48:09.159632 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:48:09.159632 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:48:09.159632 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:48:09.159632 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:48:09.159632 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:48:09.159632 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 12:48:09.159632 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 12:48:09.159632 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 12:48:09.159632 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 12:48:09.160696 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:48:09.160696 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:48:09.160696 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:48:09.160696 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:48:09.160696 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:48:09.160696 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:48:09.160696 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:48:09.160696 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 14 12:48:09.160696 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:48:09.160696 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:48:09.160696 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:48:09.160696 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:48:09.160696 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:48:09.160696 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:48:09.160696 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:48:09.160696 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:48:09.160696 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 12:48:09.161548 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 12:48:09.161548 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:48:09.161548 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 14 12:48:09.161548 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 188/382] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Oct 14 12:48:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:48:09.161548 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84faf00-bfda-4127-b57e-b538e2ceeb31 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:09.177758 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69450b6-1417-43e3-abbf-770007a2ab4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:09.178401 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69450b6-1417-43e3-abbf-770007a2ab4b None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:09.178684 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69450b6-1417-43e3-abbf-770007a2ab4b None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:09.178956 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69450b6-1417-43e3-abbf-770007a2ab4b None admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:09.179591 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69450b6-1417-43e3-abbf-770007a2ab4b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:09.179957 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69450b6-1417-43e3-abbf-770007a2ab4b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:09.181346 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69450b6-1417-43e3-abbf-770007a2ab4b None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:09.194182 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 195/383] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Oct 14 12:48:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:09.194986 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69450b6-1417-43e3-abbf-770007a2ab4b None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:09.198948 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:09.263605 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84faf00-bfda-4127-b57e-b538e2ceeb31 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:09.282816 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:09.294971 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69450b6-1417-43e3-abbf-770007a2ab4b None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:09.297157 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508109e0-43f6-4e6c-8dd9-4cd4c928a1f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:09.297791 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508109e0-43f6-4e6c-8dd9-4cd4c928a1f7 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:09.298074 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508109e0-43f6-4e6c-8dd9-4cd4c928a1f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:09.298384 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508109e0-43f6-4e6c-8dd9-4cd4c928a1f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:09.309007 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508109e0-43f6-4e6c-8dd9-4cd4c928a1f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:09.310508 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508109e0-43f6-4e6c-8dd9-4cd4c928a1f7 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:09.325481 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-508109e0-43f6-4e6c-8dd9-4cd4c928a1f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:48:09.325481 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:09.325481 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:48:09.325481 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:48:09.325481 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:48:09.325481 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:48:09.325481 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:48:09.325481 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:48:09.325481 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:48:09.325481 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:48:09.325481 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:48:09.325481 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:48:09.325481 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 12:48:09.325481 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 12:48:09.325481 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 12:48:09.325481 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 12:48:09.326452 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:48:09.326452 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:48:09.326452 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:48:09.326452 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:48:09.326452 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:48:09.326452 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:48:09.326452 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:48:09.326452 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 14 12:48:09.326452 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:48:09.326452 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:48:09.326452 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:48:09.326452 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:48:09.326452 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:48:09.326452 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:48:09.326452 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:48:09.326452 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:48:09.326452 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 12:48:09.327271 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 12:48:09.327271 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:48:09.327271 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 14 12:48:09.327271 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 189/384] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Oct 14 12:48:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:48:09.327811 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b20b896-a004-4b23-929d-62a2dd7e666a None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:09.328109 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b20b896-a004-4b23-929d-62a2dd7e666a None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:09.328320 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b20b896-a004-4b23-929d-62a2dd7e666a None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:09.329547 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 190/385] 10.222.0.17 () {54 vars in 927 bytes} [Fri Oct 14 12:48:09 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:48:09.330264 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b20b896-a004-4b23-929d-62a2dd7e666a None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:09.336733 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d294463-a83a-4224-b215-a2ce8093a5cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:09.337347 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d294463-a83a-4224-b215-a2ce8093a5cc None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:09.337625 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d294463-a83a-4224-b215-a2ce8093a5cc None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:09.337894 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d294463-a83a-4224-b215-a2ce8093a5cc None admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:09.338593 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d294463-a83a-4224-b215-a2ce8093a5cc None admin] RBAC: Adding query filter params (name=service) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:09.338899 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d294463-a83a-4224-b215-a2ce8093a5cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:09.340281 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d294463-a83a-4224-b215-a2ce8093a5cc None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:09.348803 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 196/386] 10.222.0.17 () {56 vars in 1103 bytes} [Fri Oct 14 12:48:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:09.349608 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d294463-a83a-4224-b215-a2ce8093a5cc None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:09.428783 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:09.445572 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b20b896-a004-4b23-929d-62a2dd7e666a None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:09.453207 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d294463-a83a-4224-b215-a2ce8093a5cc None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:09.479246 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf81b9b-a912-4d65-8c89-457a1a5431b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:09.479850 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf81b9b-a912-4d65-8c89-457a1a5431b9 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:09.480125 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf81b9b-a912-4d65-8c89-457a1a5431b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:09.480394 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf81b9b-a912-4d65-8c89-457a1a5431b9 None admin] PATH_INFO: `/v3/domains` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:09.481027 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf81b9b-a912-4d65-8c89-457a1a5431b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:09.481324 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf81b9b-a912-4d65-8c89-457a1a5431b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:09.482744 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf81b9b-a912-4d65-8c89-457a1a5431b9 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:09.487562 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5baab6-0f80-409e-a670-36bd0a362383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:09.488199 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5baab6-0f80-409e-a670-36bd0a362383 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:09.488475 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5baab6-0f80-409e-a670-36bd0a362383 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:09.488748 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5baab6-0f80-409e-a670-36bd0a362383 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:09.493740 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 191/387] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Oct 14 12:48:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:09.494566 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf81b9b-a912-4d65-8c89-457a1a5431b9 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:09.496282 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5baab6-0f80-409e-a670-36bd0a362383 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:09.497719 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5baab6-0f80-409e-a670-36bd0a362383 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:09.511121 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-8a5baab6-0f80-409e-a670-36bd0a362383 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 14 12:48:09.511121 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:09.511121 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:48:09.511121 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:48:09.511121 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:48:09.511121 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:48:09.511121 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:48:09.511121 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:48:09.511121 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:48:09.511121 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:48:09.511121 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:48:09.511121 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:48:09.511121 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 14 12:48:09.511121 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 14 12:48:09.511121 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 14 12:48:09.511121 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 14 12:48:09.512059 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:48:09.512059 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:48:09.512059 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 14 12:48:09.512059 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 12:48:09.512059 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 14 12:48:09.512059 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 12:48:09.512059 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:48:09.512059 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:48:09.512059 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:48:09.512059 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:48:09.512059 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:48:09.512059 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 14 12:48:09.512059 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:48:09.512059 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:48:09.512059 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:48:09.512059 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:48:09.512059 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:48:09.512059 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:48:09.512937 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:48:09.512937 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:48:09.512937 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 14 12:48:09.512937 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 14 12:48:09.512937 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 14 12:48:09.512937 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 14 12:48:09.512937 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 14 12:48:09.512937 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 14 12:48:09.512937 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 14 12:48:09.512937 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 14 12:48:09.512937 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 197/388] 10.222.0.17 () {56 vars in 1099 bytes} [Fri Oct 14 12:48:09 2022] GET /identity/v3/users/glance => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:48:09.513772 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e8174d-1bc5-4299-b1b3-b1dfe84a7ee3 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:09.514067 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e8174d-1bc5-4299-b1b3-b1dfe84a7ee3 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:09.514335 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e8174d-1bc5-4299-b1b3-b1dfe84a7ee3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:09.535810 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-76e8174d-1bc5-4299-b1b3-b1dfe84a7ee3 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:48:09.537651 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-76e8174d-1bc5-4299-b1b3-b1dfe84a7ee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:48:09.541949 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:09.607226 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf81b9b-a912-4d65-8c89-457a1a5431b9 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:09.610695 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 198/389] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Oct 14 12:48:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 12:48:09.611545 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e8174d-1bc5-4299-b1b3-b1dfe84a7ee3 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:09.650290 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c61353-c6a3-4414-97e9-78ee61784f43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:09.650901 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c61353-c6a3-4414-97e9-78ee61784f43 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:09.651180 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c61353-c6a3-4414-97e9-78ee61784f43 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:09.651448 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c61353-c6a3-4414-97e9-78ee61784f43 None admin] PATH_INFO: `/v3/domains` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:09.652086 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c61353-c6a3-4414-97e9-78ee61784f43 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:09.652388 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c61353-c6a3-4414-97e9-78ee61784f43 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:09.653754 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c61353-c6a3-4414-97e9-78ee61784f43 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:09.669308 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 192/390] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Oct 14 12:48:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:09.670923 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c61353-c6a3-4414-97e9-78ee61784f43 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:09.683417 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:09.727811 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e8174d-1bc5-4299-b1b3-b1dfe84a7ee3 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:09.764167 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffb5970-acfd-46f2-a8be-a33dd8ca0fb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:09.764783 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffb5970-acfd-46f2-a8be-a33dd8ca0fb2 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:09.765061 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffb5970-acfd-46f2-a8be-a33dd8ca0fb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:09.765329 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffb5970-acfd-46f2-a8be-a33dd8ca0fb2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:09.775236 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:09.777278 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffb5970-acfd-46f2-a8be-a33dd8ca0fb2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:09.778983 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffb5970-acfd-46f2-a8be-a33dd8ca0fb2 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:09.779886 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c61353-c6a3-4414-97e9-78ee61784f43 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:09.795922 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-4ffb5970-acfd-46f2-a8be-a33dd8ca0fb2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:48:09.795922 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:09.795922 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:48:09.795922 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:48:09.795922 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:48:09.795922 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:48:09.795922 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:48:09.795922 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:48:09.795922 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:48:09.795922 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:48:09.795922 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:48:09.795922 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:48:09.795922 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 12:48:09.795922 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 12:48:09.795922 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 12:48:09.795922 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 12:48:09.796885 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:48:09.796885 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:48:09.796885 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:48:09.796885 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:48:09.796885 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:48:09.796885 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:48:09.796885 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:48:09.796885 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 14 12:48:09.796885 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:48:09.796885 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:48:09.796885 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:48:09.796885 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:48:09.796885 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:48:09.796885 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:48:09.796885 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:48:09.796885 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:48:09.796885 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 12:48:09.798317 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 12:48:09.798317 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:48:09.798317 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 14 12:48:09.798317 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 199/391] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Oct 14 12:48:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:48:09.798529 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffb5970-acfd-46f2-a8be-a33dd8ca0fb2 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:09.825565 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14787cee-9453-47ad-9fb4-bf8bd61b544a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:09.826222 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14787cee-9453-47ad-9fb4-bf8bd61b544a None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:09.826751 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14787cee-9453-47ad-9fb4-bf8bd61b544a None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:09.827025 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14787cee-9453-47ad-9fb4-bf8bd61b544a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:09.835586 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14787cee-9453-47ad-9fb4-bf8bd61b544a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:09.837047 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14787cee-9453-47ad-9fb4-bf8bd61b544a None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:09.850855 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-14787cee-9453-47ad-9fb4-bf8bd61b544a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 12:48:09.850855 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:09.850855 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:48:09.850855 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:48:09.850855 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:48:09.850855 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:48:09.850855 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:48:09.850855 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:48:09.850855 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:48:09.850855 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:48:09.850855 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:48:09.850855 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:48:09.850855 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 14 12:48:09.850855 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 14 12:48:09.850855 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 14 12:48:09.852546 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 14 12:48:09.852546 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:48:09.852546 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:48:09.852546 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:48:09.852546 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:48:09.852546 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:48:09.852546 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:48:09.852546 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:48:09.852546 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 14 12:48:09.852546 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:48:09.852546 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:48:09.852546 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:48:09.852546 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:48:09.852546 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:48:09.852546 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:48:09.852546 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:48:09.852546 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:48:09.853791 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 14 12:48:09.853791 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 14 12:48:09.853791 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 14 12:48:09.853791 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 14 12:48:09.853791 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 14 12:48:09.853791 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 14 12:48:09.853791 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 12:48:09.853791 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 14 12:48:09.856908 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 193/392] 10.222.0.17 () {56 vars in 1111 bytes} [Fri Oct 14 12:48:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:48:09.857795 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14787cee-9453-47ad-9fb4-bf8bd61b544a None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:09.912512 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffb5970-acfd-46f2-a8be-a33dd8ca0fb2 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:09.925667 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:09.946363 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0859b4-1132-431b-b46b-649f728a1dbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:09.947175 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0859b4-1132-431b-b46b-649f728a1dbf None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:09.947323 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0859b4-1132-431b-b46b-649f728a1dbf None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:09.947498 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0859b4-1132-431b-b46b-649f728a1dbf None admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:09.948190 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0859b4-1132-431b-b46b-649f728a1dbf None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:09.948491 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0859b4-1132-431b-b46b-649f728a1dbf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:09.949925 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0859b4-1132-431b-b46b-649f728a1dbf None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:09.962108 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14787cee-9453-47ad-9fb4-bf8bd61b544a None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:09.988650 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 200/393] 10.222.0.17 () {56 vars in 1137 bytes} [Fri Oct 14 12:48:09 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:09.994050 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0859b4-1132-431b-b46b-649f728a1dbf None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:10.008742 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c7bc95-31cb-4e72-a626-3cb55cf42673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:10.009371 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c7bc95-31cb-4e72-a626-3cb55cf42673 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:10.009644 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c7bc95-31cb-4e72-a626-3cb55cf42673 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:10.009911 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c7bc95-31cb-4e72-a626-3cb55cf42673 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:10.016927 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c7bc95-31cb-4e72-a626-3cb55cf42673 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:10.018391 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c7bc95-31cb-4e72-a626-3cb55cf42673 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:10.031294 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-d7c7bc95-31cb-4e72-a626-3cb55cf42673 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 14 12:48:10.031294 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:10.031294 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:48:10.031294 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:48:10.031294 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:48:10.031294 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:48:10.031294 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:48:10.031294 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:48:10.031294 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:48:10.031294 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:48:10.031294 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:48:10.031294 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:48:10.031294 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 14 12:48:10.031294 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 14 12:48:10.031294 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 14 12:48:10.031294 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 14 12:48:10.032379 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:48:10.032379 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:48:10.032379 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 14 12:48:10.032379 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 12:48:10.032379 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 14 12:48:10.032379 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 12:48:10.032379 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:48:10.032379 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:48:10.032379 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:48:10.032379 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:48:10.032379 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:48:10.032379 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 14 12:48:10.032379 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:48:10.032379 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:48:10.032379 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:48:10.032379 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:48:10.032379 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:48:10.032379 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:48:10.038773 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:48:10.038773 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:48:10.038773 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 14 12:48:10.038773 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 14 12:48:10.038773 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 14 12:48:10.038773 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 14 12:48:10.038773 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 14 12:48:10.038773 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 14 12:48:10.038773 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 14 12:48:10.038773 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 14 12:48:10.038773 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 194/394] 10.222.0.17 () {56 vars in 1102 bytes} [Fri Oct 14 12:48:09 2022] GET /identity/v3/users/neutron => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:48:10.038773 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c7bc95-31cb-4e72-a626-3cb55cf42673 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:10.054092 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:10.110480 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0859b4-1132-431b-b46b-649f728a1dbf None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:10.135762 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c7bc95-31cb-4e72-a626-3cb55cf42673 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:10.145085 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1028d1b5-50c2-4f17-a19a-b7d1828b0979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:10.145697 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1028d1b5-50c2-4f17-a19a-b7d1828b0979 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:10.145976 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1028d1b5-50c2-4f17-a19a-b7d1828b0979 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:10.146283 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1028d1b5-50c2-4f17-a19a-b7d1828b0979 None admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:10.146926 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1028d1b5-50c2-4f17-a19a-b7d1828b0979 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:10.147235 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1028d1b5-50c2-4f17-a19a-b7d1828b0979 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:10.148633 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1028d1b5-50c2-4f17-a19a-b7d1828b0979 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:10.161022 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 201/395] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Oct 14 12:48:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:10.161733 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1028d1b5-50c2-4f17-a19a-b7d1828b0979 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:10.166851 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:10.176566 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61dcc7e-ca2b-4e8a-bd9e-b608dfd399de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:10.177269 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61dcc7e-ca2b-4e8a-bd9e-b608dfd399de None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:10.177611 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61dcc7e-ca2b-4e8a-bd9e-b608dfd399de None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:10.177949 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61dcc7e-ca2b-4e8a-bd9e-b608dfd399de None admin] PATH_INFO: `/v3/projects` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:10.178747 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61dcc7e-ca2b-4e8a-bd9e-b608dfd399de None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:10.179059 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61dcc7e-ca2b-4e8a-bd9e-b608dfd399de None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:10.180516 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61dcc7e-ca2b-4e8a-bd9e-b608dfd399de None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:10.202388 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 195/396] 10.222.0.17 () {56 vars in 1148 bytes} [Fri Oct 14 12:48:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:10.203229 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61dcc7e-ca2b-4e8a-bd9e-b608dfd399de None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:10.262935 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1028d1b5-50c2-4f17-a19a-b7d1828b0979 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:10.275214 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:10.300485 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dddc46f-d145-4a64-ac73-6cbf708376a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:10.301726 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dddc46f-d145-4a64-ac73-6cbf708376a2 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:10.302003 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dddc46f-d145-4a64-ac73-6cbf708376a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:10.302303 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dddc46f-d145-4a64-ac73-6cbf708376a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:10.303995 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61dcc7e-ca2b-4e8a-bd9e-b608dfd399de None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:10.312390 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dddc46f-d145-4a64-ac73-6cbf708376a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:10.313848 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dddc46f-d145-4a64-ac73-6cbf708376a2 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:10.329133 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-3dddc46f-d145-4a64-ac73-6cbf708376a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:48:10.329133 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:10.329133 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:48:10.329133 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:48:10.329133 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:48:10.329133 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:48:10.329133 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:48:10.329133 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:48:10.329133 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:48:10.329133 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:48:10.329133 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:48:10.329133 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:48:10.329133 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 12:48:10.329133 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 12:48:10.329133 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 12:48:10.329133 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 12:48:10.330340 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:48:10.330340 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:48:10.330340 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:48:10.330340 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:48:10.330340 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:48:10.330340 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:48:10.330340 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:48:10.330340 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 14 12:48:10.330340 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:48:10.330340 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:48:10.330340 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:48:10.330340 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:48:10.330340 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:48:10.330340 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:48:10.330340 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:48:10.330340 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:48:10.330340 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 12:48:10.331193 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 12:48:10.331193 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:48:10.331193 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 14 12:48:10.331193 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 202/397] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Oct 14 12:48:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:48:10.331410 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dddc46f-d145-4a64-ac73-6cbf708376a2 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:10.341019 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082d2f6e-1289-4a58-8c67-2bc674575716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:10.341684 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082d2f6e-1289-4a58-8c67-2bc674575716 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:10.341968 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082d2f6e-1289-4a58-8c67-2bc674575716 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:10.342276 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082d2f6e-1289-4a58-8c67-2bc674575716 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:10.352777 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082d2f6e-1289-4a58-8c67-2bc674575716 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:10.354288 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082d2f6e-1289-4a58-8c67-2bc674575716 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:10.370278 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-082d2f6e-1289-4a58-8c67-2bc674575716 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:48:10.370278 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:10.370278 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:48:10.370278 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:48:10.370278 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:48:10.370278 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:48:10.370278 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:48:10.370278 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:48:10.370278 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:48:10.370278 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:48:10.370278 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:48:10.370278 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:48:10.370278 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 12:48:10.370278 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 12:48:10.370278 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 12:48:10.370278 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 12:48:10.371223 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:48:10.371223 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:48:10.371223 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:48:10.371223 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:48:10.371223 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:48:10.371223 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:48:10.371223 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:48:10.371223 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 14 12:48:10.371223 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:48:10.371223 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:48:10.371223 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:48:10.371223 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:48:10.371223 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:48:10.371223 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:48:10.371223 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:48:10.371223 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:48:10.371223 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 12:48:10.372074 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 12:48:10.372074 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:48:10.372074 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 14 12:48:10.372074 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 196/398] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Oct 14 12:48:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:48:10.372074 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082d2f6e-1289-4a58-8c67-2bc674575716 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:10.414032 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:10.439818 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dddc46f-d145-4a64-ac73-6cbf708376a2 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:10.473810 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57862e1e-3620-404d-a556-30e6f99c7d11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:10.474444 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57862e1e-3620-404d-a556-30e6f99c7d11 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:10.474722 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57862e1e-3620-404d-a556-30e6f99c7d11 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:10.474997 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57862e1e-3620-404d-a556-30e6f99c7d11 None admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:10.475587 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082d2f6e-1289-4a58-8c67-2bc674575716 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:10.475722 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57862e1e-3620-404d-a556-30e6f99c7d11 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:10.476037 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57862e1e-3620-404d-a556-30e6f99c7d11 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:10.477479 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57862e1e-3620-404d-a556-30e6f99c7d11 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:10.495380 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 203/399] 10.222.0.17 () {56 vars in 1139 bytes} [Fri Oct 14 12:48:10 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:10.496199 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57862e1e-3620-404d-a556-30e6f99c7d11 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:10.519911 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde16957-4443-41fd-9503-f6e1e5e52a6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:10.520575 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde16957-4443-41fd-9503-f6e1e5e52a6b None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:10.520860 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde16957-4443-41fd-9503-f6e1e5e52a6b None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:10.520996 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:10.521134 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde16957-4443-41fd-9503-f6e1e5e52a6b None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:10.529018 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde16957-4443-41fd-9503-f6e1e5e52a6b None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:10.530527 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde16957-4443-41fd-9503-f6e1e5e52a6b None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:10.543174 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-fde16957-4443-41fd-9503-f6e1e5e52a6b None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 14 12:48:10.543174 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:10.543174 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:48:10.543174 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:48:10.543174 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:48:10.543174 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:48:10.543174 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:48:10.543174 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:48:10.543174 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:48:10.543174 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:48:10.543174 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:48:10.543174 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:48:10.543174 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 14 12:48:10.543174 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 14 12:48:10.543174 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 14 12:48:10.543174 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 14 12:48:10.544196 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:48:10.544196 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:48:10.544196 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 14 12:48:10.544196 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 12:48:10.544196 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 14 12:48:10.544196 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 12:48:10.544196 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:48:10.544196 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:48:10.544196 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:48:10.544196 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:48:10.544196 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:48:10.544196 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 14 12:48:10.544196 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:48:10.544196 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:48:10.544196 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:48:10.544196 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:48:10.544196 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:48:10.544196 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:48:10.545053 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:48:10.545053 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:48:10.545053 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 14 12:48:10.545053 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 14 12:48:10.545053 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 14 12:48:10.545053 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 14 12:48:10.545053 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 14 12:48:10.545053 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 14 12:48:10.545053 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 14 12:48:10.545053 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 14 12:48:10.545053 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 197/400] 10.222.0.17 () {56 vars in 1099 bytes} [Fri Oct 14 12:48:10 2022] GET /identity/v3/users/cinder => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:48:10.545053 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde16957-4443-41fd-9503-f6e1e5e52a6b None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:10.604791 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57862e1e-3620-404d-a556-30e6f99c7d11 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:10.638972 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f500798-3511-4739-a524-f7d2d8e7bdfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:10.639538 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f500798-3511-4739-a524-f7d2d8e7bdfb None admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:10.639812 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f500798-3511-4739-a524-f7d2d8e7bdfb None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:10.640078 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f500798-3511-4739-a524-f7d2d8e7bdfb None admin] PATH_INFO: `/v3/projects/2486e73d493b40e18d9d988744993854/users/931f4e32c8764514b5efed31b0785be7/roles/2d0a16b1c5634daf99f2b7ac092d1ddd` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:10.644867 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:10.648959 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde16957-4443-41fd-9503-f6e1e5e52a6b None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:10.654389 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f500798-3511-4739-a524-f7d2d8e7bdfb None admin] RBAC: Authorizing `identity:create_grant(project_id=2486e73d493b40e18d9d988744993854, user_id=931f4e32c8764514b5efed31b0785be7, role_id=2d0a16b1c5634daf99f2b7ac092d1ddd)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:10.655841 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f500798-3511-4739-a524-f7d2d8e7bdfb None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:10.669320 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 204/401] 10.222.0.17 () {58 vars in 1439 bytes} [Fri Oct 14 12:48:10 2022] PUT /identity/v3/projects/2486e73d493b40e18d9d988744993854/users/931f4e32c8764514b5efed31b0785be7/roles/2d0a16b1c5634daf99f2b7ac092d1ddd => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 12:48:10.670151 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f500798-3511-4739-a524-f7d2d8e7bdfb None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:10.702567 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bd15f5-b516-4430-8ac4-7180f8ea88a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:10.703193 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bd15f5-b516-4430-8ac4-7180f8ea88a0 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:10.703466 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bd15f5-b516-4430-8ac4-7180f8ea88a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:10.703736 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bd15f5-b516-4430-8ac4-7180f8ea88a0 None admin] PATH_INFO: `/v3/domains` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:10.704396 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bd15f5-b516-4430-8ac4-7180f8ea88a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:10.704699 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bd15f5-b516-4430-8ac4-7180f8ea88a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:10.706131 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bd15f5-b516-4430-8ac4-7180f8ea88a0 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:10.719683 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 198/402] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Oct 14 12:48:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:10.720549 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bd15f5-b516-4430-8ac4-7180f8ea88a0 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:10.765698 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:10.805404 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f500798-3511-4739-a524-f7d2d8e7bdfb None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:10.839243 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bd15f5-b516-4430-8ac4-7180f8ea88a0 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:10.843759 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09a6d3b-9611-48d7-bb24-def4ed5fd523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:10.844383 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09a6d3b-9611-48d7-bb24-def4ed5fd523 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:10.845347 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09a6d3b-9611-48d7-bb24-def4ed5fd523 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:10.845347 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09a6d3b-9611-48d7-bb24-def4ed5fd523 None admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:10.845600 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09a6d3b-9611-48d7-bb24-def4ed5fd523 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:10.845869 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09a6d3b-9611-48d7-bb24-def4ed5fd523 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:10.848318 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09a6d3b-9611-48d7-bb24-def4ed5fd523 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:10.864285 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 205/403] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Oct 14 12:48:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:10.865154 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09a6d3b-9611-48d7-bb24-def4ed5fd523 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:10.880536 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e880f8c9-db81-4d07-869b-7e41a457152b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:10.881261 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e880f8c9-db81-4d07-869b-7e41a457152b None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:10.881626 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e880f8c9-db81-4d07-869b-7e41a457152b None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:10.881974 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e880f8c9-db81-4d07-869b-7e41a457152b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:10.892780 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e880f8c9-db81-4d07-869b-7e41a457152b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:10.895240 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e880f8c9-db81-4d07-869b-7e41a457152b None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:10.910667 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-e880f8c9-db81-4d07-869b-7e41a457152b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:48:10.910667 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:10.910667 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:48:10.910667 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:48:10.910667 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:48:10.910667 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:48:10.910667 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:48:10.910667 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:48:10.910667 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:48:10.910667 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:48:10.910667 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:48:10.910667 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:48:10.910667 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 12:48:10.910667 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 12:48:10.910667 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 12:48:10.910667 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 12:48:10.911825 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:48:10.911825 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:48:10.911825 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:48:10.911825 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:48:10.911825 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:48:10.911825 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:48:10.911825 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:48:10.911825 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 14 12:48:10.911825 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:48:10.911825 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:48:10.911825 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:48:10.911825 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:48:10.911825 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:48:10.911825 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:48:10.911825 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:48:10.911825 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:48:10.911825 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 12:48:10.912665 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 12:48:10.912665 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:48:10.912665 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 14 12:48:10.912665 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 199/404] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Oct 14 12:48:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:48:10.912665 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e880f8c9-db81-4d07-869b-7e41a457152b None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:10.930338 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:10.982142 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09a6d3b-9611-48d7-bb24-def4ed5fd523 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:11.019120 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:11.026575 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ba956d-0639-4dee-bf6f-2b99a45643e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:11.027215 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ba956d-0639-4dee-bf6f-2b99a45643e8 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:11.027420 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ba956d-0639-4dee-bf6f-2b99a45643e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:11.027674 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ba956d-0639-4dee-bf6f-2b99a45643e8 None admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:11.028404 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ba956d-0639-4dee-bf6f-2b99a45643e8 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:11.028716 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ba956d-0639-4dee-bf6f-2b99a45643e8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:11.030193 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ba956d-0639-4dee-bf6f-2b99a45643e8 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:11.031337 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e880f8c9-db81-4d07-869b-7e41a457152b None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:11.060995 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 206/405] 10.222.0.17 () {56 vars in 1137 bytes} [Fri Oct 14 12:48:10 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:11.061659 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ba956d-0639-4dee-bf6f-2b99a45643e8 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:11.086284 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5362d53-43ef-4873-81d0-c9e89bbef40f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:11.087008 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5362d53-43ef-4873-81d0-c9e89bbef40f None admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:11.087365 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5362d53-43ef-4873-81d0-c9e89bbef40f None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:11.088249 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5362d53-43ef-4873-81d0-c9e89bbef40f None admin] PATH_INFO: `/v3/users` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:11.089178 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5362d53-43ef-4873-81d0-c9e89bbef40f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:11.090869 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5362d53-43ef-4873-81d0-c9e89bbef40f None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:11.126153 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 200/406] 10.222.0.17 () {60 vars in 1132 bytes} [Fri Oct 14 12:48:10 2022] POST /identity/v3/users => generated 247 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 12:48:11.126153 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5362d53-43ef-4873-81d0-c9e89bbef40f None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:11.188902 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ba956d-0639-4dee-bf6f-2b99a45643e8 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:11.220726 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:11.234475 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa13f11-f39c-464f-a01c-f69ed95cae2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:11.235299 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa13f11-f39c-464f-a01c-f69ed95cae2f None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:11.235652 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa13f11-f39c-464f-a01c-f69ed95cae2f None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:11.235998 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa13f11-f39c-464f-a01c-f69ed95cae2f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:11.244747 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa13f11-f39c-464f-a01c-f69ed95cae2f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:11.246622 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa13f11-f39c-464f-a01c-f69ed95cae2f None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:11.260371 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-7fa13f11-f39c-464f-a01c-f69ed95cae2f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 12:48:11.260371 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:11.260371 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:48:11.260371 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:48:11.260371 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:48:11.260371 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:48:11.260371 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:48:11.260371 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:48:11.260371 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:48:11.260371 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:48:11.260371 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:48:11.260371 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:48:11.260371 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 14 12:48:11.260371 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 14 12:48:11.260371 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 14 12:48:11.261265 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 14 12:48:11.261265 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:48:11.261265 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:48:11.261265 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:48:11.261265 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:48:11.261265 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:48:11.261265 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:48:11.261265 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:48:11.261265 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 14 12:48:11.261265 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:48:11.261265 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:48:11.261265 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:48:11.261265 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:48:11.261265 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:48:11.261265 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:48:11.261265 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:48:11.261265 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:48:11.262079 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 14 12:48:11.262079 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 14 12:48:11.262079 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 14 12:48:11.262079 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 14 12:48:11.262079 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 14 12:48:11.262079 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 14 12:48:11.262079 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 12:48:11.262079 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 14 12:48:11.262079 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 207/407] 10.222.0.17 () {56 vars in 1111 bytes} [Fri Oct 14 12:48:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:48:11.263034 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa13f11-f39c-464f-a01c-f69ed95cae2f None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:11.267652 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5362d53-43ef-4873-81d0-c9e89bbef40f None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:11.313171 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a7c832-79d6-4f0f-bcde-e654069160be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:11.314267 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a7c832-79d6-4f0f-bcde-e654069160be None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:11.314659 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a7c832-79d6-4f0f-bcde-e654069160be None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:11.315275 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a7c832-79d6-4f0f-bcde-e654069160be None admin] PATH_INFO: `/v3/domains` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:11.316498 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a7c832-79d6-4f0f-bcde-e654069160be None admin] RBAC: Adding query filter params (name=Default) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:11.317020 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a7c832-79d6-4f0f-bcde-e654069160be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:11.319991 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a7c832-79d6-4f0f-bcde-e654069160be None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:11.322650 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:11.341548 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 201/408] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Oct 14 12:48:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:11.343102 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a7c832-79d6-4f0f-bcde-e654069160be None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:11.406574 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa13f11-f39c-464f-a01c-f69ed95cae2f None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:11.455046 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7e6196-fe53-4fa9-b1cb-8f942a587bf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:11.455911 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7e6196-fe53-4fa9-b1cb-8f942a587bf1 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:11.456252 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7e6196-fe53-4fa9-b1cb-8f942a587bf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:11.456530 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7e6196-fe53-4fa9-b1cb-8f942a587bf1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:11.469763 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7e6196-fe53-4fa9-b1cb-8f942a587bf1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:11.471286 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7e6196-fe53-4fa9-b1cb-8f942a587bf1 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:11.493138 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a7c832-79d6-4f0f-bcde-e654069160be None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:11.496443 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-7d7e6196-fe53-4fa9-b1cb-8f942a587bf1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:48:11.496443 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:11.496443 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:48:11.496443 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:48:11.496443 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:48:11.496443 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:48:11.496443 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:48:11.496443 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:48:11.496443 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:48:11.496443 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:48:11.496443 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:48:11.496443 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:48:11.496443 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 12:48:11.496443 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 12:48:11.496443 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 12:48:11.496443 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 12:48:11.497420 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:48:11.497420 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:48:11.497420 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:48:11.497420 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:48:11.497420 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:48:11.497420 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:48:11.497420 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:48:11.497420 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 14 12:48:11.497420 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:48:11.497420 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:48:11.497420 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:48:11.497420 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:48:11.497420 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:48:11.497420 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:48:11.497420 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:48:11.497420 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:48:11.497420 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 12:48:11.498359 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 12:48:11.498359 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:48:11.498359 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 14 12:48:11.500514 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 208/409] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Oct 14 12:48:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:48:11.501745 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7e6196-fe53-4fa9-b1cb-8f942a587bf1 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:11.532176 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:11.536089 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b586f8-e212-4b68-801d-27c2245ba745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:11.536749 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b586f8-e212-4b68-801d-27c2245ba745 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:11.537066 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b586f8-e212-4b68-801d-27c2245ba745 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:11.537981 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b586f8-e212-4b68-801d-27c2245ba745 None admin] PATH_INFO: `/v3/projects` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:11.538747 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b586f8-e212-4b68-801d-27c2245ba745 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:11.539069 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b586f8-e212-4b68-801d-27c2245ba745 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:11.541110 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b586f8-e212-4b68-801d-27c2245ba745 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:11.562351 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 202/410] 10.222.0.17 () {56 vars in 1148 bytes} [Fri Oct 14 12:48:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:11.563947 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b586f8-e212-4b68-801d-27c2245ba745 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:11.647705 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:11.653693 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7e6196-fe53-4fa9-b1cb-8f942a587bf1 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:11.692313 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b586f8-e212-4b68-801d-27c2245ba745 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:11.702497 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db04ab5-2f3e-4619-b51d-d5762a2f13d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:11.703139 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db04ab5-2f3e-4619-b51d-d5762a2f13d9 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:11.703444 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db04ab5-2f3e-4619-b51d-d5762a2f13d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:11.704189 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db04ab5-2f3e-4619-b51d-d5762a2f13d9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:11.715543 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db04ab5-2f3e-4619-b51d-d5762a2f13d9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:11.717263 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db04ab5-2f3e-4619-b51d-d5762a2f13d9 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:11.733636 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-4db04ab5-2f3e-4619-b51d-d5762a2f13d9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 12:48:11.733636 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:11.733636 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:48:11.733636 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:48:11.733636 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:48:11.733636 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:48:11.733636 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:48:11.733636 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:48:11.733636 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:48:11.733636 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:48:11.733636 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:48:11.733636 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:48:11.733636 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 14 12:48:11.733636 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 14 12:48:11.733636 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 14 12:48:11.734576 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 14 12:48:11.734576 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:48:11.734576 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:48:11.734576 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:48:11.734576 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:48:11.734576 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:48:11.734576 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:48:11.734576 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:48:11.734576 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 14 12:48:11.734576 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:48:11.734576 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:48:11.734576 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:48:11.734576 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:48:11.734576 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:48:11.734576 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:48:11.734576 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:48:11.734576 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:48:11.735456 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 14 12:48:11.735456 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 14 12:48:11.735456 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 14 12:48:11.735456 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 14 12:48:11.735456 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 14 12:48:11.735456 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 14 12:48:11.735456 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 12:48:11.735456 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 14 12:48:11.736900 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca88d77-b062-488d-88ae-2ccd2bdaa586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:11.738379 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca88d77-b062-488d-88ae-2ccd2bdaa586 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:11.738973 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca88d77-b062-488d-88ae-2ccd2bdaa586 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:11.739482 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca88d77-b062-488d-88ae-2ccd2bdaa586 None admin] PATH_INFO: `/v3/domains` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:11.740068 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 209/411] 10.222.0.17 () {56 vars in 1111 bytes} [Fri Oct 14 12:48:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:48:11.740840 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca88d77-b062-488d-88ae-2ccd2bdaa586 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:11.740943 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db04ab5-2f3e-4619-b51d-d5762a2f13d9 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:11.741593 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca88d77-b062-488d-88ae-2ccd2bdaa586 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:11.743273 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca88d77-b062-488d-88ae-2ccd2bdaa586 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:11.762510 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 203/412] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Oct 14 12:48:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:11.763801 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca88d77-b062-488d-88ae-2ccd2bdaa586 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:11.822933 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:11.891558 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db04ab5-2f3e-4619-b51d-d5762a2f13d9 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:11.901920 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca88d77-b062-488d-88ae-2ccd2bdaa586 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:11.936405 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e19e59-af24-457c-91c2-c0d17984ea5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:11.937166 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e19e59-af24-457c-91c2-c0d17984ea5b None admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:11.937446 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e19e59-af24-457c-91c2-c0d17984ea5b None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:11.937815 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e19e59-af24-457c-91c2-c0d17984ea5b None admin] PATH_INFO: `/v3/projects/2486e73d493b40e18d9d988744993854/users/a0de24488ed54df29d8da344d76651d2/roles/2d0a16b1c5634daf99f2b7ac092d1ddd` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:11.947146 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d348c8d-e599-438c-843f-deffe3631f92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:11.947886 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d348c8d-e599-438c-843f-deffe3631f92 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:11.948170 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d348c8d-e599-438c-843f-deffe3631f92 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:11.948443 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d348c8d-e599-438c-843f-deffe3631f92 None admin] PATH_INFO: `/v3/projects` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:11.949206 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d348c8d-e599-438c-843f-deffe3631f92 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:11.949521 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d348c8d-e599-438c-843f-deffe3631f92 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:11.951398 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d348c8d-e599-438c-843f-deffe3631f92 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:11.955821 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e19e59-af24-457c-91c2-c0d17984ea5b None admin] RBAC: Authorizing `identity:create_grant(project_id=2486e73d493b40e18d9d988744993854, user_id=a0de24488ed54df29d8da344d76651d2, role_id=2d0a16b1c5634daf99f2b7ac092d1ddd)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:11.957843 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e19e59-af24-457c-91c2-c0d17984ea5b None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:11.966604 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 204/413] 10.222.0.17 () {56 vars in 1148 bytes} [Fri Oct 14 12:48:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:11.967321 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d348c8d-e599-438c-843f-deffe3631f92 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:11.984661 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 210/414] 10.222.0.17 () {58 vars in 1439 bytes} [Fri Oct 14 12:48:11 2022] PUT /identity/v3/projects/2486e73d493b40e18d9d988744993854/users/a0de24488ed54df29d8da344d76651d2/roles/2d0a16b1c5634daf99f2b7ac092d1ddd => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 12:48:11.985599 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e19e59-af24-457c-91c2-c0d17984ea5b None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:12.001503 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:12.189045 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e19e59-af24-457c-91c2-c0d17984ea5b None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:12.218159 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d348c8d-e599-438c-843f-deffe3631f92 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:12.230669 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:12.252731 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0496fd08-d97a-44de-9cd7-1c5b87d80b81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:12.253926 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0496fd08-d97a-44de-9cd7-1c5b87d80b81 None admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:12.254427 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0496fd08-d97a-44de-9cd7-1c5b87d80b81 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:12.254843 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0496fd08-d97a-44de-9cd7-1c5b87d80b81 None admin] PATH_INFO: `/v3/projects/2486e73d493b40e18d9d988744993854/users/b2d483292f3a4794848fcacfba5b107e/roles/2d0a16b1c5634daf99f2b7ac092d1ddd` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:12.263890 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b02ea66-c5da-40c1-bc1a-d817718c8256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:12.264535 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b02ea66-c5da-40c1-bc1a-d817718c8256 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:12.264815 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b02ea66-c5da-40c1-bc1a-d817718c8256 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:12.265085 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b02ea66-c5da-40c1-bc1a-d817718c8256 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:12.274884 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b02ea66-c5da-40c1-bc1a-d817718c8256 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:12.276191 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0496fd08-d97a-44de-9cd7-1c5b87d80b81 None admin] RBAC: Authorizing `identity:create_grant(project_id=2486e73d493b40e18d9d988744993854, user_id=b2d483292f3a4794848fcacfba5b107e, role_id=2d0a16b1c5634daf99f2b7ac092d1ddd)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:12.276417 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b02ea66-c5da-40c1-bc1a-d817718c8256 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:12.277791 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0496fd08-d97a-44de-9cd7-1c5b87d80b81 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:12.290290 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-4b02ea66-c5da-40c1-bc1a-d817718c8256 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 12:48:12.290290 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:12.290290 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:48:12.290290 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:48:12.290290 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:48:12.290290 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:48:12.290290 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:48:12.290290 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:48:12.290290 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:48:12.290290 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:48:12.290290 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:48:12.290290 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:48:12.290290 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 14 12:48:12.290290 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 14 12:48:12.290290 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 14 12:48:12.291230 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 14 12:48:12.291230 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:48:12.291230 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:48:12.291230 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:48:12.291230 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:48:12.291230 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:48:12.291230 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:48:12.291230 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:48:12.291230 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 14 12:48:12.291230 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:48:12.291230 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:48:12.291230 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:48:12.291230 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:48:12.291230 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:48:12.291230 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:48:12.291230 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:48:12.291230 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:48:12.292318 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 14 12:48:12.292318 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 14 12:48:12.292318 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 14 12:48:12.292318 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 14 12:48:12.292318 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 14 12:48:12.292318 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 14 12:48:12.292318 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 12:48:12.292318 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 14 12:48:12.292318 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 205/415] 10.222.0.17 () {56 vars in 1111 bytes} [Fri Oct 14 12:48:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:48:12.297489 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b02ea66-c5da-40c1-bc1a-d817718c8256 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:12.301785 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 211/416] 10.222.0.17 () {58 vars in 1439 bytes} [Fri Oct 14 12:48:11 2022] PUT /identity/v3/projects/2486e73d493b40e18d9d988744993854/users/b2d483292f3a4794848fcacfba5b107e/roles/2d0a16b1c5634daf99f2b7ac092d1ddd => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 12:48:12.448012 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b02ea66-c5da-40c1-bc1a-d817718c8256 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:12.504507 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adb891b-c647-46ba-896f-644bc3d3a8b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:12.505072 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adb891b-c647-46ba-896f-644bc3d3a8b0 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:12.505352 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adb891b-c647-46ba-896f-644bc3d3a8b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:12.505627 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adb891b-c647-46ba-896f-644bc3d3a8b0 None admin] PATH_INFO: `/v3/projects` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:12.506397 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adb891b-c647-46ba-896f-644bc3d3a8b0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:12.506707 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adb891b-c647-46ba-896f-644bc3d3a8b0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:12.508386 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adb891b-c647-46ba-896f-644bc3d3a8b0 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:12.525208 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 206/417] 10.222.0.17 () {56 vars in 1148 bytes} [Fri Oct 14 12:48:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:12.530983 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0496fd08-d97a-44de-9cd7-1c5b87d80b81 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:12.604870 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:12.652785 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0496fd08-d97a-44de-9cd7-1c5b87d80b81 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:12.708998 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94f6634-7ad2-4f05-a875-f2850aee2aae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:12.709676 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94f6634-7ad2-4f05-a875-f2850aee2aae None admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:12.710072 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94f6634-7ad2-4f05-a875-f2850aee2aae None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:12.710355 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94f6634-7ad2-4f05-a875-f2850aee2aae None admin] PATH_INFO: `/v3/projects/2486e73d493b40e18d9d988744993854/users/76c3c564b8c548e4beef1cbfba2ad343/roles/2d0a16b1c5634daf99f2b7ac092d1ddd` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:12.740686 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94f6634-7ad2-4f05-a875-f2850aee2aae None admin] RBAC: Authorizing `identity:create_grant(project_id=2486e73d493b40e18d9d988744993854, user_id=76c3c564b8c548e4beef1cbfba2ad343, role_id=2d0a16b1c5634daf99f2b7ac092d1ddd)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:12.742234 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94f6634-7ad2-4f05-a875-f2850aee2aae None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:12.764055 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 212/418] 10.222.0.17 () {58 vars in 1439 bytes} [Fri Oct 14 12:48:12 2022] PUT /identity/v3/projects/2486e73d493b40e18d9d988744993854/users/76c3c564b8c548e4beef1cbfba2ad343/roles/2d0a16b1c5634daf99f2b7ac092d1ddd => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 12:48:13.245139 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b126f61-a043-4dbb-b0a1-f633b9c3a73e None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:13.245856 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b126f61-a043-4dbb-b0a1-f633b9c3a73e None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:13.245856 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b126f61-a043-4dbb-b0a1-f633b9c3a73e None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:13.247352 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 207/419] 10.222.0.17 () {54 vars in 927 bytes} [Fri Oct 14 12:48:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 14 12:48:13.253032 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b3f5c3-7232-407b-90de-3dd65a6c7985 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:13.253586 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b3f5c3-7232-407b-90de-3dd65a6c7985 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:13.253586 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b3f5c3-7232-407b-90de-3dd65a6c7985 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:13.273059 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-13b3f5c3-7232-407b-90de-3dd65a6c7985 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:48:13.274364 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-13b3f5c3-7232-407b-90de-3dd65a6c7985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:48:13.382363 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 213/420] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Oct 14 12:48:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 14 12:48:13.666670 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b126f61-a043-4dbb-b0a1-f633b9c3a73e None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:13.701580 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:13.714441 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be91aba-3698-404f-a2c8-559f78acf77a None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:13.714746 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be91aba-3698-404f-a2c8-559f78acf77a None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:13.714976 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be91aba-3698-404f-a2c8-559f78acf77a None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:13.716335 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 214/421] 10.222.0.17 () {54 vars in 927 bytes} [Fri Oct 14 12:48:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 14 12:48:13.721572 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8fa7eb-5635-48b6-8e33-99ac959d7797 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:13.723582 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8fa7eb-5635-48b6-8e33-99ac959d7797 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:13.723582 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8fa7eb-5635-48b6-8e33-99ac959d7797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:13.751028 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-9a8fa7eb-5635-48b6-8e33-99ac959d7797 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:48:13.752213 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-9a8fa7eb-5635-48b6-8e33-99ac959d7797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:48:13.826781 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:13.884603 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b126f61-a043-4dbb-b0a1-f633b9c3a73e None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:13.892477 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 215/422] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Oct 14 12:48:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 14 12:48:13.930717 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e48915-bbc3-4474-8f88-a90a4aaa4ae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:13.931279 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e48915-bbc3-4474-8f88-a90a4aaa4ae0 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:13.931612 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e48915-bbc3-4474-8f88-a90a4aaa4ae0 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:13.931885 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e48915-bbc3-4474-8f88-a90a4aaa4ae0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:13.945008 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e48915-bbc3-4474-8f88-a90a4aaa4ae0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 12:48:13.950440 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-c0e48915-bbc3-4474-8f88-a90a4aaa4ae0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 14 12:48:13.950440 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:13.950440 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:48:13.950440 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:48:13.950440 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:48:13.950440 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:48:13.950440 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:48:13.950440 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:48:13.950440 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:48:13.950440 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:48:13.950440 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:48:13.950440 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:48:13.950440 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 12:48:13.950440 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 12:48:13.950440 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 12:48:13.950440 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 12:48:13.952493 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 12:48:13.952493 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 12:48:13.952493 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 12:48:13.952493 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 12:48:13.952493 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:48:13.952493 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:48:13.952493 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:48:13.952493 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:48:13.952493 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:48:13.952493 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:48:13.952493 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:48:13.952493 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 14 12:48:13.952493 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:48:13.952493 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:48:13.952493 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:48:13.952493 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:48:13.954381 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:48:13.954381 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:48:13.954381 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:48:13.954381 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:48:13.954381 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 12:48:13.954381 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 12:48:13.954381 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 12:48:13.954381 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 12:48:13.954381 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 12:48:13.954381 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 12:48:13.954381 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 14 12:48:13.954381 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 14 12:48:13.954381 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 208/423] 10.222.0.17 () {56 vars in 1102 bytes} [Fri Oct 14 12:48:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:48:13.959317 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8fa7eb-5635-48b6-8e33-99ac959d7797 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:14.098050 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8fa7eb-5635-48b6-8e33-99ac959d7797 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:14.154083 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1628e7-e59c-4540-8ef6-66dc5426f195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:14.154708 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1628e7-e59c-4540-8ef6-66dc5426f195 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:14.154984 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1628e7-e59c-4540-8ef6-66dc5426f195 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:14.155252 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1628e7-e59c-4540-8ef6-66dc5426f195 None admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:14.155915 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1628e7-e59c-4540-8ef6-66dc5426f195 None admin] RBAC: Adding query filter params (name=service) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:14.156212 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1628e7-e59c-4540-8ef6-66dc5426f195 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:14.157673 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1628e7-e59c-4540-8ef6-66dc5426f195 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:14.170760 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 216/424] 10.222.0.17 () {56 vars in 1103 bytes} [Fri Oct 14 12:48:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:14.179284 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e48915-bbc3-4474-8f88-a90a4aaa4ae0 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:14.243527 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1628e7-e59c-4540-8ef6-66dc5426f195 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:14.303456 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:14.318945 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:14.323555 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e48915-bbc3-4474-8f88-a90a4aaa4ae0 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:14.365825 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79c9cdf-9178-4e98-b030-e60d85adb27e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:14.367576 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79c9cdf-9178-4e98-b030-e60d85adb27e None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:14.368171 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79c9cdf-9178-4e98-b030-e60d85adb27e None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:14.368602 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79c9cdf-9178-4e98-b030-e60d85adb27e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:14.384735 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79c9cdf-9178-4e98-b030-e60d85adb27e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:14.386449 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79c9cdf-9178-4e98-b030-e60d85adb27e None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:14.402693 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-b79c9cdf-9178-4e98-b030-e60d85adb27e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:48:14.402693 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:14.402693 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:48:14.402693 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:48:14.402693 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:48:14.402693 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:48:14.402693 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:48:14.402693 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:48:14.402693 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:48:14.402693 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:48:14.402693 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:48:14.402693 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:48:14.402693 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 12:48:14.402693 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 12:48:14.402693 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 12:48:14.402693 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 12:48:14.403826 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:48:14.403826 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:48:14.403826 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:48:14.403826 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:48:14.403826 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:48:14.403826 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:48:14.403826 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:48:14.403826 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 14 12:48:14.403826 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:48:14.403826 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:48:14.403826 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:48:14.403826 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:48:14.403826 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:48:14.403826 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:48:14.403826 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:48:14.403826 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:48:14.403826 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 12:48:14.404872 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 12:48:14.404872 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:48:14.404872 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 14 12:48:14.406721 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 209/425] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Oct 14 12:48:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:48:14.418777 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79c9cdf-9178-4e98-b030-e60d85adb27e None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:14.437375 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1628e7-e59c-4540-8ef6-66dc5426f195 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:14.484027 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df8d12e-08e8-4f7c-9a34-ca42c2bb6933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:14.484665 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df8d12e-08e8-4f7c-9a34-ca42c2bb6933 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:14.484942 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df8d12e-08e8-4f7c-9a34-ca42c2bb6933 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:14.485223 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df8d12e-08e8-4f7c-9a34-ca42c2bb6933 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:14.505096 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df8d12e-08e8-4f7c-9a34-ca42c2bb6933 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 12:48:14.516758 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-9df8d12e-08e8-4f7c-9a34-ca42c2bb6933 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 14 12:48:14.516758 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:14.516758 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:48:14.516758 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:48:14.516758 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:48:14.516758 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:48:14.516758 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:48:14.516758 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:48:14.516758 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:48:14.516758 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:48:14.516758 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:48:14.516758 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:48:14.516758 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 12:48:14.516758 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 12:48:14.516758 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 12:48:14.516758 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 12:48:14.517698 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 12:48:14.517698 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 12:48:14.517698 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 12:48:14.517698 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 12:48:14.517698 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:48:14.517698 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:48:14.517698 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:48:14.517698 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:48:14.517698 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:48:14.517698 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:48:14.517698 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:48:14.517698 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 14 12:48:14.517698 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:48:14.517698 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:48:14.517698 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:48:14.517698 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:48:14.519123 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:48:14.519123 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:48:14.519123 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:48:14.519123 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:48:14.519123 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 12:48:14.519123 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 12:48:14.519123 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 12:48:14.519123 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 12:48:14.519123 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 12:48:14.519123 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 12:48:14.519123 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 14 12:48:14.519123 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 14 12:48:14.520022 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 217/426] 10.222.0.17 () {56 vars in 1102 bytes} [Fri Oct 14 12:48:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:48:14.524673 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df8d12e-08e8-4f7c-9a34-ca42c2bb6933 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:14.568394 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79c9cdf-9178-4e98-b030-e60d85adb27e None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:14.609495 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e53cf51-75a9-4c81-8990-344bdd73fc8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:14.610518 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e53cf51-75a9-4c81-8990-344bdd73fc8d None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:14.611126 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e53cf51-75a9-4c81-8990-344bdd73fc8d None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:14.611602 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e53cf51-75a9-4c81-8990-344bdd73fc8d None admin] PATH_INFO: `/v3/domains` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:14.612528 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e53cf51-75a9-4c81-8990-344bdd73fc8d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:14.613038 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e53cf51-75a9-4c81-8990-344bdd73fc8d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:14.614811 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e53cf51-75a9-4c81-8990-344bdd73fc8d None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:14.623320 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:14.632125 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 210/427] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Oct 14 12:48:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 12:48:14.638395 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e53cf51-75a9-4c81-8990-344bdd73fc8d None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:14.739715 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:14.759341 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df8d12e-08e8-4f7c-9a34-ca42c2bb6933 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:14.828973 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab7e8dd-6f6b-4839-b181-3ae46937118d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:14.829948 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab7e8dd-6f6b-4839-b181-3ae46937118d None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:14.830456 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab7e8dd-6f6b-4839-b181-3ae46937118d None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:14.831687 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab7e8dd-6f6b-4839-b181-3ae46937118d None admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:14.832797 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab7e8dd-6f6b-4839-b181-3ae46937118d None admin] RBAC: Adding query filter params (name=service) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:14.833600 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab7e8dd-6f6b-4839-b181-3ae46937118d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:14.835962 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab7e8dd-6f6b-4839-b181-3ae46937118d None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:14.850038 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 218/428] 10.222.0.17 () {56 vars in 1103 bytes} [Fri Oct 14 12:48:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 12:48:14.855912 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab7e8dd-6f6b-4839-b181-3ae46937118d None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:14.860727 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e53cf51-75a9-4c81-8990-344bdd73fc8d None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:14.941761 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fa694f-7af0-4f86-8689-036a8a0d7193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:14.944111 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fa694f-7af0-4f86-8689-036a8a0d7193 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:14.944673 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fa694f-7af0-4f86-8689-036a8a0d7193 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:14.945230 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fa694f-7af0-4f86-8689-036a8a0d7193 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:14.956932 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fa694f-7af0-4f86-8689-036a8a0d7193 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:14.959698 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fa694f-7af0-4f86-8689-036a8a0d7193 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:14.978476 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-37fa694f-7af0-4f86-8689-036a8a0d7193 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 14 12:48:14.978476 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:14.978476 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:48:14.978476 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:48:14.978476 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:48:14.978476 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:48:14.978476 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:48:14.978476 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:48:14.978476 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:48:14.978476 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:48:14.978476 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:48:14.978476 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:48:14.978476 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 14 12:48:14.978476 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 14 12:48:14.978476 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 14 12:48:14.978476 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 14 12:48:14.979571 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:48:14.979571 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:48:14.979571 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 14 12:48:14.979571 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 12:48:14.979571 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 14 12:48:14.979571 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 12:48:14.979571 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:48:14.979571 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:48:14.979571 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:48:14.979571 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:48:14.979571 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:48:14.979571 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 14 12:48:14.979571 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:48:14.979571 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:48:14.979571 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:48:14.979571 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:48:14.979571 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:48:14.979571 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:48:14.980571 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:48:14.980571 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:48:14.980571 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 14 12:48:14.980571 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 14 12:48:14.980571 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 14 12:48:14.980571 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 14 12:48:14.980571 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 14 12:48:14.980571 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 14 12:48:14.980571 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 14 12:48:14.980571 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 14 12:48:14.984640 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 211/429] 10.222.0.17 () {56 vars in 1093 bytes} [Fri Oct 14 12:48:14 2022] GET /identity/v3/users/nova => generated 82 bytes in 347 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:48:14.991316 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fa694f-7af0-4f86-8689-036a8a0d7193 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:15.103646 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:15.113073 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab7e8dd-6f6b-4839-b181-3ae46937118d None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:15.157570 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fa694f-7af0-4f86-8689-036a8a0d7193 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:15.192584 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87ea42f-2bfd-46c3-9493-b8a82d6d74b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:15.193240 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87ea42f-2bfd-46c3-9493-b8a82d6d74b9 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:15.193516 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87ea42f-2bfd-46c3-9493-b8a82d6d74b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:15.193787 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87ea42f-2bfd-46c3-9493-b8a82d6d74b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:15.200086 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de993bc9-833b-45e5-b3fd-1f10893568f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:15.200709 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de993bc9-833b-45e5-b3fd-1f10893568f7 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:15.200988 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de993bc9-833b-45e5-b3fd-1f10893568f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:15.201263 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de993bc9-833b-45e5-b3fd-1f10893568f7 None admin] PATH_INFO: `/v3/users` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:15.202012 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de993bc9-833b-45e5-b3fd-1f10893568f7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:15.202356 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de993bc9-833b-45e5-b3fd-1f10893568f7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:15.203857 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de993bc9-833b-45e5-b3fd-1f10893568f7 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:15.206349 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87ea42f-2bfd-46c3-9493-b8a82d6d74b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:15.207866 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87ea42f-2bfd-46c3-9493-b8a82d6d74b9 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:15.224597 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-a87ea42f-2bfd-46c3-9493-b8a82d6d74b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:48:15.224597 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:15.224597 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:48:15.224597 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:48:15.224597 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:48:15.224597 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:48:15.224597 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:48:15.224597 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:48:15.224597 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:48:15.224597 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:48:15.224597 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:48:15.224597 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:48:15.224597 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 12:48:15.224597 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 12:48:15.224597 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 12:48:15.224597 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 12:48:15.225546 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:48:15.225546 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:48:15.225546 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:48:15.225546 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:48:15.225546 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:48:15.225546 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:48:15.225546 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:48:15.225546 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 14 12:48:15.225546 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:48:15.225546 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:48:15.225546 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:48:15.225546 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:48:15.225546 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:48:15.225546 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:48:15.225546 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:48:15.225546 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:48:15.225546 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 12:48:15.226418 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 12:48:15.226418 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:48:15.226418 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 14 12:48:15.230495 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 219/430] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Oct 14 12:48:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 370 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:48:15.231899 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a985c42-0233-4963-be10-4a064d182b76 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:15.232182 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a985c42-0233-4963-be10-4a064d182b76 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:15.232456 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a985c42-0233-4963-be10-4a064d182b76 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:15.234407 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 220/431] 10.222.0.17 () {54 vars in 927 bytes} [Fri Oct 14 12:48:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:48:15.239088 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a985c42-0233-4963-be10-4a064d182b76 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:15.239354 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 212/432] 10.222.0.17 () {56 vars in 1133 bytes} [Fri Oct 14 12:48:14 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:15.249220 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de993bc9-833b-45e5-b3fd-1f10893568f7 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:15.250097 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:15.362842 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a985c42-0233-4963-be10-4a064d182b76 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:15.389719 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de993bc9-833b-45e5-b3fd-1f10893568f7 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:15.402680 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fbdd18-11b0-49af-abd1-1230b2db32f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:15.403284 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fbdd18-11b0-49af-abd1-1230b2db32f6 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:15.403583 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fbdd18-11b0-49af-abd1-1230b2db32f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:15.403837 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fbdd18-11b0-49af-abd1-1230b2db32f6 None admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:15.404477 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fbdd18-11b0-49af-abd1-1230b2db32f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:15.404856 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fbdd18-11b0-49af-abd1-1230b2db32f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:15.406376 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fbdd18-11b0-49af-abd1-1230b2db32f6 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:15.408500 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:15.419588 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 221/433] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Oct 14 12:48:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:15.423681 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a1b0b9-b510-40b3-8253-244e694d7e10 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:15.424350 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a1b0b9-b510-40b3-8253-244e694d7e10 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:15.424633 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a1b0b9-b510-40b3-8253-244e694d7e10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:15.430564 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab8df50-e32c-49c4-bd64-6008b52de826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:15.431667 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab8df50-e32c-49c4-bd64-6008b52de826 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:15.432147 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab8df50-e32c-49c4-bd64-6008b52de826 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:15.433474 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab8df50-e32c-49c4-bd64-6008b52de826 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:15.444710 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-f3a1b0b9-b510-40b3-8253-244e694d7e10 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:48:15.446311 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-f3a1b0b9-b510-40b3-8253-244e694d7e10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:48:15.510386 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab8df50-e32c-49c4-bd64-6008b52de826 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:15.512094 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab8df50-e32c-49c4-bd64-6008b52de826 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:15.520010 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:15.534172 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 222/434] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Oct 14 12:48:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 12:48:15.534172 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1a316d-a19a-4b27-8472-b81693441469 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:15.534172 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1a316d-a19a-4b27-8472-b81693441469 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:15.534172 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1a316d-a19a-4b27-8472-b81693441469 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:15.534172 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 223/435] 10.222.0.17 () {54 vars in 927 bytes} [Fri Oct 14 12:48:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:48:15.534172 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1a316d-a19a-4b27-8472-b81693441469 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:15.657983 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 213/436] 10.222.0.17 () {58 vars in 1282 bytes} [Fri Oct 14 12:48:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 14 12:48:15.660502 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c693701-0f45-4e04-99ba-95f7b8e54799 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:15.660789 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c693701-0f45-4e04-99ba-95f7b8e54799 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:15.661064 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c693701-0f45-4e04-99ba-95f7b8e54799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:15.684190 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-2c693701-0f45-4e04-99ba-95f7b8e54799 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:48:15.685971 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-2c693701-0f45-4e04-99ba-95f7b8e54799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:48:15.699532 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1a316d-a19a-4b27-8472-b81693441469 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:15.702898 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:15.742740 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ef4ba0-e992-4360-936e-95a6b96f4fb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:15.744548 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ef4ba0-e992-4360-936e-95a6b96f4fb9 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:15.744830 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ef4ba0-e992-4360-936e-95a6b96f4fb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:15.745540 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ef4ba0-e992-4360-936e-95a6b96f4fb9 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:15.754858 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ef4ba0-e992-4360-936e-95a6b96f4fb9 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:15.756322 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ef4ba0-e992-4360-936e-95a6b96f4fb9 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:15.768398 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-e4ef4ba0-e992-4360-936e-95a6b96f4fb9 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 14 12:48:15.768398 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:15.768398 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:48:15.768398 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:48:15.768398 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:48:15.768398 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:48:15.768398 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:48:15.768398 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:48:15.768398 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:48:15.768398 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:48:15.768398 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:48:15.768398 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:48:15.768398 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 14 12:48:15.768398 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 14 12:48:15.768398 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 14 12:48:15.768398 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 14 12:48:15.769890 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:48:15.769890 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:48:15.769890 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 14 12:48:15.769890 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 12:48:15.769890 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 14 12:48:15.769890 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 12:48:15.769890 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:48:15.769890 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:48:15.769890 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:48:15.769890 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:48:15.769890 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:48:15.769890 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 14 12:48:15.769890 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:48:15.769890 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:48:15.769890 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:48:15.769890 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:48:15.769890 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:48:15.769890 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:48:15.770857 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:48:15.770857 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:48:15.770857 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 14 12:48:15.770857 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 14 12:48:15.770857 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 14 12:48:15.770857 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 14 12:48:15.770857 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 14 12:48:15.770857 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 14 12:48:15.770857 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 14 12:48:15.770857 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 14 12:48:15.770857 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 224/437] 10.222.0.17 () {56 vars in 1096 bytes} [Fri Oct 14 12:48:15 2022] GET /identity/v3/users/swift => generated 83 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:48:15.771496 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ef4ba0-e992-4360-936e-95a6b96f4fb9 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:15.779115 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 214/438] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Oct 14 12:48:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 12:48:15.781200 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77511fcc-213a-41a2-b324-64237af24bd1 None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:15.781688 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77511fcc-213a-41a2-b324-64237af24bd1 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:15.782215 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77511fcc-213a-41a2-b324-64237af24bd1 None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:15.784901 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 215/439] 10.222.0.17 () {54 vars in 927 bytes} [Fri Oct 14 12:48:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:48:15.786240 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77511fcc-213a-41a2-b324-64237af24bd1 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:15.835304 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:15.893236 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ef4ba0-e992-4360-936e-95a6b96f4fb9 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:15.915150 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77511fcc-213a-41a2-b324-64237af24bd1 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:15.936869 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53434492-754e-49f6-879a-4c620d02c37b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:15.937694 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53434492-754e-49f6-879a-4c620d02c37b None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:15.937979 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53434492-754e-49f6-879a-4c620d02c37b None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:15.938772 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53434492-754e-49f6-879a-4c620d02c37b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:15.952017 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53434492-754e-49f6-879a-4c620d02c37b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:15.953307 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53434492-754e-49f6-879a-4c620d02c37b None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:15.959733 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460e95e0-c935-4552-b941-8ea6fee62e4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:15.960641 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460e95e0-c935-4552-b941-8ea6fee62e4d None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:15.961144 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460e95e0-c935-4552-b941-8ea6fee62e4d None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:15.961618 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460e95e0-c935-4552-b941-8ea6fee62e4d None admin] PATH_INFO: `/v3/users` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:15.962848 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460e95e0-c935-4552-b941-8ea6fee62e4d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:15.963163 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460e95e0-c935-4552-b941-8ea6fee62e4d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:15.964612 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460e95e0-c935-4552-b941-8ea6fee62e4d None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:15.969496 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-53434492-754e-49f6-879a-4c620d02c37b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:48:15.969496 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:15.969496 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:48:15.969496 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:48:15.969496 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:48:15.969496 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:48:15.969496 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:48:15.969496 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:48:15.969496 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:48:15.969496 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:48:15.969496 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:48:15.969496 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:48:15.969496 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 12:48:15.969496 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 12:48:15.969496 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 12:48:15.969496 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 12:48:15.970431 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:48:15.970431 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:48:15.970431 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:48:15.970431 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:48:15.970431 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:48:15.970431 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:48:15.970431 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:48:15.970431 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 14 12:48:15.970431 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:48:15.970431 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:48:15.970431 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:48:15.970431 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:48:15.970431 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:48:15.970431 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:48:15.970431 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:48:15.970431 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:48:15.970431 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 12:48:15.971444 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 12:48:15.971444 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:48:15.971444 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 14 12:48:15.973238 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 225/440] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Oct 14 12:48:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:48:15.974501 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ab2df1-6bf9-4109-b664-8dfef940478f None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:15.974783 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ab2df1-6bf9-4109-b664-8dfef940478f None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:15.975054 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ab2df1-6bf9-4109-b664-8dfef940478f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:15.992255 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 216/441] 10.222.0.17 () {56 vars in 1135 bytes} [Fri Oct 14 12:48:15 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:15.993495 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460e95e0-c935-4552-b941-8ea6fee62e4d None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:15.994378 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-86ab2df1-6bf9-4109-b664-8dfef940478f None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:48:15.995638 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-86ab2df1-6bf9-4109-b664-8dfef940478f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:48:15.999888 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:16.076847 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 226/442] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Oct 14 12:48:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 12:48:16.077761 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ab2df1-6bf9-4109-b664-8dfef940478f None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:16.133264 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460e95e0-c935-4552-b941-8ea6fee62e4d None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:16.147430 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:16.173997 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6414fecf-cba4-4856-a561-45e98ee09688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:16.174570 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6414fecf-cba4-4856-a561-45e98ee09688 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:16.175432 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6414fecf-cba4-4856-a561-45e98ee09688 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:16.175713 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6414fecf-cba4-4856-a561-45e98ee09688 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:16.188429 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6414fecf-cba4-4856-a561-45e98ee09688 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 12:48:16.195788 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-6414fecf-cba4-4856-a561-45e98ee09688 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 14 12:48:16.195788 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:16.195788 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:48:16.195788 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:48:16.195788 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:48:16.195788 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:48:16.195788 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:48:16.195788 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:48:16.195788 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:48:16.195788 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:48:16.195788 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:48:16.195788 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:48:16.195788 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 12:48:16.195788 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 12:48:16.195788 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 12:48:16.195788 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 12:48:16.196753 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 12:48:16.196753 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 12:48:16.196753 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 12:48:16.196753 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 12:48:16.196753 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:48:16.196753 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:48:16.196753 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:48:16.196753 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:48:16.196753 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:48:16.196753 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:48:16.196753 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:48:16.196753 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 14 12:48:16.196753 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:48:16.196753 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:48:16.196753 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:48:16.196753 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:48:16.198271 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:48:16.198271 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:48:16.198271 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:48:16.198271 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:48:16.198271 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 12:48:16.198271 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 12:48:16.198271 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 12:48:16.198271 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 12:48:16.198271 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 12:48:16.198271 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 12:48:16.198271 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 14 12:48:16.198271 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 14 12:48:16.198271 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 217/443] 10.222.0.17 () {56 vars in 1102 bytes} [Fri Oct 14 12:48:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:48:16.199493 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6414fecf-cba4-4856-a561-45e98ee09688 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:16.262158 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ab2df1-6bf9-4109-b664-8dfef940478f None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:16.289793 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:16.310972 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c544d07-99b5-4497-bcd6-0e0ac993cd77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:16.311740 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c544d07-99b5-4497-bcd6-0e0ac993cd77 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:16.312026 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c544d07-99b5-4497-bcd6-0e0ac993cd77 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:16.312486 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c544d07-99b5-4497-bcd6-0e0ac993cd77 None admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:16.313148 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c544d07-99b5-4497-bcd6-0e0ac993cd77 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:16.313458 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c544d07-99b5-4497-bcd6-0e0ac993cd77 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:16.314889 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c544d07-99b5-4497-bcd6-0e0ac993cd77 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:16.331263 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 227/444] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Oct 14 12:48:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:16.331263 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c544d07-99b5-4497-bcd6-0e0ac993cd77 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:16.339933 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6414fecf-cba4-4856-a561-45e98ee09688 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:16.383906 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1f3c5b-3c14-41ec-935e-754611edaf3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:16.384889 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1f3c5b-3c14-41ec-935e-754611edaf3f None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:16.385183 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1f3c5b-3c14-41ec-935e-754611edaf3f None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:16.385455 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1f3c5b-3c14-41ec-935e-754611edaf3f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:16.401204 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1f3c5b-3c14-41ec-935e-754611edaf3f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:16.402892 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1f3c5b-3c14-41ec-935e-754611edaf3f None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:16.419150 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-bb1f3c5b-3c14-41ec-935e-754611edaf3f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:48:16.419150 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:16.419150 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:48:16.419150 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:48:16.419150 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:48:16.419150 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:48:16.419150 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:48:16.419150 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:48:16.419150 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:48:16.419150 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:48:16.419150 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:48:16.419150 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:48:16.419150 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 12:48:16.419150 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 12:48:16.419150 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 12:48:16.419150 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 12:48:16.420151 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:48:16.420151 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:48:16.420151 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:48:16.420151 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:48:16.420151 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:48:16.420151 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:48:16.420151 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:48:16.420151 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 14 12:48:16.420151 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:48:16.420151 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:48:16.420151 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:48:16.420151 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:48:16.420151 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:48:16.420151 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:48:16.420151 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:48:16.420151 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:48:16.420151 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 12:48:16.420983 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 12:48:16.420983 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:48:16.420983 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 14 12:48:16.420983 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 218/445] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Oct 14 12:48:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:48:16.421193 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1f3c5b-3c14-41ec-935e-754611edaf3f None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:16.444141 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:16.448210 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c544d07-99b5-4497-bcd6-0e0ac993cd77 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:16.492898 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9726f46-5e3e-473e-aa13-1c7a2af2cc9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:16.493531 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9726f46-5e3e-473e-aa13-1c7a2af2cc9c None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:16.493805 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9726f46-5e3e-473e-aa13-1c7a2af2cc9c None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:16.494072 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9726f46-5e3e-473e-aa13-1c7a2af2cc9c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:16.504764 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9726f46-5e3e-473e-aa13-1c7a2af2cc9c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 12:48:16.510006 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-c9726f46-5e3e-473e-aa13-1c7a2af2cc9c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 14 12:48:16.510006 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:16.510006 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:48:16.510006 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:48:16.510006 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:48:16.510006 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:48:16.510006 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:48:16.510006 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:48:16.510006 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:48:16.510006 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:48:16.510006 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:48:16.510006 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:48:16.510006 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 12:48:16.510006 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 12:48:16.510006 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 12:48:16.510006 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 12:48:16.510954 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 12:48:16.510954 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 12:48:16.510954 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 12:48:16.510954 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 12:48:16.510954 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:48:16.510954 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:48:16.510954 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:48:16.510954 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:48:16.510954 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:48:16.510954 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:48:16.510954 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:48:16.510954 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 14 12:48:16.510954 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:48:16.510954 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:48:16.510954 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:48:16.510954 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:48:16.511767 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:48:16.511767 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:48:16.511767 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:48:16.511767 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:48:16.511767 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 12:48:16.511767 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 12:48:16.511767 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 12:48:16.511767 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 12:48:16.511767 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 12:48:16.511767 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 12:48:16.511767 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 14 12:48:16.511767 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 14 12:48:16.511767 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 228/446] 10.222.0.17 () {56 vars in 1102 bytes} [Fri Oct 14 12:48:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:48:16.512416 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9726f46-5e3e-473e-aa13-1c7a2af2cc9c None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:16.538187 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1f3c5b-3c14-41ec-935e-754611edaf3f None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:16.555088 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:16.573626 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61609da4-d43d-448a-8a90-472397328d04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:16.574263 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61609da4-d43d-448a-8a90-472397328d04 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:16.574541 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61609da4-d43d-448a-8a90-472397328d04 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:16.574811 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61609da4-d43d-448a-8a90-472397328d04 None admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:16.575472 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61609da4-d43d-448a-8a90-472397328d04 None admin] RBAC: Adding query filter params (name=service) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:16.575767 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61609da4-d43d-448a-8a90-472397328d04 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:16.577264 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61609da4-d43d-448a-8a90-472397328d04 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:16.585982 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 219/447] 10.222.0.17 () {56 vars in 1103 bytes} [Fri Oct 14 12:48:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:16.586855 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61609da4-d43d-448a-8a90-472397328d04 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:16.629771 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9726f46-5e3e-473e-aa13-1c7a2af2cc9c None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:16.671632 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ecde46-c361-486a-9b5a-082afd32d0aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:16.672257 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ecde46-c361-486a-9b5a-082afd32d0aa None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:16.672525 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ecde46-c361-486a-9b5a-082afd32d0aa None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:16.672801 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ecde46-c361-486a-9b5a-082afd32d0aa None admin] PATH_INFO: `/v3/projects/service` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:16.680201 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ecde46-c361-486a-9b5a-082afd32d0aa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:16.681644 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ecde46-c361-486a-9b5a-082afd32d0aa None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:16.689031 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61609da4-d43d-448a-8a90-472397328d04 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:16.692904 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-d4ecde46-c361-486a-9b5a-082afd32d0aa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 12:48:16.692904 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:16.692904 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:48:16.692904 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:48:16.692904 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:48:16.692904 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:48:16.692904 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:48:16.692904 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:48:16.692904 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:48:16.692904 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:48:16.692904 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:48:16.692904 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:48:16.692904 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 14 12:48:16.692904 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 14 12:48:16.692904 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 14 12:48:16.694104 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 14 12:48:16.694104 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:48:16.694104 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:48:16.694104 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:48:16.694104 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:48:16.694104 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:48:16.694104 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:48:16.694104 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:48:16.694104 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 14 12:48:16.694104 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:48:16.694104 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:48:16.694104 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:48:16.694104 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:48:16.694104 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:48:16.694104 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:48:16.694104 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:48:16.694104 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:48:16.695222 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 14 12:48:16.695222 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 14 12:48:16.695222 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 14 12:48:16.695222 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 14 12:48:16.695222 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 14 12:48:16.695222 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 14 12:48:16.695222 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 12:48:16.695222 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 14 12:48:16.695222 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 229/448] 10.222.0.17 () {56 vars in 1111 bytes} [Fri Oct 14 12:48:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:48:16.695222 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ecde46-c361-486a-9b5a-082afd32d0aa None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:16.715241 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:16.728778 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489046fa-ba19-48ec-ad3b-9b4d0c850bba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:16.729396 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489046fa-ba19-48ec-ad3b-9b4d0c850bba None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:16.729672 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489046fa-ba19-48ec-ad3b-9b4d0c850bba None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:16.729941 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489046fa-ba19-48ec-ad3b-9b4d0c850bba None admin] PATH_INFO: `/v3/roles/service` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:16.743322 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489046fa-ba19-48ec-ad3b-9b4d0c850bba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 12:48:16.749125 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-489046fa-ba19-48ec-ad3b-9b4d0c850bba None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 14 12:48:16.749125 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:16.749125 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:48:16.749125 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:48:16.749125 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:48:16.749125 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:48:16.749125 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:48:16.749125 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:48:16.749125 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:48:16.749125 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:48:16.749125 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:48:16.749125 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:48:16.749125 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 12:48:16.749125 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 12:48:16.749125 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 12:48:16.749125 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 12:48:16.750216 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 12:48:16.750216 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 12:48:16.750216 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 12:48:16.750216 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 12:48:16.750216 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:48:16.750216 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:48:16.750216 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:48:16.750216 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:48:16.750216 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:48:16.750216 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:48:16.750216 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:48:16.750216 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 14 12:48:16.750216 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:48:16.750216 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:48:16.750216 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:48:16.750216 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:48:16.751157 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:48:16.751157 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:48:16.751157 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:48:16.751157 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:48:16.751157 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 12:48:16.751157 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 12:48:16.751157 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 12:48:16.751157 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 12:48:16.751157 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 12:48:16.751157 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 12:48:16.751157 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 14 12:48:16.751157 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 14 12:48:16.751157 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 220/449] 10.222.0.17 () {56 vars in 1102 bytes} [Fri Oct 14 12:48:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:48:16.751157 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489046fa-ba19-48ec-ad3b-9b4d0c850bba None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:16.796667 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:16.803393 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ecde46-c361-486a-9b5a-082afd32d0aa None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:16.837786 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c725a46-3bd9-4256-9264-2aa7400a09b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:16.838510 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c725a46-3bd9-4256-9264-2aa7400a09b1 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:16.838789 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c725a46-3bd9-4256-9264-2aa7400a09b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:16.839058 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c725a46-3bd9-4256-9264-2aa7400a09b1 None admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:16.839700 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c725a46-3bd9-4256-9264-2aa7400a09b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:16.840001 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c725a46-3bd9-4256-9264-2aa7400a09b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:16.841392 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c725a46-3bd9-4256-9264-2aa7400a09b1 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:16.853825 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 230/450] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Oct 14 12:48:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:16.854673 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c725a46-3bd9-4256-9264-2aa7400a09b1 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:16.862731 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489046fa-ba19-48ec-ad3b-9b4d0c850bba None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:16.898294 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658c541e-ddea-48d6-8b94-59e70a445bc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:16.899072 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658c541e-ddea-48d6-8b94-59e70a445bc1 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:16.899357 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658c541e-ddea-48d6-8b94-59e70a445bc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:16.899638 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658c541e-ddea-48d6-8b94-59e70a445bc1 None admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:16.900304 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658c541e-ddea-48d6-8b94-59e70a445bc1 None admin] RBAC: Adding query filter params (name=service) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:16.900610 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658c541e-ddea-48d6-8b94-59e70a445bc1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:16.902005 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658c541e-ddea-48d6-8b94-59e70a445bc1 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:16.911287 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 221/451] 10.222.0.17 () {56 vars in 1103 bytes} [Fri Oct 14 12:48:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:16.912110 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658c541e-ddea-48d6-8b94-59e70a445bc1 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:16.943189 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:16.968108 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c725a46-3bd9-4256-9264-2aa7400a09b1 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:17.008919 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6502e6-093a-4702-b090-de209c3390f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:17.009541 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6502e6-093a-4702-b090-de209c3390f5 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:17.009817 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6502e6-093a-4702-b090-de209c3390f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:17.010081 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6502e6-093a-4702-b090-de209c3390f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:17.025236 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6502e6-093a-4702-b090-de209c3390f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:17.025236 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6502e6-093a-4702-b090-de209c3390f5 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:17.025611 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:17.031998 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658c541e-ddea-48d6-8b94-59e70a445bc1 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:17.040883 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-0e6502e6-093a-4702-b090-de209c3390f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:48:17.040883 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:17.040883 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:48:17.040883 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:48:17.040883 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:48:17.040883 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:48:17.040883 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:48:17.040883 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:48:17.040883 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:48:17.040883 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:48:17.040883 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:48:17.040883 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:48:17.040883 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 12:48:17.040883 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 12:48:17.040883 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 12:48:17.040883 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 12:48:17.041904 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:48:17.041904 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:48:17.041904 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:48:17.041904 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:48:17.041904 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:48:17.041904 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:48:17.041904 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:48:17.041904 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 14 12:48:17.041904 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:48:17.041904 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:48:17.041904 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:48:17.041904 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:48:17.041904 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:48:17.041904 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:48:17.041904 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:48:17.041904 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:48:17.041904 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 12:48:17.042900 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 12:48:17.042900 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:48:17.042900 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 14 12:48:17.042900 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 231/452] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Oct 14 12:48:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:48:17.043840 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6502e6-093a-4702-b090-de209c3390f5 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:17.073150 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c9f360-21fc-4e11-ac60-c385aabc07d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:17.073150 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c9f360-21fc-4e11-ac60-c385aabc07d4 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:17.073150 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c9f360-21fc-4e11-ac60-c385aabc07d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:17.073150 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c9f360-21fc-4e11-ac60-c385aabc07d4 None admin] PATH_INFO: `/v3/projects` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:17.080302 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c9f360-21fc-4e11-ac60-c385aabc07d4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:17.080302 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c9f360-21fc-4e11-ac60-c385aabc07d4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:17.080302 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c9f360-21fc-4e11-ac60-c385aabc07d4 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:17.092079 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 222/453] 10.222.0.17 () {56 vars in 1148 bytes} [Fri Oct 14 12:48:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:17.093142 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c9f360-21fc-4e11-ac60-c385aabc07d4 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:17.151158 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6502e6-093a-4702-b090-de209c3390f5 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:17.180504 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:17.186526 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd39bf5-babd-4d88-ab03-589ee0f1c52b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:17.187131 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd39bf5-babd-4d88-ab03-589ee0f1c52b None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:17.187404 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd39bf5-babd-4d88-ab03-589ee0f1c52b None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:17.187677 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd39bf5-babd-4d88-ab03-589ee0f1c52b None admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:17.188328 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd39bf5-babd-4d88-ab03-589ee0f1c52b None admin] RBAC: Adding query filter params (name=service) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:17.188626 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd39bf5-babd-4d88-ab03-589ee0f1c52b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:17.190015 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd39bf5-babd-4d88-ab03-589ee0f1c52b None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:17.198768 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 232/454] 10.222.0.17 () {56 vars in 1103 bytes} [Fri Oct 14 12:48:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:17.199586 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd39bf5-babd-4d88-ab03-589ee0f1c52b None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:17.203067 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c9f360-21fc-4e11-ac60-c385aabc07d4 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:17.239586 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608a8ebd-bae2-408d-8849-8d6d14dc352e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:17.240136 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608a8ebd-bae2-408d-8849-8d6d14dc352e None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:17.240419 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608a8ebd-bae2-408d-8849-8d6d14dc352e None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:17.240693 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608a8ebd-bae2-408d-8849-8d6d14dc352e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:17.247605 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608a8ebd-bae2-408d-8849-8d6d14dc352e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:17.249061 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608a8ebd-bae2-408d-8849-8d6d14dc352e None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:17.261772 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-608a8ebd-bae2-408d-8849-8d6d14dc352e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 12:48:17.261772 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:17.261772 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:48:17.261772 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:48:17.261772 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:48:17.261772 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:48:17.261772 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:48:17.261772 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:48:17.261772 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:48:17.261772 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:48:17.261772 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:48:17.261772 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:48:17.261772 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 14 12:48:17.261772 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 14 12:48:17.261772 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 14 12:48:17.262829 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 14 12:48:17.262829 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:48:17.262829 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:48:17.262829 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:48:17.262829 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:48:17.262829 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:48:17.262829 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:48:17.262829 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:48:17.262829 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 14 12:48:17.262829 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:48:17.262829 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:48:17.262829 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:48:17.262829 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:48:17.262829 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:48:17.262829 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:48:17.262829 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:48:17.262829 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:48:17.263732 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 14 12:48:17.263732 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 14 12:48:17.263732 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 14 12:48:17.263732 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 14 12:48:17.263732 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 14 12:48:17.263732 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 14 12:48:17.263732 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 12:48:17.263732 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 14 12:48:17.263732 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 223/455] 10.222.0.17 () {56 vars in 1111 bytes} [Fri Oct 14 12:48:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:48:17.265287 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608a8ebd-bae2-408d-8849-8d6d14dc352e None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:17.297809 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:17.323310 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd39bf5-babd-4d88-ab03-589ee0f1c52b None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:17.359264 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08350a7d-6697-4493-bd94-bd00a4f9bfcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:17.359896 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08350a7d-6697-4493-bd94-bd00a4f9bfcc None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:17.360167 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08350a7d-6697-4493-bd94-bd00a4f9bfcc None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:17.360435 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08350a7d-6697-4493-bd94-bd00a4f9bfcc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:17.374342 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08350a7d-6697-4493-bd94-bd00a4f9bfcc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:17.375795 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08350a7d-6697-4493-bd94-bd00a4f9bfcc None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:17.385570 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608a8ebd-bae2-408d-8849-8d6d14dc352e None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:17.395080 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-08350a7d-6697-4493-bd94-bd00a4f9bfcc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:48:17.395080 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:17.395080 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:48:17.395080 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:48:17.395080 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:48:17.395080 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:48:17.395080 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:48:17.395080 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:48:17.395080 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:48:17.395080 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:48:17.395080 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:48:17.395080 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:48:17.395080 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 12:48:17.395080 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 12:48:17.395080 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 12:48:17.395080 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 12:48:17.396180 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:48:17.396180 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:48:17.396180 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:48:17.396180 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:48:17.396180 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:48:17.396180 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:48:17.396180 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:48:17.396180 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 14 12:48:17.396180 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:48:17.396180 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:48:17.396180 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:48:17.396180 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:48:17.396180 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:48:17.396180 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:48:17.396180 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:48:17.396180 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:48:17.396180 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 12:48:17.397025 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 12:48:17.397025 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:48:17.397025 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 14 12:48:17.397463 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 233/456] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Oct 14 12:48:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:48:17.398260 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08350a7d-6697-4493-bd94-bd00a4f9bfcc None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:17.420742 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a962845-ee44-4954-a297-7e87c3996eec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:17.421350 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a962845-ee44-4954-a297-7e87c3996eec None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:17.421618 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a962845-ee44-4954-a297-7e87c3996eec None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:17.421892 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a962845-ee44-4954-a297-7e87c3996eec None admin] PATH_INFO: `/v3/domains` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:17.422577 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a962845-ee44-4954-a297-7e87c3996eec None admin] RBAC: Adding query filter params (name=Default) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:17.422879 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a962845-ee44-4954-a297-7e87c3996eec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:17.424267 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a962845-ee44-4954-a297-7e87c3996eec None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:17.436869 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 224/457] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Oct 14 12:48:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:17.437937 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a962845-ee44-4954-a297-7e87c3996eec None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:17.454994 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:17.518094 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08350a7d-6697-4493-bd94-bd00a4f9bfcc None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:17.533722 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:17.554466 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6294a89a-67cd-4322-8ac0-f447cd87c2b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:17.555072 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6294a89a-67cd-4322-8ac0-f447cd87c2b6 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:17.555352 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6294a89a-67cd-4322-8ac0-f447cd87c2b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:17.555626 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6294a89a-67cd-4322-8ac0-f447cd87c2b6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:17.556345 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6294a89a-67cd-4322-8ac0-f447cd87c2b6 None admin] RBAC: Adding query filter params (role.id=2d0a16b1c5634daf99f2b7ac092d1ddd, scope.project.id=2486e73d493b40e18d9d988744993854, user.id=931f4e32c8764514b5efed31b0785be7) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:17.556656 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6294a89a-67cd-4322-8ac0-f447cd87c2b6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:17.558100 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6294a89a-67cd-4322-8ac0-f447cd87c2b6 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:17.559760 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a962845-ee44-4954-a297-7e87c3996eec None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:17.564371 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 234/458] 10.222.0.17 () {56 vars in 1374 bytes} [Fri Oct 14 12:48:17 2022] GET /identity/v3/role_assignments?user.id=931f4e32c8764514b5efed31b0785be7&scope.project.id=2486e73d493b40e18d9d988744993854&role.id=2d0a16b1c5634daf99f2b7ac092d1ddd => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:17.565180 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6294a89a-67cd-4322-8ac0-f447cd87c2b6 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:17.615800 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e02b7f-f5d5-4537-bf7b-243b996eb298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:17.616451 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e02b7f-f5d5-4537-bf7b-243b996eb298 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:17.617009 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e02b7f-f5d5-4537-bf7b-243b996eb298 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:17.617301 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e02b7f-f5d5-4537-bf7b-243b996eb298 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:17.636025 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e02b7f-f5d5-4537-bf7b-243b996eb298 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:17.637561 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e02b7f-f5d5-4537-bf7b-243b996eb298 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:17.661356 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-32e02b7f-f5d5-4537-bf7b-243b996eb298 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:48:17.661356 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:17.661356 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:48:17.661356 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:48:17.661356 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:48:17.661356 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:48:17.661356 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:48:17.661356 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:48:17.661356 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:48:17.661356 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:48:17.661356 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:48:17.661356 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:48:17.661356 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 12:48:17.661356 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 12:48:17.661356 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 12:48:17.661356 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 12:48:17.662392 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:48:17.662392 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:48:17.662392 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:48:17.662392 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:48:17.662392 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:48:17.662392 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:48:17.662392 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:48:17.662392 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 14 12:48:17.662392 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:48:17.662392 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:48:17.662392 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:48:17.662392 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:48:17.662392 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:48:17.662392 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:48:17.662392 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:48:17.662392 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:48:17.662392 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 12:48:17.663250 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 12:48:17.663250 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:48:17.663250 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 14 12:48:17.663425 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 225/459] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Oct 14 12:48:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:48:17.664695 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e02b7f-f5d5-4537-bf7b-243b996eb298 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:17.724011 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6294a89a-67cd-4322-8ac0-f447cd87c2b6 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:17.735757 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:17.769193 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3f30ef-0124-4495-943b-ff2859663cf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:17.770038 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3f30ef-0124-4495-943b-ff2859663cf1 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:17.770517 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3f30ef-0124-4495-943b-ff2859663cf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:17.770805 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3f30ef-0124-4495-943b-ff2859663cf1 None admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:17.771509 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3f30ef-0124-4495-943b-ff2859663cf1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:17.771824 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3f30ef-0124-4495-943b-ff2859663cf1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:17.773275 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3f30ef-0124-4495-943b-ff2859663cf1 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:17.792399 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 235/460] 10.222.0.17 () {56 vars in 1148 bytes} [Fri Oct 14 12:48:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:17.794707 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3f30ef-0124-4495-943b-ff2859663cf1 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:17.801060 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e02b7f-f5d5-4537-bf7b-243b996eb298 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:17.836932 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:17.842702 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9724b0f4-983b-487d-926c-25cd756cf39c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:17.843341 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9724b0f4-983b-487d-926c-25cd756cf39c None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:17.843632 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9724b0f4-983b-487d-926c-25cd756cf39c None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:17.843964 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9724b0f4-983b-487d-926c-25cd756cf39c None admin] PATH_INFO: `/v3/domains` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:17.844625 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9724b0f4-983b-487d-926c-25cd756cf39c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:17.844933 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9724b0f4-983b-487d-926c-25cd756cf39c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:17.846360 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9724b0f4-983b-487d-926c-25cd756cf39c None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:17.860084 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 226/461] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Oct 14 12:48:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:17.860939 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9724b0f4-983b-487d-926c-25cd756cf39c None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:17.932447 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3f30ef-0124-4495-943b-ff2859663cf1 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:17.973322 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfd02fe-87d8-41ad-8bbd-13504463706e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:17.974069 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfd02fe-87d8-41ad-8bbd-13504463706e None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:17.974510 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfd02fe-87d8-41ad-8bbd-13504463706e None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:17.975107 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfd02fe-87d8-41ad-8bbd-13504463706e None admin] PATH_INFO: `/v3/users/glance` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:17.983164 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfd02fe-87d8-41ad-8bbd-13504463706e None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:17.985058 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfd02fe-87d8-41ad-8bbd-13504463706e None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:17.996130 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9724b0f4-983b-487d-926c-25cd756cf39c None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:17.999411 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-5cfd02fe-87d8-41ad-8bbd-13504463706e None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 14 12:48:17.999411 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:17.999411 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:48:17.999411 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:48:17.999411 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:48:17.999411 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:48:17.999411 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:48:17.999411 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:48:17.999411 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:48:17.999411 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:48:17.999411 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:48:17.999411 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:48:17.999411 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 14 12:48:17.999411 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 14 12:48:17.999411 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 14 12:48:17.999411 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 14 12:48:18.000435 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:48:18.000435 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:48:18.000435 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 14 12:48:18.000435 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 12:48:18.000435 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 14 12:48:18.000435 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 12:48:18.000435 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:48:18.000435 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:48:18.000435 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:48:18.000435 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:48:18.000435 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:48:18.000435 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 14 12:48:18.000435 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:48:18.000435 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:48:18.000435 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:48:18.000435 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:48:18.000435 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:48:18.000435 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:48:18.001318 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:48:18.001318 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:48:18.001318 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 14 12:48:18.001318 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 14 12:48:18.001318 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 14 12:48:18.001318 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 14 12:48:18.001318 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 14 12:48:18.001318 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 14 12:48:18.001318 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 14 12:48:18.001318 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 14 12:48:18.001318 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 236/462] 10.222.0.17 () {56 vars in 1099 bytes} [Fri Oct 14 12:48:17 2022] GET /identity/v3/users/glance => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:48:18.001318 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfd02fe-87d8-41ad-8bbd-13504463706e None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:18.037878 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:18.045464 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf29801-ea3a-4dca-8f51-11161f4c9773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:18.046329 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf29801-ea3a-4dca-8f51-11161f4c9773 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:18.046606 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf29801-ea3a-4dca-8f51-11161f4c9773 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:18.046932 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf29801-ea3a-4dca-8f51-11161f4c9773 None admin] PATH_INFO: `/v3/domains` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:18.047847 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf29801-ea3a-4dca-8f51-11161f4c9773 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:18.048216 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf29801-ea3a-4dca-8f51-11161f4c9773 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:18.050023 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf29801-ea3a-4dca-8f51-11161f4c9773 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:18.068916 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 227/463] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Oct 14 12:48:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:18.072685 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf29801-ea3a-4dca-8f51-11161f4c9773 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:18.134899 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfd02fe-87d8-41ad-8bbd-13504463706e None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:18.151773 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:18.173358 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c99ff1-0cc3-4038-a51b-553e9de6d6ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:18.174378 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c99ff1-0cc3-4038-a51b-553e9de6d6ac None admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:18.174849 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c99ff1-0cc3-4038-a51b-553e9de6d6ac None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:18.175128 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c99ff1-0cc3-4038-a51b-553e9de6d6ac None admin] PATH_INFO: `/v3/projects/2486e73d493b40e18d9d988744993854/users/86c9fc57b1ec4d00b9f392877f277284/roles/2d0a16b1c5634daf99f2b7ac092d1ddd` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:18.192572 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c99ff1-0cc3-4038-a51b-553e9de6d6ac None admin] RBAC: Authorizing `identity:create_grant(project_id=2486e73d493b40e18d9d988744993854, user_id=86c9fc57b1ec4d00b9f392877f277284, role_id=2d0a16b1c5634daf99f2b7ac092d1ddd)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:18.194156 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c99ff1-0cc3-4038-a51b-553e9de6d6ac None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:18.210858 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf29801-ea3a-4dca-8f51-11161f4c9773 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:18.214234 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 237/464] 10.222.0.17 () {58 vars in 1439 bytes} [Fri Oct 14 12:48:18 2022] PUT /identity/v3/projects/2486e73d493b40e18d9d988744993854/users/86c9fc57b1ec4d00b9f392877f277284/roles/2d0a16b1c5634daf99f2b7ac092d1ddd => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 12:48:18.215252 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c99ff1-0cc3-4038-a51b-553e9de6d6ac None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:18.257735 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43f7772-ab4b-4da7-ab74-f605e67a3717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:18.258399 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43f7772-ab4b-4da7-ab74-f605e67a3717 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:18.258678 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43f7772-ab4b-4da7-ab74-f605e67a3717 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:18.258949 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43f7772-ab4b-4da7-ab74-f605e67a3717 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:18.268275 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43f7772-ab4b-4da7-ab74-f605e67a3717 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:18.270302 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43f7772-ab4b-4da7-ab74-f605e67a3717 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:18.283970 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-e43f7772-ab4b-4da7-ab74-f605e67a3717 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 14 12:48:18.283970 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:18.283970 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:48:18.283970 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:48:18.283970 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:48:18.283970 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:48:18.283970 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:48:18.283970 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:48:18.283970 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:48:18.283970 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:48:18.283970 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:48:18.283970 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:48:18.283970 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 14 12:48:18.283970 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 14 12:48:18.283970 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 14 12:48:18.283970 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 14 12:48:18.284958 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:48:18.284958 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:48:18.284958 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 14 12:48:18.284958 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 12:48:18.284958 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 14 12:48:18.284958 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 12:48:18.284958 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:48:18.284958 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:48:18.284958 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:48:18.284958 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:48:18.284958 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:48:18.284958 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 14 12:48:18.284958 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:48:18.284958 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:48:18.284958 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:48:18.284958 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:48:18.284958 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:48:18.284958 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:48:18.285886 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:48:18.285886 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:48:18.285886 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 14 12:48:18.285886 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 14 12:48:18.285886 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 14 12:48:18.285886 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 14 12:48:18.285886 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 14 12:48:18.285886 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 14 12:48:18.285886 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 14 12:48:18.285886 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 14 12:48:18.285886 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 228/465] 10.222.0.17 () {56 vars in 1102 bytes} [Fri Oct 14 12:48:18 2022] GET /identity/v3/users/neutron => generated 85 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:48:18.286481 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43f7772-ab4b-4da7-ab74-f605e67a3717 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:18.359062 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:18.404521 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c99ff1-0cc3-4038-a51b-553e9de6d6ac None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:18.449041 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82ac1bd-be0a-459d-a601-8efa644f79b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:18.449718 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82ac1bd-be0a-459d-a601-8efa644f79b4 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:18.450006 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82ac1bd-be0a-459d-a601-8efa644f79b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:18.450329 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82ac1bd-be0a-459d-a601-8efa644f79b4 None admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:18.451066 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82ac1bd-be0a-459d-a601-8efa644f79b4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:18.451376 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82ac1bd-be0a-459d-a601-8efa644f79b4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:18.452918 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82ac1bd-be0a-459d-a601-8efa644f79b4 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:18.472919 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 238/466] 10.222.0.17 () {56 vars in 1137 bytes} [Fri Oct 14 12:48:18 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:18.473534 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43f7772-ab4b-4da7-ab74-f605e67a3717 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:18.474988 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82ac1bd-be0a-459d-a601-8efa644f79b4 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:18.491096 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:18.525312 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d798b0e-ecda-4cc9-b65b-29ed3f6bbe82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:18.526313 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d798b0e-ecda-4cc9-b65b-29ed3f6bbe82 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:18.526877 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d798b0e-ecda-4cc9-b65b-29ed3f6bbe82 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:18.527159 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d798b0e-ecda-4cc9-b65b-29ed3f6bbe82 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:18.537922 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d798b0e-ecda-4cc9-b65b-29ed3f6bbe82 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:18.540110 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d798b0e-ecda-4cc9-b65b-29ed3f6bbe82 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:18.556691 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-7d798b0e-ecda-4cc9-b65b-29ed3f6bbe82 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 14 12:48:18.556691 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:18.556691 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:48:18.556691 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:48:18.556691 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:48:18.556691 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:48:18.556691 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:48:18.556691 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:48:18.556691 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:48:18.556691 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:48:18.556691 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:48:18.556691 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:48:18.556691 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 14 12:48:18.556691 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 14 12:48:18.556691 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 14 12:48:18.556691 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 14 12:48:18.557635 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:48:18.557635 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:48:18.557635 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 14 12:48:18.557635 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 12:48:18.557635 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 14 12:48:18.557635 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 12:48:18.557635 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:48:18.557635 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:48:18.557635 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:48:18.557635 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:48:18.557635 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:48:18.557635 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 14 12:48:18.557635 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:48:18.557635 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:48:18.557635 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:48:18.557635 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:48:18.557635 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:48:18.557635 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:48:18.559198 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:48:18.559198 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:48:18.559198 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 14 12:48:18.559198 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 14 12:48:18.559198 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 14 12:48:18.559198 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 14 12:48:18.559198 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 14 12:48:18.559198 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 14 12:48:18.559198 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 14 12:48:18.559198 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 14 12:48:18.559198 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 229/467] 10.222.0.17 () {56 vars in 1099 bytes} [Fri Oct 14 12:48:18 2022] GET /identity/v3/users/cinder => generated 84 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:48:18.559198 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d798b0e-ecda-4cc9-b65b-29ed3f6bbe82 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:18.598474 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82ac1bd-be0a-459d-a601-8efa644f79b4 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:18.643497 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fef740-408a-4388-b822-9375d503adde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:18.644429 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fef740-408a-4388-b822-9375d503adde None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:18.644883 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fef740-408a-4388-b822-9375d503adde None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:18.645316 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fef740-408a-4388-b822-9375d503adde None admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:18.647168 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fef740-408a-4388-b822-9375d503adde None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:18.647657 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fef740-408a-4388-b822-9375d503adde None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:18.651161 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fef740-408a-4388-b822-9375d503adde None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:18.671872 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:18.681524 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 239/468] 10.222.0.17 () {56 vars in 1139 bytes} [Fri Oct 14 12:48:18 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:18.682689 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fef740-408a-4388-b822-9375d503adde None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:18.716774 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d798b0e-ecda-4cc9-b65b-29ed3f6bbe82 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:18.754918 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a978d8-59bf-4abc-ad0c-3fa96bfa3c24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:18.755669 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a978d8-59bf-4abc-ad0c-3fa96bfa3c24 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:18.756033 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a978d8-59bf-4abc-ad0c-3fa96bfa3c24 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:18.756308 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a978d8-59bf-4abc-ad0c-3fa96bfa3c24 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:18.805851 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fef740-408a-4388-b822-9375d503adde None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:18.808804 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:18.848694 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a978d8-59bf-4abc-ad0c-3fa96bfa3c24 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:18.851189 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a978d8-59bf-4abc-ad0c-3fa96bfa3c24 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:18.859860 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689871f8-419c-4f61-addc-5850744887f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:18.860799 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689871f8-419c-4f61-addc-5850744887f0 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:18.861223 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689871f8-419c-4f61-addc-5850744887f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:18.861646 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689871f8-419c-4f61-addc-5850744887f0 None admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:18.862926 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689871f8-419c-4f61-addc-5850744887f0 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:18.863397 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689871f8-419c-4f61-addc-5850744887f0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:18.865741 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689871f8-419c-4f61-addc-5850744887f0 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:18.890086 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 240/469] 10.222.0.17 () {56 vars in 1137 bytes} [Fri Oct 14 12:48:18 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:18.891038 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689871f8-419c-4f61-addc-5850744887f0 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:18.948766 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:18.973439 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 230/470] 10.222.0.17 () {58 vars in 1282 bytes} [Fri Oct 14 12:48:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 14 12:48:18.974811 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a978d8-59bf-4abc-ad0c-3fa96bfa3c24 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:19.000432 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689871f8-419c-4f61-addc-5850744887f0 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:19.037916 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65337b0d-82f0-42dd-8a01-939fbb47ac68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:19.038558 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65337b0d-82f0-42dd-8a01-939fbb47ac68 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:19.038837 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65337b0d-82f0-42dd-8a01-939fbb47ac68 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:19.039109 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65337b0d-82f0-42dd-8a01-939fbb47ac68 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:19.062152 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:19.098807 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a978d8-59bf-4abc-ad0c-3fa96bfa3c24 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:19.118427 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65337b0d-82f0-42dd-8a01-939fbb47ac68 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:19.119889 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65337b0d-82f0-42dd-8a01-939fbb47ac68 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:19.141393 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3340861-71a9-404e-b869-e9aeef15a29c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:19.142373 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3340861-71a9-404e-b869-e9aeef15a29c None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:19.142992 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3340861-71a9-404e-b869-e9aeef15a29c None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:19.143669 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3340861-71a9-404e-b869-e9aeef15a29c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:19.180356 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:19.234018 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3340861-71a9-404e-b869-e9aeef15a29c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:19.236299 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3340861-71a9-404e-b869-e9aeef15a29c None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:19.248662 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 241/471] 10.222.0.17 () {58 vars in 1282 bytes} [Fri Oct 14 12:48:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 14 12:48:19.249587 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65337b0d-82f0-42dd-8a01-939fbb47ac68 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:19.314356 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:19.352583 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 231/472] 10.222.0.17 () {58 vars in 1282 bytes} [Fri Oct 14 12:48:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 14 12:48:19.353831 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3340861-71a9-404e-b869-e9aeef15a29c None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:19.373771 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65337b0d-82f0-42dd-8a01-939fbb47ac68 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:19.418402 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a103911-ba8e-43d4-af82-af050d3aa607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:19.419074 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a103911-ba8e-43d4-af82-af050d3aa607 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:19.419353 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a103911-ba8e-43d4-af82-af050d3aa607 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:19.419628 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a103911-ba8e-43d4-af82-af050d3aa607 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:19.432463 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a103911-ba8e-43d4-af82-af050d3aa607 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:19.434264 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a103911-ba8e-43d4-af82-af050d3aa607 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:19.451396 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-9a103911-ba8e-43d4-af82-af050d3aa607 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:48:19.451396 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:19.451396 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:48:19.451396 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:48:19.451396 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:48:19.451396 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:48:19.451396 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:48:19.451396 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:48:19.451396 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:48:19.451396 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:48:19.451396 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:48:19.451396 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:48:19.451396 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 12:48:19.451396 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 12:48:19.451396 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 12:48:19.451396 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 12:48:19.452330 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:48:19.452330 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:48:19.452330 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:48:19.452330 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:48:19.452330 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:48:19.452330 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:48:19.452330 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:48:19.452330 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 14 12:48:19.452330 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:48:19.452330 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:48:19.452330 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:48:19.452330 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:48:19.452330 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:48:19.452330 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:48:19.452330 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:48:19.452330 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:48:19.452330 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 12:48:19.453154 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 12:48:19.453154 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:48:19.453154 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 14 12:48:19.455570 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 242/473] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Oct 14 12:48:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:48:19.457384 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a103911-ba8e-43d4-af82-af050d3aa607 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:19.462933 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:19.497103 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3340861-71a9-404e-b869-e9aeef15a29c None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:19.537674 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69d51fc-4f04-4e69-bd8d-86020f76f9db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:19.538583 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69d51fc-4f04-4e69-bd8d-86020f76f9db None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:19.538966 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69d51fc-4f04-4e69-bd8d-86020f76f9db None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:19.539338 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69d51fc-4f04-4e69-bd8d-86020f76f9db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:19.553483 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69d51fc-4f04-4e69-bd8d-86020f76f9db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:19.556042 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69d51fc-4f04-4e69-bd8d-86020f76f9db None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:19.577107 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-e69d51fc-4f04-4e69-bd8d-86020f76f9db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:48:19.577107 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:19.577107 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:48:19.577107 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:48:19.577107 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:48:19.577107 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:48:19.577107 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:48:19.577107 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:48:19.577107 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:48:19.577107 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:48:19.577107 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:48:19.577107 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:48:19.577107 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 12:48:19.577107 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 12:48:19.577107 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 12:48:19.577107 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 12:48:19.578972 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:48:19.578972 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:48:19.578972 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:48:19.578972 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:48:19.578972 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:48:19.578972 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:48:19.578972 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:48:19.578972 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 14 12:48:19.578972 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:48:19.578972 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:48:19.578972 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:48:19.578972 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:48:19.578972 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:48:19.578972 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:48:19.578972 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:48:19.578972 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:48:19.578972 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 12:48:19.579854 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 12:48:19.579854 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:48:19.579854 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 14 12:48:19.581699 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 232/474] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Oct 14 12:48:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:48:19.582926 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69d51fc-4f04-4e69-bd8d-86020f76f9db None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:19.615780 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a103911-ba8e-43d4-af82-af050d3aa607 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:19.620758 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:19.663211 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08f29ac-cbe4-4598-82f7-2c0ea1f7e463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:19.663944 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08f29ac-cbe4-4598-82f7-2c0ea1f7e463 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:19.664311 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08f29ac-cbe4-4598-82f7-2c0ea1f7e463 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:19.664654 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08f29ac-cbe4-4598-82f7-2c0ea1f7e463 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:19.676423 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08f29ac-cbe4-4598-82f7-2c0ea1f7e463 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:19.678152 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08f29ac-cbe4-4598-82f7-2c0ea1f7e463 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:19.695275 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-d08f29ac-cbe4-4598-82f7-2c0ea1f7e463 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:48:19.695275 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:19.695275 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:48:19.695275 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:48:19.695275 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:48:19.695275 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:48:19.695275 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:48:19.695275 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:48:19.695275 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:48:19.695275 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:48:19.695275 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:48:19.695275 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:48:19.695275 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 12:48:19.695275 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 12:48:19.695275 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 12:48:19.695275 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 12:48:19.696222 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:48:19.696222 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:48:19.696222 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:48:19.696222 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:48:19.696222 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:48:19.696222 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:48:19.696222 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:48:19.696222 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 14 12:48:19.696222 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:48:19.696222 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:48:19.696222 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:48:19.696222 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:48:19.696222 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:48:19.696222 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:48:19.696222 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:48:19.696222 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:48:19.696222 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 12:48:19.697435 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 12:48:19.697435 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:48:19.697435 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 14 12:48:19.697435 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 243/475] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Oct 14 12:48:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:48:19.698025 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08f29ac-cbe4-4598-82f7-2c0ea1f7e463 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:19.736240 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69d51fc-4f04-4e69-bd8d-86020f76f9db None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:19.763810 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:19.785293 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f07aca-a687-4cf5-8205-5354e9bccfa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:19.786225 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f07aca-a687-4cf5-8205-5354e9bccfa0 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:19.786682 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f07aca-a687-4cf5-8205-5354e9bccfa0 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:19.787131 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f07aca-a687-4cf5-8205-5354e9bccfa0 None admin] PATH_INFO: `/v3/domains` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:19.787984 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f07aca-a687-4cf5-8205-5354e9bccfa0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:19.788465 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f07aca-a687-4cf5-8205-5354e9bccfa0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:19.790026 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f07aca-a687-4cf5-8205-5354e9bccfa0 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:19.808324 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 233/476] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Oct 14 12:48:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:19.809504 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f07aca-a687-4cf5-8205-5354e9bccfa0 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:19.821613 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08f29ac-cbe4-4598-82f7-2c0ea1f7e463 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:19.865933 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cec7f9e-a40b-46cb-97d7-12af4b257ca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:19.866699 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cec7f9e-a40b-46cb-97d7-12af4b257ca0 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:19.867126 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cec7f9e-a40b-46cb-97d7-12af4b257ca0 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:19.867550 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cec7f9e-a40b-46cb-97d7-12af4b257ca0 None admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:19.868338 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cec7f9e-a40b-46cb-97d7-12af4b257ca0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:19.868715 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cec7f9e-a40b-46cb-97d7-12af4b257ca0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:19.870270 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cec7f9e-a40b-46cb-97d7-12af4b257ca0 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:19.887578 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 244/477] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Oct 14 12:48:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:19.888807 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cec7f9e-a40b-46cb-97d7-12af4b257ca0 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:19.937050 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:19.956296 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f07aca-a687-4cf5-8205-5354e9bccfa0 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:20.004685 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5a96aa-783f-4fa1-b56a-cc7ffa139f18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:20.006153 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5a96aa-783f-4fa1-b56a-cc7ffa139f18 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:20.007038 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5a96aa-783f-4fa1-b56a-cc7ffa139f18 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:20.008152 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5a96aa-783f-4fa1-b56a-cc7ffa139f18 None admin] PATH_INFO: `/v3/domains` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:20.008833 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5a96aa-783f-4fa1-b56a-cc7ffa139f18 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:20.009145 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5a96aa-783f-4fa1-b56a-cc7ffa139f18 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:20.010819 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5a96aa-783f-4fa1-b56a-cc7ffa139f18 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:20.024334 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 234/478] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Oct 14 12:48:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:20.025473 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5a96aa-783f-4fa1-b56a-cc7ffa139f18 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:20.037577 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cec7f9e-a40b-46cb-97d7-12af4b257ca0 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:20.055947 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:20.076508 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796ca962-142f-45f5-86f0-ea6a448f34bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:20.077183 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796ca962-142f-45f5-86f0-ea6a448f34bd None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:20.077427 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796ca962-142f-45f5-86f0-ea6a448f34bd None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:20.077700 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796ca962-142f-45f5-86f0-ea6a448f34bd None admin] PATH_INFO: `/v3/projects/service` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:20.086200 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796ca962-142f-45f5-86f0-ea6a448f34bd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:20.088124 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796ca962-142f-45f5-86f0-ea6a448f34bd None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:20.102980 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-796ca962-142f-45f5-86f0-ea6a448f34bd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 12:48:20.102980 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:20.102980 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:48:20.102980 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:48:20.102980 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:48:20.102980 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:48:20.102980 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:48:20.102980 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:48:20.102980 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:48:20.102980 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:48:20.102980 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:48:20.102980 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:48:20.102980 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 14 12:48:20.102980 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 14 12:48:20.102980 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 14 12:48:20.103930 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 14 12:48:20.103930 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:48:20.103930 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:48:20.103930 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:48:20.103930 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:48:20.103930 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:48:20.103930 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:48:20.103930 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:48:20.103930 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 14 12:48:20.103930 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:48:20.103930 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:48:20.103930 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:48:20.103930 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:48:20.103930 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:48:20.103930 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:48:20.103930 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:48:20.103930 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:48:20.104851 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 14 12:48:20.104851 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 14 12:48:20.104851 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 14 12:48:20.104851 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 14 12:48:20.104851 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 14 12:48:20.104851 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 14 12:48:20.104851 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 12:48:20.104851 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 14 12:48:20.109230 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 245/479] 10.222.0.17 () {56 vars in 1111 bytes} [Fri Oct 14 12:48:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:48:20.110414 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71facb5-874e-485b-8b96-32caf2794d9e None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:20.110698 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71facb5-874e-485b-8b96-32caf2794d9e None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:20.110971 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71facb5-874e-485b-8b96-32caf2794d9e None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:20.114168 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 246/480] 10.222.0.17 () {54 vars in 927 bytes} [Fri Oct 14 12:48:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:48:20.114168 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71facb5-874e-485b-8b96-32caf2794d9e None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:20.159488 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5a96aa-783f-4fa1-b56a-cc7ffa139f18 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:20.199096 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3197db6-2691-44d0-b37b-16ba7c618248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:20.199726 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3197db6-2691-44d0-b37b-16ba7c618248 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:20.200170 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3197db6-2691-44d0-b37b-16ba7c618248 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:20.200445 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3197db6-2691-44d0-b37b-16ba7c618248 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:20.210029 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3197db6-2691-44d0-b37b-16ba7c618248 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:20.211870 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3197db6-2691-44d0-b37b-16ba7c618248 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:20.229574 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-b3197db6-2691-44d0-b37b-16ba7c618248 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 12:48:20.229574 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:20.229574 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:48:20.229574 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:48:20.229574 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:48:20.229574 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:48:20.229574 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:48:20.229574 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:48:20.229574 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:48:20.229574 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:48:20.229574 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:48:20.229574 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:48:20.229574 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 14 12:48:20.229574 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 14 12:48:20.229574 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 14 12:48:20.231477 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 14 12:48:20.231477 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:48:20.231477 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:48:20.231477 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:48:20.231477 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:48:20.231477 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:48:20.231477 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:48:20.231477 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:48:20.231477 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 14 12:48:20.231477 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:48:20.231477 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:48:20.231477 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:48:20.231477 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:48:20.231477 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:48:20.231477 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:48:20.231477 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:48:20.231477 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:48:20.232706 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 14 12:48:20.232706 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 14 12:48:20.232706 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 14 12:48:20.232706 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 14 12:48:20.232706 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 14 12:48:20.232706 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 14 12:48:20.232706 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 12:48:20.232706 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 14 12:48:20.235822 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 235/481] 10.222.0.17 () {56 vars in 1111 bytes} [Fri Oct 14 12:48:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:48:20.236704 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3197db6-2691-44d0-b37b-16ba7c618248 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:20.241405 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:20.254809 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71facb5-874e-485b-8b96-32caf2794d9e None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:20.295995 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e7003a-8432-4760-b150-4bdab9aa967a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:20.296648 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e7003a-8432-4760-b150-4bdab9aa967a None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:20.296928 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e7003a-8432-4760-b150-4bdab9aa967a None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:20.297315 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e7003a-8432-4760-b150-4bdab9aa967a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:20.305221 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e7003a-8432-4760-b150-4bdab9aa967a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:20.306874 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e7003a-8432-4760-b150-4bdab9aa967a None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:20.320270 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-22e7003a-8432-4760-b150-4bdab9aa967a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 12:48:20.320270 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:20.320270 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:48:20.320270 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:48:20.320270 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:48:20.320270 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:48:20.320270 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:48:20.320270 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:48:20.320270 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:48:20.320270 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:48:20.320270 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:48:20.320270 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:48:20.320270 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 14 12:48:20.320270 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 14 12:48:20.320270 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 14 12:48:20.321829 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 14 12:48:20.321829 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:48:20.321829 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:48:20.321829 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:48:20.321829 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:48:20.321829 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:48:20.321829 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:48:20.321829 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:48:20.321829 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 14 12:48:20.321829 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:48:20.321829 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:48:20.321829 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:48:20.321829 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:48:20.321829 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:48:20.321829 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:48:20.321829 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:48:20.321829 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:48:20.323232 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 14 12:48:20.323232 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 14 12:48:20.323232 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 14 12:48:20.323232 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 14 12:48:20.323232 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 14 12:48:20.323232 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 14 12:48:20.323232 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 12:48:20.323232 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 14 12:48:20.323232 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 247/482] 10.222.0.17 () {56 vars in 1111 bytes} [Fri Oct 14 12:48:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:48:20.323232 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32e8ded-dd82-41c1-8a43-dcb0abd3ce5f None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:20.324222 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32e8ded-dd82-41c1-8a43-dcb0abd3ce5f None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:20.324222 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32e8ded-dd82-41c1-8a43-dcb0abd3ce5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:20.348413 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-b32e8ded-dd82-41c1-8a43-dcb0abd3ce5f None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:48:20.349646 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-b32e8ded-dd82-41c1-8a43-dcb0abd3ce5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:48:20.389610 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3197db6-2691-44d0-b37b-16ba7c618248 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:20.392247 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:20.429912 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c2248b-5046-44a2-bb8d-045235bb8317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:20.430760 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c2248b-5046-44a2-bb8d-045235bb8317 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:20.431412 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c2248b-5046-44a2-bb8d-045235bb8317 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:20.431697 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c2248b-5046-44a2-bb8d-045235bb8317 None admin] PATH_INFO: `/v3/projects` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:20.432561 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c2248b-5046-44a2-bb8d-045235bb8317 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:20.432875 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c2248b-5046-44a2-bb8d-045235bb8317 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:20.434439 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c2248b-5046-44a2-bb8d-045235bb8317 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:20.443186 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 248/483] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Oct 14 12:48:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 12:48:20.443787 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32e8ded-dd82-41c1-8a43-dcb0abd3ce5f None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:20.467463 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 236/484] 10.222.0.17 () {56 vars in 1148 bytes} [Fri Oct 14 12:48:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:20.468812 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c2248b-5046-44a2-bb8d-045235bb8317 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:20.548513 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:20.565879 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32e8ded-dd82-41c1-8a43-dcb0abd3ce5f None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:20.596654 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c2248b-5046-44a2-bb8d-045235bb8317 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:20.611922 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a95783-7a58-40a9-b675-691fc7495dd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:20.613094 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a95783-7a58-40a9-b675-691fc7495dd2 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:20.613373 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a95783-7a58-40a9-b675-691fc7495dd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:20.613644 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a95783-7a58-40a9-b675-691fc7495dd2 None admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:20.614374 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a95783-7a58-40a9-b675-691fc7495dd2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:20.614676 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a95783-7a58-40a9-b675-691fc7495dd2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:20.616109 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a95783-7a58-40a9-b675-691fc7495dd2 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:20.631468 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 249/485] 10.222.0.17 () {56 vars in 1148 bytes} [Fri Oct 14 12:48:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:20.632730 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a95783-7a58-40a9-b675-691fc7495dd2 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:20.638405 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b823c7e-f287-4d80-a872-3c6aa21bc8b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:20.639018 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b823c7e-f287-4d80-a872-3c6aa21bc8b6 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:20.639292 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b823c7e-f287-4d80-a872-3c6aa21bc8b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:20.639557 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b823c7e-f287-4d80-a872-3c6aa21bc8b6 None admin] PATH_INFO: `/v3/projects` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:20.640250 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b823c7e-f287-4d80-a872-3c6aa21bc8b6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:20.640552 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b823c7e-f287-4d80-a872-3c6aa21bc8b6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:20.641972 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b823c7e-f287-4d80-a872-3c6aa21bc8b6 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:20.659428 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 237/486] 10.222.0.17 () {56 vars in 1148 bytes} [Fri Oct 14 12:48:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:20.659428 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2f4bf6-538a-4ecd-ac90-3a8e8b0cf1b0 None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:20.659428 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2f4bf6-538a-4ecd-ac90-3a8e8b0cf1b0 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:20.659428 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2f4bf6-538a-4ecd-ac90-3a8e8b0cf1b0 None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:20.659428 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 238/487] 10.222.0.17 () {54 vars in 927 bytes} [Fri Oct 14 12:48:20 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:48:20.659428 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2f4bf6-538a-4ecd-ac90-3a8e8b0cf1b0 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:20.680412 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:20.757486 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a95783-7a58-40a9-b675-691fc7495dd2 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:20.770714 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2f4bf6-538a-4ecd-ac90-3a8e8b0cf1b0 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:20.790998 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062c991b-9b13-488d-8226-79a54cfd212d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:20.791599 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062c991b-9b13-488d-8226-79a54cfd212d None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:20.791878 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062c991b-9b13-488d-8226-79a54cfd212d None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:20.792148 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062c991b-9b13-488d-8226-79a54cfd212d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:20.792870 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062c991b-9b13-488d-8226-79a54cfd212d None admin] RBAC: Adding query filter params (role.id=2d0a16b1c5634daf99f2b7ac092d1ddd, scope.project.id=2486e73d493b40e18d9d988744993854, user.id=a0de24488ed54df29d8da344d76651d2) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:20.793186 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062c991b-9b13-488d-8226-79a54cfd212d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:20.793325 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:20.794887 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062c991b-9b13-488d-8226-79a54cfd212d None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:20.801402 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 250/488] 10.222.0.17 () {56 vars in 1374 bytes} [Fri Oct 14 12:48:20 2022] GET /identity/v3/role_assignments?user.id=a0de24488ed54df29d8da344d76651d2&scope.project.id=2486e73d493b40e18d9d988744993854&role.id=2d0a16b1c5634daf99f2b7ac092d1ddd => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:20.802158 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062c991b-9b13-488d-8226-79a54cfd212d None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:20.806344 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534b59c6-cd13-43e8-af31-1d61cf992186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:20.807008 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534b59c6-cd13-43e8-af31-1d61cf992186 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:20.807290 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534b59c6-cd13-43e8-af31-1d61cf992186 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:20.807567 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534b59c6-cd13-43e8-af31-1d61cf992186 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:20.808317 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534b59c6-cd13-43e8-af31-1d61cf992186 None admin] RBAC: Adding query filter params (role.id=2d0a16b1c5634daf99f2b7ac092d1ddd, scope.project.id=2486e73d493b40e18d9d988744993854, user.id=b2d483292f3a4794848fcacfba5b107e) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:20.808631 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534b59c6-cd13-43e8-af31-1d61cf992186 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:20.810146 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534b59c6-cd13-43e8-af31-1d61cf992186 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:20.830370 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 239/489] 10.222.0.17 () {56 vars in 1374 bytes} [Fri Oct 14 12:48:20 2022] GET /identity/v3/role_assignments?user.id=b2d483292f3a4794848fcacfba5b107e&scope.project.id=2486e73d493b40e18d9d988744993854&role.id=2d0a16b1c5634daf99f2b7ac092d1ddd => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:20.830370 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd9314c-a9b1-415d-b92f-24c889240677 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:20.830370 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd9314c-a9b1-415d-b92f-24c889240677 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:20.830370 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd9314c-a9b1-415d-b92f-24c889240677 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:20.863363 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-ffd9314c-a9b1-415d-b92f-24c889240677 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:48:20.865404 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-ffd9314c-a9b1-415d-b92f-24c889240677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:48:20.921331 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:20.933471 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062c991b-9b13-488d-8226-79a54cfd212d None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:20.966749 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 240/490] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Oct 14 12:48:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 12:48:20.968232 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd9314c-a9b1-415d-b92f-24c889240677 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:20.975642 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97924ea6-4171-4542-8c6c-a81889298c97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:20.976474 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97924ea6-4171-4542-8c6c-a81889298c97 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:20.976818 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97924ea6-4171-4542-8c6c-a81889298c97 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:20.977166 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97924ea6-4171-4542-8c6c-a81889298c97 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:20.977986 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97924ea6-4171-4542-8c6c-a81889298c97 None admin] RBAC: Adding query filter params (role.id=2d0a16b1c5634daf99f2b7ac092d1ddd, scope.project.id=2486e73d493b40e18d9d988744993854, user.id=76c3c564b8c548e4beef1cbfba2ad343) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:20.978396 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97924ea6-4171-4542-8c6c-a81889298c97 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:20.987815 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97924ea6-4171-4542-8c6c-a81889298c97 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:20.993543 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 251/491] 10.222.0.17 () {56 vars in 1374 bytes} [Fri Oct 14 12:48:20 2022] GET /identity/v3/role_assignments?user.id=76c3c564b8c548e4beef1cbfba2ad343&scope.project.id=2486e73d493b40e18d9d988744993854&role.id=2d0a16b1c5634daf99f2b7ac092d1ddd => generated 608 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:21.139661 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd9314c-a9b1-415d-b92f-24c889240677 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:21.161448 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:21.183819 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7dd3e5-1e2f-49ef-9411-d2d302ea67e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:21.184474 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7dd3e5-1e2f-49ef-9411-d2d302ea67e6 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:21.184756 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7dd3e5-1e2f-49ef-9411-d2d302ea67e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:21.185034 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7dd3e5-1e2f-49ef-9411-d2d302ea67e6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:21.197770 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7dd3e5-1e2f-49ef-9411-d2d302ea67e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 12:48:21.202771 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-2b7dd3e5-1e2f-49ef-9411-d2d302ea67e6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 14 12:48:21.202771 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:21.202771 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:48:21.202771 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:48:21.202771 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:48:21.202771 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:48:21.202771 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:48:21.202771 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:48:21.202771 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:48:21.202771 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:48:21.202771 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:48:21.202771 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:48:21.202771 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 12:48:21.202771 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 12:48:21.202771 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 12:48:21.202771 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 12:48:21.203657 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 12:48:21.203657 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 12:48:21.203657 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 12:48:21.203657 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 12:48:21.203657 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:48:21.203657 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:48:21.203657 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:48:21.203657 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:48:21.203657 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:48:21.203657 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:48:21.203657 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:48:21.203657 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 14 12:48:21.203657 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:48:21.203657 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:48:21.203657 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:48:21.203657 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:48:21.204888 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:48:21.204888 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:48:21.204888 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:48:21.204888 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:48:21.204888 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 12:48:21.204888 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 12:48:21.204888 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 12:48:21.204888 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 12:48:21.204888 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 12:48:21.204888 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 12:48:21.204888 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 14 12:48:21.204888 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 14 12:48:21.204888 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 241/492] 10.222.0.17 () {56 vars in 1096 bytes} [Fri Oct 14 12:48:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:48:21.210297 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97924ea6-4171-4542-8c6c-a81889298c97 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:21.300572 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7dd3e5-1e2f-49ef-9411-d2d302ea67e6 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:21.341383 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97924ea6-4171-4542-8c6c-a81889298c97 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:21.391201 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa56085b-1f8a-4612-9c80-45416985b3ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:21.391810 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa56085b-1f8a-4612-9c80-45416985b3ae None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:21.392092 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa56085b-1f8a-4612-9c80-45416985b3ae None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:21.392364 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa56085b-1f8a-4612-9c80-45416985b3ae None admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:21.393092 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa56085b-1f8a-4612-9c80-45416985b3ae None admin] RBAC: Adding query filter params (name=admin) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:21.393947 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa56085b-1f8a-4612-9c80-45416985b3ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:21.395542 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa56085b-1f8a-4612-9c80-45416985b3ae None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:21.405433 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 252/493] 10.222.0.17 () {56 vars in 1099 bytes} [Fri Oct 14 12:48:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:21.411702 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa56085b-1f8a-4612-9c80-45416985b3ae None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:21.433950 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7dd3e5-1e2f-49ef-9411-d2d302ea67e6 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:21.437371 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:21.484419 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b24922-7f31-4162-aac4-5864d4cb15e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:21.485063 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b24922-7f31-4162-aac4-5864d4cb15e4 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:21.485342 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b24922-7f31-4162-aac4-5864d4cb15e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:21.485619 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b24922-7f31-4162-aac4-5864d4cb15e4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:21.507799 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b24922-7f31-4162-aac4-5864d4cb15e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 12:48:21.512739 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-71b24922-7f31-4162-aac4-5864d4cb15e4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 14 12:48:21.512739 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:21.512739 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:48:21.512739 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:48:21.512739 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:48:21.512739 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:48:21.512739 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:48:21.512739 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:48:21.512739 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:48:21.512739 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:48:21.512739 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:48:21.512739 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:48:21.512739 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 12:48:21.512739 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 12:48:21.512739 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 12:48:21.512739 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 12:48:21.514186 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 12:48:21.514186 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 12:48:21.514186 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 12:48:21.514186 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 12:48:21.514186 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:48:21.514186 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:48:21.514186 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:48:21.514186 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:48:21.514186 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:48:21.514186 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:48:21.514186 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:48:21.514186 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 14 12:48:21.514186 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:48:21.514186 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:48:21.514186 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:48:21.514186 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:48:21.515498 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:48:21.515498 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:48:21.515498 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:48:21.515498 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:48:21.515498 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 12:48:21.515498 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 12:48:21.515498 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 12:48:21.515498 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 12:48:21.515498 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 12:48:21.515498 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 12:48:21.515498 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 14 12:48:21.515498 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 14 12:48:21.522204 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 242/494] 10.222.0.17 () {56 vars in 1102 bytes} [Fri Oct 14 12:48:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:48:21.531167 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b24922-7f31-4162-aac4-5864d4cb15e4 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:21.576283 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa56085b-1f8a-4612-9c80-45416985b3ae None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:21.629651 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:21.662272 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0826a510-9889-4545-9200-b1ee03299da1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:21.663624 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0826a510-9889-4545-9200-b1ee03299da1 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:21.664122 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0826a510-9889-4545-9200-b1ee03299da1 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:21.664602 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0826a510-9889-4545-9200-b1ee03299da1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:21.689209 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0826a510-9889-4545-9200-b1ee03299da1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:21.695454 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0826a510-9889-4545-9200-b1ee03299da1 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:21.715131 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b24922-7f31-4162-aac4-5864d4cb15e4 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:21.718876 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-0826a510-9889-4545-9200-b1ee03299da1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:48:21.718876 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:21.718876 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:48:21.718876 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:48:21.718876 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:48:21.718876 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:48:21.718876 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:48:21.718876 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:48:21.718876 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:48:21.718876 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:48:21.718876 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:48:21.718876 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:48:21.718876 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 12:48:21.718876 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 12:48:21.718876 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 12:48:21.718876 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 12:48:21.719776 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:48:21.719776 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:48:21.719776 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:48:21.719776 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:48:21.719776 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:48:21.719776 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:48:21.719776 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:48:21.719776 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 14 12:48:21.719776 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:48:21.719776 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:48:21.719776 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:48:21.719776 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:48:21.719776 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:48:21.719776 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:48:21.719776 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:48:21.719776 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:48:21.719776 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 12:48:21.720807 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 12:48:21.720807 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:48:21.720807 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 14 12:48:21.730924 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 253/495] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Oct 14 12:48:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:48:21.731899 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0826a510-9889-4545-9200-b1ee03299da1 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:21.751952 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81924b19-d552-4a61-b259-7720ccee0077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:21.753395 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81924b19-d552-4a61-b259-7720ccee0077 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:21.753807 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81924b19-d552-4a61-b259-7720ccee0077 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:21.754110 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81924b19-d552-4a61-b259-7720ccee0077 None admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:21.754833 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81924b19-d552-4a61-b259-7720ccee0077 None admin] RBAC: Adding query filter params (name=service) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:21.755143 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81924b19-d552-4a61-b259-7720ccee0077 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:21.756580 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81924b19-d552-4a61-b259-7720ccee0077 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:21.766352 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 243/496] 10.222.0.17 () {56 vars in 1103 bytes} [Fri Oct 14 12:48:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:21.773451 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81924b19-d552-4a61-b259-7720ccee0077 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:21.874841 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:21.917331 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:21.923042 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81924b19-d552-4a61-b259-7720ccee0077 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:21.947734 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0826a510-9889-4545-9200-b1ee03299da1 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:21.996189 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8aa2f2f-c552-483c-9b19-dea7ab462487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:21.996820 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aa2f2f-c552-483c-9b19-dea7ab462487 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:21.997102 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aa2f2f-c552-483c-9b19-dea7ab462487 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:21.997373 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aa2f2f-c552-483c-9b19-dea7ab462487 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:22.015567 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8aa2f2f-c552-483c-9b19-dea7ab462487 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:22.017032 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8aa2f2f-c552-483c-9b19-dea7ab462487 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:22.019103 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f9c339-e2e6-4724-9fc0-0773684bddc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:22.019724 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f9c339-e2e6-4724-9fc0-0773684bddc6 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:22.020003 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f9c339-e2e6-4724-9fc0-0773684bddc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:22.020275 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f9c339-e2e6-4724-9fc0-0773684bddc6 None admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:22.020920 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f9c339-e2e6-4724-9fc0-0773684bddc6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:22.021227 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f9c339-e2e6-4724-9fc0-0773684bddc6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:22.022630 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f9c339-e2e6-4724-9fc0-0773684bddc6 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:22.046280 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-a8aa2f2f-c552-483c-9b19-dea7ab462487 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:48:22.046280 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:22.046280 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:48:22.046280 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:48:22.046280 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:48:22.046280 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:48:22.046280 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:48:22.046280 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:48:22.046280 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:48:22.046280 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:48:22.046280 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:48:22.046280 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:48:22.046280 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 12:48:22.046280 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 12:48:22.046280 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 12:48:22.046280 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 12:48:22.047235 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:48:22.047235 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:48:22.047235 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:48:22.047235 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:48:22.047235 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:48:22.047235 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:48:22.047235 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:48:22.047235 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 14 12:48:22.047235 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:48:22.047235 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:48:22.047235 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:48:22.047235 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:48:22.047235 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:48:22.047235 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:48:22.047235 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:48:22.047235 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:48:22.047235 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 12:48:22.048183 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 12:48:22.048183 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:48:22.048183 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 14 12:48:22.048348 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 254/497] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Oct 14 12:48:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:22.048419 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 244/498] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Oct 14 12:48:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 14 12:48:22.054729 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f9c339-e2e6-4724-9fc0-0773684bddc6 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:22.055259 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8aa2f2f-c552-483c-9b19-dea7ab462487 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:22.165070 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8aa2f2f-c552-483c-9b19-dea7ab462487 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:22.200823 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e406d2f7-9c50-4f4d-922b-ef929ed59f69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:22.201346 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e406d2f7-9c50-4f4d-922b-ef929ed59f69 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:22.201627 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e406d2f7-9c50-4f4d-922b-ef929ed59f69 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:22.201903 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e406d2f7-9c50-4f4d-922b-ef929ed59f69 None admin] PATH_INFO: `/v3/domains` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:22.202586 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e406d2f7-9c50-4f4d-922b-ef929ed59f69 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:22.202890 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e406d2f7-9c50-4f4d-922b-ef929ed59f69 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:22.204312 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e406d2f7-9c50-4f4d-922b-ef929ed59f69 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:22.217075 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 245/499] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Oct 14 12:48:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:22.223316 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e406d2f7-9c50-4f4d-922b-ef929ed59f69 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:22.241237 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:22.267068 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f9c339-e2e6-4724-9fc0-0773684bddc6 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:22.325585 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:22.338552 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e406d2f7-9c50-4f4d-922b-ef929ed59f69 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:22.340238 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f41b5cc-f577-40eb-9128-db9a529d3454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:22.340957 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f41b5cc-f577-40eb-9128-db9a529d3454 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:22.341242 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f41b5cc-f577-40eb-9128-db9a529d3454 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:22.341516 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f41b5cc-f577-40eb-9128-db9a529d3454 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:22.359906 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f41b5cc-f577-40eb-9128-db9a529d3454 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:22.361391 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f41b5cc-f577-40eb-9128-db9a529d3454 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:22.382840 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-4f41b5cc-f577-40eb-9128-db9a529d3454 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 14 12:48:22.382840 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:22.382840 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:48:22.382840 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:48:22.382840 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:48:22.382840 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:48:22.382840 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:48:22.382840 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:48:22.382840 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:48:22.382840 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:48:22.382840 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:48:22.382840 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:48:22.382840 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 14 12:48:22.382840 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 14 12:48:22.382840 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 14 12:48:22.382840 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 14 12:48:22.383922 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:48:22.383922 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:48:22.383922 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 14 12:48:22.383922 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 12:48:22.383922 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 14 12:48:22.383922 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 12:48:22.383922 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:48:22.383922 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:48:22.383922 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:48:22.383922 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:48:22.383922 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:48:22.383922 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 14 12:48:22.383922 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:48:22.383922 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:48:22.383922 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:48:22.383922 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:48:22.383922 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:48:22.383922 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:48:22.385283 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:48:22.385283 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:48:22.385283 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 14 12:48:22.385283 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 14 12:48:22.385283 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 14 12:48:22.385283 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 14 12:48:22.385283 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 14 12:48:22.385283 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 14 12:48:22.385283 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 14 12:48:22.385283 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 14 12:48:22.385283 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 255/500] 10.222.0.17 () {56 vars in 1093 bytes} [Fri Oct 14 12:48:22 2022] GET /identity/v3/users/nova => generated 82 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:48:22.389513 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f41b5cc-f577-40eb-9128-db9a529d3454 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:22.390821 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e662471a-1e18-4b9a-93b4-e6dd90646da3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:22.391463 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e662471a-1e18-4b9a-93b4-e6dd90646da3 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:22.391739 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e662471a-1e18-4b9a-93b4-e6dd90646da3 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:22.392010 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e662471a-1e18-4b9a-93b4-e6dd90646da3 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:22.416970 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e662471a-1e18-4b9a-93b4-e6dd90646da3 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:22.421440 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e662471a-1e18-4b9a-93b4-e6dd90646da3 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:22.447189 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-e662471a-1e18-4b9a-93b4-e6dd90646da3 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 14 12:48:22.447189 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:22.447189 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:48:22.447189 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:48:22.447189 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:48:22.447189 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:48:22.447189 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:48:22.447189 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:48:22.447189 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:48:22.447189 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:48:22.447189 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:48:22.447189 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:48:22.447189 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 14 12:48:22.447189 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 14 12:48:22.447189 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 14 12:48:22.447189 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 14 12:48:22.448385 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:48:22.448385 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:48:22.448385 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 14 12:48:22.448385 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 12:48:22.448385 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 14 12:48:22.448385 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 12:48:22.448385 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:48:22.448385 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:48:22.448385 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:48:22.448385 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:48:22.448385 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:48:22.448385 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 14 12:48:22.448385 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:48:22.448385 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:48:22.448385 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:48:22.448385 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:48:22.448385 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:48:22.448385 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:48:22.449304 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:48:22.449304 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:48:22.449304 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 14 12:48:22.449304 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 14 12:48:22.449304 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 14 12:48:22.449304 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 14 12:48:22.449304 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 14 12:48:22.449304 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 14 12:48:22.449304 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 14 12:48:22.449304 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 14 12:48:22.449304 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 246/501] 10.222.0.17 () {56 vars in 1096 bytes} [Fri Oct 14 12:48:22 2022] GET /identity/v3/users/swift => generated 83 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:48:22.457216 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e662471a-1e18-4b9a-93b4-e6dd90646da3 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:22.547927 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f41b5cc-f577-40eb-9128-db9a529d3454 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:22.590540 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b84a2f-5162-4374-b7b5-14773be9eb1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:22.591298 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b84a2f-5162-4374-b7b5-14773be9eb1b None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:22.591649 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b84a2f-5162-4374-b7b5-14773be9eb1b None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:22.591923 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b84a2f-5162-4374-b7b5-14773be9eb1b None admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:22.592662 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b84a2f-5162-4374-b7b5-14773be9eb1b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:22.592975 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b84a2f-5162-4374-b7b5-14773be9eb1b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:22.594591 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b84a2f-5162-4374-b7b5-14773be9eb1b None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:22.614925 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 256/502] 10.222.0.17 () {56 vars in 1133 bytes} [Fri Oct 14 12:48:22 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:22.623178 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b84a2f-5162-4374-b7b5-14773be9eb1b None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:22.623432 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:22.656008 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e662471a-1e18-4b9a-93b4-e6dd90646da3 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:22.697394 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f092301-2b08-4cdb-a67f-90ea61d5ef9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:22.698009 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f092301-2b08-4cdb-a67f-90ea61d5ef9b None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:22.698317 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f092301-2b08-4cdb-a67f-90ea61d5ef9b None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:22.698592 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f092301-2b08-4cdb-a67f-90ea61d5ef9b None admin] PATH_INFO: `/v3/users` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:22.699340 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f092301-2b08-4cdb-a67f-90ea61d5ef9b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:22.699705 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f092301-2b08-4cdb-a67f-90ea61d5ef9b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:22.701210 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f092301-2b08-4cdb-a67f-90ea61d5ef9b None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:22.722170 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 247/503] 10.222.0.17 () {56 vars in 1135 bytes} [Fri Oct 14 12:48:22 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:22.727785 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f092301-2b08-4cdb-a67f-90ea61d5ef9b None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:22.738194 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:22.825206 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b84a2f-5162-4374-b7b5-14773be9eb1b None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:22.893973 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f092301-2b08-4cdb-a67f-90ea61d5ef9b None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:22.926621 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:22.927801 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f6982a-5352-4485-87b3-5495dd1d365b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:22.928588 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f6982a-5352-4485-87b3-5495dd1d365b None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:22.928797 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f6982a-5352-4485-87b3-5495dd1d365b None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:22.929053 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f6982a-5352-4485-87b3-5495dd1d365b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:22.939741 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f6982a-5352-4485-87b3-5495dd1d365b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:22.941351 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f6982a-5352-4485-87b3-5495dd1d365b None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:22.947340 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50e2f0f-ec2c-409a-9a0f-cfbdb9da9b53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:22.948294 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50e2f0f-ec2c-409a-9a0f-cfbdb9da9b53 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:22.948781 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50e2f0f-ec2c-409a-9a0f-cfbdb9da9b53 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:22.949262 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50e2f0f-ec2c-409a-9a0f-cfbdb9da9b53 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:22.957817 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-28f6982a-5352-4485-87b3-5495dd1d365b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:48:22.957817 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:22.957817 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:48:22.957817 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:48:22.957817 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:48:22.957817 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:48:22.957817 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:48:22.957817 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:48:22.957817 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:48:22.957817 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:48:22.957817 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:48:22.957817 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:48:22.957817 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 12:48:22.957817 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 12:48:22.957817 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 12:48:22.957817 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 12:48:22.958916 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:48:22.958916 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:48:22.958916 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:48:22.958916 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:48:22.958916 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:48:22.958916 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:48:22.958916 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:48:22.958916 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 14 12:48:22.958916 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:48:22.958916 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:48:22.958916 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:48:22.958916 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:48:22.958916 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:48:22.958916 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:48:22.958916 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:48:22.958916 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:48:22.958916 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 12:48:22.959809 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 12:48:22.959809 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:48:22.959809 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 14 12:48:22.959809 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 257/504] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Oct 14 12:48:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:48:22.979647 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f6982a-5352-4485-87b3-5495dd1d365b None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:23.037905 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50e2f0f-ec2c-409a-9a0f-cfbdb9da9b53 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:23.039741 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50e2f0f-ec2c-409a-9a0f-cfbdb9da9b53 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:23.146527 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 248/505] 10.222.0.17 () {58 vars in 1282 bytes} [Fri Oct 14 12:48:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 14 12:48:23.152795 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50e2f0f-ec2c-409a-9a0f-cfbdb9da9b53 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:23.193505 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:23.253491 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:23.257716 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f6982a-5352-4485-87b3-5495dd1d365b None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:23.322761 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadad11a-8089-400f-bd92-80bccba76abf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:23.323376 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadad11a-8089-400f-bd92-80bccba76abf None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:23.323649 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadad11a-8089-400f-bd92-80bccba76abf None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:23.323917 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadad11a-8089-400f-bd92-80bccba76abf None admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:23.324569 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadad11a-8089-400f-bd92-80bccba76abf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:23.324870 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadad11a-8089-400f-bd92-80bccba76abf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:23.326284 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadad11a-8089-400f-bd92-80bccba76abf None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:23.339359 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50e2f0f-ec2c-409a-9a0f-cfbdb9da9b53 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:23.348793 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 258/506] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Oct 14 12:48:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 365 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:23.348793 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a13e1ec-6185-4cc3-9d93-4a7feed216c6 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:23.348793 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a13e1ec-6185-4cc3-9d93-4a7feed216c6 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:23.348793 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a13e1ec-6185-4cc3-9d93-4a7feed216c6 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:23.349735 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 259/507] 10.222.0.17 () {54 vars in 927 bytes} [Fri Oct 14 12:48:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:48:23.350835 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a13e1ec-6185-4cc3-9d93-4a7feed216c6 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:23.381422 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c3fa93-4145-4a8c-b77d-3d67b9af00e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:23.382544 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c3fa93-4145-4a8c-b77d-3d67b9af00e5 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:23.383087 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c3fa93-4145-4a8c-b77d-3d67b9af00e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:23.383370 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c3fa93-4145-4a8c-b77d-3d67b9af00e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:23.396156 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c3fa93-4145-4a8c-b77d-3d67b9af00e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:23.397639 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c3fa93-4145-4a8c-b77d-3d67b9af00e5 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:23.415959 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-73c3fa93-4145-4a8c-b77d-3d67b9af00e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:48:23.415959 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:23.415959 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:48:23.415959 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:48:23.415959 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:48:23.415959 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:48:23.415959 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:48:23.415959 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:48:23.415959 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:48:23.415959 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:48:23.415959 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:48:23.415959 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:48:23.415959 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 12:48:23.415959 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 12:48:23.415959 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 12:48:23.415959 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 12:48:23.416959 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:48:23.416959 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:48:23.416959 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:48:23.416959 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:48:23.416959 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:48:23.416959 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:48:23.416959 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:48:23.416959 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 14 12:48:23.416959 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:48:23.416959 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:48:23.416959 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:48:23.416959 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:48:23.416959 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:48:23.416959 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:48:23.416959 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:48:23.416959 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:48:23.416959 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 12:48:23.417840 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 12:48:23.417840 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:48:23.417840 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 14 12:48:23.418410 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 249/508] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Oct 14 12:48:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:48:23.419339 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f49dca-8602-41ed-987d-760d5e5b7fbf None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:23.419869 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f49dca-8602-41ed-987d-760d5e5b7fbf None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:23.419869 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f49dca-8602-41ed-987d-760d5e5b7fbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:23.441665 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-07f49dca-8602-41ed-987d-760d5e5b7fbf None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:48:23.442891 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-07f49dca-8602-41ed-987d-760d5e5b7fbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:48:23.473510 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a13e1ec-6185-4cc3-9d93-4a7feed216c6 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:23.512641 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32a2ecd-a339-4230-abce-3c5781d7dd95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:23.513388 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32a2ecd-a339-4230-abce-3c5781d7dd95 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:23.513750 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32a2ecd-a339-4230-abce-3c5781d7dd95 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:23.514187 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32a2ecd-a339-4230-abce-3c5781d7dd95 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:23.523128 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32a2ecd-a339-4230-abce-3c5781d7dd95 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:23.524757 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32a2ecd-a339-4230-abce-3c5781d7dd95 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:23.526071 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 250/509] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Oct 14 12:48:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 12:48:23.527063 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f49dca-8602-41ed-987d-760d5e5b7fbf None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:23.538628 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-f32a2ecd-a339-4230-abce-3c5781d7dd95 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 12:48:23.538628 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:23.538628 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:48:23.538628 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:48:23.538628 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:48:23.538628 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:48:23.538628 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:48:23.538628 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:48:23.538628 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:48:23.538628 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:48:23.538628 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:48:23.538628 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:48:23.538628 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 14 12:48:23.538628 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 14 12:48:23.538628 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 14 12:48:23.540429 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 14 12:48:23.540429 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:48:23.540429 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:48:23.540429 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:48:23.540429 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:48:23.540429 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:48:23.540429 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:48:23.540429 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:48:23.540429 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 14 12:48:23.540429 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:48:23.540429 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:48:23.540429 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:48:23.540429 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:48:23.540429 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:48:23.540429 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:48:23.540429 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:48:23.540429 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:48:23.542080 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 14 12:48:23.542080 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 14 12:48:23.542080 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 14 12:48:23.542080 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 14 12:48:23.542080 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 14 12:48:23.542080 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 14 12:48:23.542080 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 12:48:23.542080 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 14 12:48:23.542080 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 260/510] 10.222.0.17 () {56 vars in 1111 bytes} [Fri Oct 14 12:48:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:48:23.542708 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:23.559170 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32a2ecd-a339-4230-abce-3c5781d7dd95 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:23.607565 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:23.681023 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f49dca-8602-41ed-987d-760d5e5b7fbf None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:23.753108 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32a2ecd-a339-4230-abce-3c5781d7dd95 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:23.756127 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccd26fa-798b-4fa6-b1a8-8f7295663fb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:23.756786 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccd26fa-798b-4fa6-b1a8-8f7295663fb6 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:23.757067 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccd26fa-798b-4fa6-b1a8-8f7295663fb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:23.757338 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccd26fa-798b-4fa6-b1a8-8f7295663fb6 None admin] PATH_INFO: `/v3/domains` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:23.757988 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccd26fa-798b-4fa6-b1a8-8f7295663fb6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:23.758316 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccd26fa-798b-4fa6-b1a8-8f7295663fb6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:23.759700 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccd26fa-798b-4fa6-b1a8-8f7295663fb6 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:23.782459 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 251/511] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Oct 14 12:48:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:23.786484 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccd26fa-798b-4fa6-b1a8-8f7295663fb6 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:23.835257 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843d085e-0b3a-4d52-b7b4-6e59abe9e07c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:23.835879 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843d085e-0b3a-4d52-b7b4-6e59abe9e07c None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:23.839348 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843d085e-0b3a-4d52-b7b4-6e59abe9e07c None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:23.839693 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843d085e-0b3a-4d52-b7b4-6e59abe9e07c None admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:23.840435 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843d085e-0b3a-4d52-b7b4-6e59abe9e07c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:23.840747 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843d085e-0b3a-4d52-b7b4-6e59abe9e07c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:23.842555 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843d085e-0b3a-4d52-b7b4-6e59abe9e07c None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:23.867965 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 261/512] 10.222.0.17 () {56 vars in 1148 bytes} [Fri Oct 14 12:48:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:23.876069 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843d085e-0b3a-4d52-b7b4-6e59abe9e07c None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:23.920957 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:23.953691 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccd26fa-798b-4fa6-b1a8-8f7295663fb6 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:23.989753 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42ed0ca-bce5-4faa-a078-5c5288cfbf1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:23.990410 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42ed0ca-bce5-4faa-a078-5c5288cfbf1c None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:23.990687 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42ed0ca-bce5-4faa-a078-5c5288cfbf1c None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:23.990958 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42ed0ca-bce5-4faa-a078-5c5288cfbf1c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:23.993086 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:23.998486 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42ed0ca-bce5-4faa-a078-5c5288cfbf1c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:23.999937 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42ed0ca-bce5-4faa-a078-5c5288cfbf1c None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:24.011305 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-d42ed0ca-bce5-4faa-a078-5c5288cfbf1c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 12:48:24.011305 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:24.011305 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:48:24.011305 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:48:24.011305 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:48:24.011305 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:48:24.011305 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:48:24.011305 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:48:24.011305 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:48:24.011305 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:48:24.011305 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:48:24.011305 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:48:24.011305 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 14 12:48:24.011305 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 14 12:48:24.011305 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 14 12:48:24.012853 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 14 12:48:24.012853 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:48:24.012853 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:48:24.012853 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:48:24.012853 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:48:24.012853 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:48:24.012853 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:48:24.012853 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:48:24.012853 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 14 12:48:24.012853 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:48:24.012853 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:48:24.012853 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:48:24.012853 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:48:24.012853 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:48:24.012853 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:48:24.012853 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:48:24.012853 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:48:24.014220 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 14 12:48:24.014220 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 14 12:48:24.014220 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 14 12:48:24.014220 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 14 12:48:24.014220 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 14 12:48:24.014220 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 14 12:48:24.014220 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 12:48:24.014220 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 14 12:48:24.014220 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 252/513] 10.222.0.17 () {56 vars in 1111 bytes} [Fri Oct 14 12:48:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:48:24.014220 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42ed0ca-bce5-4faa-a078-5c5288cfbf1c None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:24.020096 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843d085e-0b3a-4d52-b7b4-6e59abe9e07c None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:24.063238 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674d1152-6594-484a-a45a-759dd6faabe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:24.064229 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674d1152-6594-484a-a45a-759dd6faabe2 None admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:24.064727 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674d1152-6594-484a-a45a-759dd6faabe2 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:24.065211 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674d1152-6594-484a-a45a-759dd6faabe2 None admin] PATH_INFO: `/v3/projects/2486e73d493b40e18d9d988744993854/users/931f4e32c8764514b5efed31b0785be7/roles/7f6e29e390bc41f7a9af17659a2e95d1` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:24.067982 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674d1152-6594-484a-a45a-759dd6faabe2 None admin] RBAC: Authorizing `identity:create_grant(project_id=2486e73d493b40e18d9d988744993854, user_id=931f4e32c8764514b5efed31b0785be7, role_id=7f6e29e390bc41f7a9af17659a2e95d1)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:24.070362 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674d1152-6594-484a-a45a-759dd6faabe2 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:24.088528 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 262/514] 10.222.0.17 () {58 vars in 1439 bytes} [Fri Oct 14 12:48:23 2022] PUT /identity/v3/projects/2486e73d493b40e18d9d988744993854/users/931f4e32c8764514b5efed31b0785be7/roles/7f6e29e390bc41f7a9af17659a2e95d1 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 12:48:24.090415 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bd4ae0-e63f-4a03-b996-5fd774dfd485 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:24.090820 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bd4ae0-e63f-4a03-b996-5fd774dfd485 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:24.091199 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bd4ae0-e63f-4a03-b996-5fd774dfd485 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:24.093214 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 263/515] 10.222.0.17 () {54 vars in 927 bytes} [Fri Oct 14 12:48:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:48:24.097238 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665f80e8-674a-49a6-803d-6616c05e280b None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:24.097238 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665f80e8-674a-49a6-803d-6616c05e280b None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:24.097535 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665f80e8-674a-49a6-803d-6616c05e280b None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:24.100112 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 264/516] 10.222.0.17 () {54 vars in 927 bytes} [Fri Oct 14 12:48:24 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:48:24.101600 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665f80e8-674a-49a6-803d-6616c05e280b None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:24.153244 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42ed0ca-bce5-4faa-a078-5c5288cfbf1c None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:24.193097 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:24.200065 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9076a0d-bd53-4524-a47a-43c69b8c952f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:24.200725 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9076a0d-bd53-4524-a47a-43c69b8c952f None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:24.201006 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9076a0d-bd53-4524-a47a-43c69b8c952f None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:24.201289 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9076a0d-bd53-4524-a47a-43c69b8c952f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:24.219640 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9076a0d-bd53-4524-a47a-43c69b8c952f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:24.222811 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9076a0d-bd53-4524-a47a-43c69b8c952f None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:24.239282 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665f80e8-674a-49a6-803d-6616c05e280b None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:24.248592 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-b9076a0d-bd53-4524-a47a-43c69b8c952f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:48:24.248592 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:24.248592 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:48:24.248592 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:48:24.248592 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:48:24.248592 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:48:24.248592 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:48:24.248592 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:48:24.248592 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:48:24.248592 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:48:24.248592 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:48:24.248592 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:48:24.248592 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 12:48:24.248592 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 12:48:24.248592 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 12:48:24.248592 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 12:48:24.249620 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:48:24.249620 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:48:24.249620 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:48:24.249620 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:48:24.249620 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:48:24.249620 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:48:24.249620 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:48:24.249620 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 14 12:48:24.249620 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:48:24.249620 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:48:24.249620 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:48:24.249620 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:48:24.249620 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:48:24.249620 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:48:24.249620 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:48:24.249620 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:48:24.249620 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 12:48:24.250586 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 12:48:24.250586 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:48:24.250586 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 14 12:48:24.250586 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 253/517] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Oct 14 12:48:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:48:24.252413 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959ba5ec-ff41-43fb-afbd-d06e5dfe07ce None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:24.253854 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959ba5ec-ff41-43fb-afbd-d06e5dfe07ce None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:24.254568 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959ba5ec-ff41-43fb-afbd-d06e5dfe07ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:24.281693 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-959ba5ec-ff41-43fb-afbd-d06e5dfe07ce None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:48:24.283018 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-959ba5ec-ff41-43fb-afbd-d06e5dfe07ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:48:24.291137 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc95676-9097-4646-8745-c48d929daa7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:24.292228 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc95676-9097-4646-8745-c48d929daa7e None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:24.292508 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc95676-9097-4646-8745-c48d929daa7e None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:24.292780 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc95676-9097-4646-8745-c48d929daa7e None admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:24.293854 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc95676-9097-4646-8745-c48d929daa7e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:24.294192 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc95676-9097-4646-8745-c48d929daa7e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:24.296342 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc95676-9097-4646-8745-c48d929daa7e None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:24.306666 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:24.314080 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 265/518] 10.222.0.17 () {56 vars in 1148 bytes} [Fri Oct 14 12:48:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:24.316801 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642506e1-fbbb-4d17-9a3a-65f170937695 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:24.317533 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642506e1-fbbb-4d17-9a3a-65f170937695 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:24.318232 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642506e1-fbbb-4d17-9a3a-65f170937695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:24.340706 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-642506e1-fbbb-4d17-9a3a-65f170937695 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:48:24.342266 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-642506e1-fbbb-4d17-9a3a-65f170937695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:48:24.366158 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 254/519] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Oct 14 12:48:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 12:48:24.366158 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959ba5ec-ff41-43fb-afbd-d06e5dfe07ce None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:24.441349 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 266/520] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Oct 14 12:48:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 12:48:24.442585 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642506e1-fbbb-4d17-9a3a-65f170937695 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:24.532830 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959ba5ec-ff41-43fb-afbd-d06e5dfe07ce None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:24.566593 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:24.611050 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a616dc7a-d84a-4748-b63e-b7b80e4efd5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:24.612742 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a616dc7a-d84a-4748-b63e-b7b80e4efd5b None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:24.613089 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a616dc7a-d84a-4748-b63e-b7b80e4efd5b None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:24.613369 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a616dc7a-d84a-4748-b63e-b7b80e4efd5b None admin] PATH_INFO: `/v3/domains` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:24.614145 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a616dc7a-d84a-4748-b63e-b7b80e4efd5b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:24.614711 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a616dc7a-d84a-4748-b63e-b7b80e4efd5b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:24.617274 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a616dc7a-d84a-4748-b63e-b7b80e4efd5b None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:24.645173 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 255/521] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Oct 14 12:48:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:24.646089 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a616dc7a-d84a-4748-b63e-b7b80e4efd5b None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:24.649100 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642506e1-fbbb-4d17-9a3a-65f170937695 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:24.688963 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:24.703745 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ad7e81-b8d0-4bdb-a4f0-aefd97ddd27e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:24.705657 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ad7e81-b8d0-4bdb-a4f0-aefd97ddd27e None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:24.706672 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ad7e81-b8d0-4bdb-a4f0-aefd97ddd27e None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:24.707126 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ad7e81-b8d0-4bdb-a4f0-aefd97ddd27e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:24.708299 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ad7e81-b8d0-4bdb-a4f0-aefd97ddd27e None admin] RBAC: Adding query filter params (role.id=2d0a16b1c5634daf99f2b7ac092d1ddd, scope.project.id=2486e73d493b40e18d9d988744993854, user.id=86c9fc57b1ec4d00b9f392877f277284) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:24.708761 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ad7e81-b8d0-4bdb-a4f0-aefd97ddd27e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:24.711070 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ad7e81-b8d0-4bdb-a4f0-aefd97ddd27e None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:24.718364 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 267/522] 10.222.0.17 () {56 vars in 1374 bytes} [Fri Oct 14 12:48:24 2022] GET /identity/v3/role_assignments?user.id=86c9fc57b1ec4d00b9f392877f277284&scope.project.id=2486e73d493b40e18d9d988744993854&role.id=2d0a16b1c5634daf99f2b7ac092d1ddd => generated 608 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:24.719373 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ad7e81-b8d0-4bdb-a4f0-aefd97ddd27e None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:24.794660 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a616dc7a-d84a-4748-b63e-b7b80e4efd5b None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:24.847224 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa408f14-f07f-4127-9bf8-1611aaea34a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:24.847780 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa408f14-f07f-4127-9bf8-1611aaea34a8 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:24.848203 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa408f14-f07f-4127-9bf8-1611aaea34a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:24.848478 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa408f14-f07f-4127-9bf8-1611aaea34a8 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:24.849114 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa408f14-f07f-4127-9bf8-1611aaea34a8 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:24.850660 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa408f14-f07f-4127-9bf8-1611aaea34a8 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:24.887166 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-aa408f14-f07f-4127-9bf8-1611aaea34a8 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 14 12:48:24.887166 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:24.887166 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 14 12:48:24.887166 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 14 12:48:24.887166 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 14 12:48:24.887166 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 14 12:48:24.887166 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 14 12:48:24.887166 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 12:48:24.887166 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 14 12:48:24.887166 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 14 12:48:24.887166 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 14 12:48:24.887166 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 14 12:48:24.887166 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:24.887166 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:48:24.887166 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:48:24.887166 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:48:24.887166 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:48:24.888234 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:48:24.888234 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:48:24.888234 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:48:24.888234 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:48:24.888234 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:48:24.888234 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:48:24.888234 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 14 12:48:24.888234 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 14 12:48:24.888234 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 14 12:48:24.888234 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 14 12:48:24.888234 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:48:24.888234 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:48:24.888234 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:48:24.888234 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:48:24.888234 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:48:24.888234 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:48:24.889061 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:48:24.889061 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 14 12:48:24.889061 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:48:24.889061 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:48:24.889061 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:48:24.889061 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:48:24.889061 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:48:24.889061 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:48:24.889061 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:48:24.889061 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:48:24.889061 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 14 12:48:24.889061 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 12:48:24.889061 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 14 12:48:24.889061 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 14 12:48:24.895483 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 256/523] 10.222.0.17 () {56 vars in 1129 bytes} [Fri Oct 14 12:48:24 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:48:24.898147 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa408f14-f07f-4127-9bf8-1611aaea34a8 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:24.910152 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ad7e81-b8d0-4bdb-a4f0-aefd97ddd27e None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:24.954210 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c26427f-e5fa-46a3-b80f-419dec4fb909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:24.954827 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c26427f-e5fa-46a3-b80f-419dec4fb909 None admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:24.955101 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c26427f-e5fa-46a3-b80f-419dec4fb909 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:24.955381 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c26427f-e5fa-46a3-b80f-419dec4fb909 None admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:24.956737 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c26427f-e5fa-46a3-b80f-419dec4fb909 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:24.958224 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c26427f-e5fa-46a3-b80f-419dec4fb909 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:24.976612 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:24.988537 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 268/524] 10.222.0.17 () {60 vars in 1132 bytes} [Fri Oct 14 12:48:24 2022] POST /identity/v3/users => generated 254 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 12:48:24.989519 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c26427f-e5fa-46a3-b80f-419dec4fb909 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:25.064122 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:25.105218 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa408f14-f07f-4127-9bf8-1611aaea34a8 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:25.172112 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c26427f-e5fa-46a3-b80f-419dec4fb909 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:25.212960 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe33a76-0a13-46f0-9d98-7a49b021969f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:25.213637 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe33a76-0a13-46f0-9d98-7a49b021969f None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:25.213908 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe33a76-0a13-46f0-9d98-7a49b021969f None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:25.214274 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe33a76-0a13-46f0-9d98-7a49b021969f None admin] PATH_INFO: `/v3/services/network` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:25.214979 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe33a76-0a13-46f0-9d98-7a49b021969f None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:25.216620 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe33a76-0a13-46f0-9d98-7a49b021969f None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:25.226056 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8447170-5701-4ee9-98d9-5e64709e07e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:25.227166 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8447170-5701-4ee9-98d9-5e64709e07e3 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:25.227957 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8447170-5701-4ee9-98d9-5e64709e07e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:25.228108 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-cfe33a76-0a13-46f0-9d98-7a49b021969f None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 14 12:48:25.228108 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:25.228108 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 14 12:48:25.228108 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 14 12:48:25.228108 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 14 12:48:25.228108 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 14 12:48:25.228108 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 14 12:48:25.228108 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 12:48:25.228108 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 14 12:48:25.228108 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 14 12:48:25.228108 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 14 12:48:25.228108 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 14 12:48:25.228108 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:25.228108 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:48:25.228108 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:48:25.228108 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:48:25.228108 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:48:25.229107 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:48:25.229107 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:48:25.229107 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:48:25.229107 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:48:25.229107 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:48:25.229107 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:48:25.229107 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 14 12:48:25.229107 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 14 12:48:25.229107 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 14 12:48:25.229107 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 14 12:48:25.229107 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:48:25.229107 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:48:25.229107 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:48:25.229107 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:48:25.229107 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:48:25.229107 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:48:25.229934 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:48:25.229934 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 14 12:48:25.229934 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:48:25.229934 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:48:25.229934 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:48:25.229934 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:48:25.229934 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:48:25.229934 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:48:25.229934 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:48:25.229934 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:48:25.229934 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 14 12:48:25.229934 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 12:48:25.229934 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 14 12:48:25.229934 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 14 12:48:25.229934 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 257/525] 10.222.0.17 () {56 vars in 1111 bytes} [Fri Oct 14 12:48:24 2022] GET /identity/v3/services/network => generated 88 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:48:25.230814 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8447170-5701-4ee9-98d9-5e64709e07e3 None admin] PATH_INFO: `/v3/services` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:25.231635 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8447170-5701-4ee9-98d9-5e64709e07e3 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:25.231635 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8447170-5701-4ee9-98d9-5e64709e07e3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:25.233054 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8447170-5701-4ee9-98d9-5e64709e07e3 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:25.241400 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe33a76-0a13-46f0-9d98-7a49b021969f None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:25.258507 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 269/526] 10.222.0.17 () {56 vars in 1124 bytes} [Fri Oct 14 12:48:24 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:25.260057 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8447170-5701-4ee9-98d9-5e64709e07e3 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:25.367793 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe33a76-0a13-46f0-9d98-7a49b021969f None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:25.398615 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:25.414287 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a3154c-126f-43d0-ab44-8f657081d0fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:25.414914 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a3154c-126f-43d0-ab44-8f657081d0fb None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:25.418143 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a3154c-126f-43d0-ab44-8f657081d0fb None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:25.418143 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a3154c-126f-43d0-ab44-8f657081d0fb None admin] PATH_INFO: `/v3/services` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:25.418143 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a3154c-126f-43d0-ab44-8f657081d0fb None admin] RBAC: Adding query filter params (name=network) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:25.418143 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a3154c-126f-43d0-ab44-8f657081d0fb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:25.418484 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a3154c-126f-43d0-ab44-8f657081d0fb None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:25.424289 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 258/527] 10.222.0.17 () {56 vars in 1112 bytes} [Fri Oct 14 12:48:25 2022] GET /identity/v3/services?name=network => generated 124 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:25.431577 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a3154c-126f-43d0-ab44-8f657081d0fb None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:25.543352 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8447170-5701-4ee9-98d9-5e64709e07e3 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:25.561437 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:25.600532 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e091e3d6-6ac8-4b80-beda-ec5a2ae7e14a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:25.601512 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e091e3d6-6ac8-4b80-beda-ec5a2ae7e14a None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:25.601916 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e091e3d6-6ac8-4b80-beda-ec5a2ae7e14a None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:25.602317 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e091e3d6-6ac8-4b80-beda-ec5a2ae7e14a None admin] PATH_INFO: `/v3/services` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:25.603324 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e091e3d6-6ac8-4b80-beda-ec5a2ae7e14a None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:25.603729 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e091e3d6-6ac8-4b80-beda-ec5a2ae7e14a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:25.605766 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e091e3d6-6ac8-4b80-beda-ec5a2ae7e14a None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:25.613516 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 270/528] 10.222.0.17 () {56 vars in 1124 bytes} [Fri Oct 14 12:48:25 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:25.648052 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a3154c-126f-43d0-ab44-8f657081d0fb None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:25.705018 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd29160-53d6-4977-8478-b819024e1c06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:25.706435 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd29160-53d6-4977-8478-b819024e1c06 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:25.706869 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd29160-53d6-4977-8478-b819024e1c06 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:25.707289 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd29160-53d6-4977-8478-b819024e1c06 None admin] PATH_INFO: `/v3/services` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:25.708107 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd29160-53d6-4977-8478-b819024e1c06 None admin] RBAC: Adding query filter params (type=network) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:25.708633 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd29160-53d6-4977-8478-b819024e1c06 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:25.710276 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd29160-53d6-4977-8478-b819024e1c06 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:25.724735 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 259/529] 10.222.0.17 () {56 vars in 1112 bytes} [Fri Oct 14 12:48:25 2022] GET /identity/v3/services?type=network => generated 124 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:26.651902 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced7f99c-be47-4acc-abf5-e1f728f93a03 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:26.652474 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced7f99c-be47-4acc-abf5-e1f728f93a03 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:26.652474 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced7f99c-be47-4acc-abf5-e1f728f93a03 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:26.654146 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 271/530] 10.222.0.17 () {54 vars in 927 bytes} [Fri Oct 14 12:48:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:48:26.668073 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe42d895-9f4c-4239-92c8-e09204919126 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:26.668606 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe42d895-9f4c-4239-92c8-e09204919126 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:26.668606 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe42d895-9f4c-4239-92c8-e09204919126 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:26.699201 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-fe42d895-9f4c-4239-92c8-e09204919126 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:48:26.700436 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-fe42d895-9f4c-4239-92c8-e09204919126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:48:26.727147 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:26.792228 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 260/531] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Oct 14 12:48:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 12:48:27.377346 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced7f99c-be47-4acc-abf5-e1f728f93a03 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:27.526779 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced7f99c-be47-4acc-abf5-e1f728f93a03 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:27.567949 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa27a07-e147-4d0a-9075-960fe2c7c723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:27.568588 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa27a07-e147-4d0a-9075-960fe2c7c723 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:27.568862 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa27a07-e147-4d0a-9075-960fe2c7c723 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:27.569128 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa27a07-e147-4d0a-9075-960fe2c7c723 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:27.581550 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa27a07-e147-4d0a-9075-960fe2c7c723 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 12:48:27.587253 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-0fa27a07-e147-4d0a-9075-960fe2c7c723 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 14 12:48:27.587253 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:27.587253 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:48:27.587253 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:48:27.587253 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:48:27.587253 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:48:27.587253 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:48:27.587253 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:48:27.587253 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:48:27.587253 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:48:27.587253 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:48:27.587253 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:48:27.587253 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 12:48:27.587253 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 12:48:27.587253 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 12:48:27.587253 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 12:48:27.588189 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 12:48:27.588189 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 12:48:27.588189 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 12:48:27.588189 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 12:48:27.588189 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:48:27.588189 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:48:27.588189 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:48:27.588189 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:48:27.588189 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:48:27.588189 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:48:27.588189 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:48:27.588189 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 14 12:48:27.588189 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:48:27.588189 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:48:27.588189 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:48:27.588189 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:48:27.589011 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:48:27.589011 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:48:27.589011 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:48:27.589011 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:48:27.589011 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 12:48:27.589011 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 12:48:27.589011 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 12:48:27.589011 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 12:48:27.589011 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 12:48:27.589011 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 12:48:27.589011 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 14 12:48:27.589011 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 14 12:48:27.589011 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 272/532] 10.222.0.17 () {56 vars in 1096 bytes} [Fri Oct 14 12:48:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:48:27.595702 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe42d895-9f4c-4239-92c8-e09204919126 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:27.678882 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2477c6-7558-4562-b7a8-94b62156154f None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:27.679522 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2477c6-7558-4562-b7a8-94b62156154f None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:27.679522 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2477c6-7558-4562-b7a8-94b62156154f None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:27.680963 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 273/533] 10.222.0.17 () {54 vars in 927 bytes} [Fri Oct 14 12:48:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 14 12:48:27.687088 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b70c433-d163-494d-b195-5011655ab54c None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:27.687376 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b70c433-d163-494d-b195-5011655ab54c None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:27.687663 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b70c433-d163-494d-b195-5011655ab54c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:27.727818 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-4b70c433-d163-494d-b195-5011655ab54c None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:48:27.730497 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-4b70c433-d163-494d-b195-5011655ab54c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:48:27.741929 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe42d895-9f4c-4239-92c8-e09204919126 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:27.778521 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb68891e-cc8f-4f14-9630-f83e41c82fd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:27.779513 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb68891e-cc8f-4f14-9630-f83e41c82fd9 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:27.779995 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb68891e-cc8f-4f14-9630-f83e41c82fd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:27.780490 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb68891e-cc8f-4f14-9630-f83e41c82fd9 None admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:27.781367 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb68891e-cc8f-4f14-9630-f83e41c82fd9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:27.781871 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb68891e-cc8f-4f14-9630-f83e41c82fd9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:27.783471 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb68891e-cc8f-4f14-9630-f83e41c82fd9 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:27.793566 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 261/534] 10.222.0.17 () {56 vars in 1099 bytes} [Fri Oct 14 12:48:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:27.795457 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:27.799385 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb68891e-cc8f-4f14-9630-f83e41c82fd9 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:27.828064 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:27.859951 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 274/535] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Oct 14 12:48:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 12:48:27.934207 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb68891e-cc8f-4f14-9630-f83e41c82fd9 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:27.972277 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dec94ba-c7ee-4feb-b85d-1251078b26af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:27.972927 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dec94ba-c7ee-4feb-b85d-1251078b26af None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:27.973205 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dec94ba-c7ee-4feb-b85d-1251078b26af None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:27.973475 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dec94ba-c7ee-4feb-b85d-1251078b26af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:27.985669 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dec94ba-c7ee-4feb-b85d-1251078b26af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:27.987780 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dec94ba-c7ee-4feb-b85d-1251078b26af None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:28.004279 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-5dec94ba-c7ee-4feb-b85d-1251078b26af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:48:28.004279 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:28.004279 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:48:28.004279 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:48:28.004279 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:48:28.004279 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:48:28.004279 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:48:28.004279 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:48:28.004279 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:48:28.004279 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:48:28.004279 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:48:28.004279 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:48:28.004279 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 12:48:28.004279 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 12:48:28.004279 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 12:48:28.004279 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 12:48:28.005270 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:48:28.005270 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:48:28.005270 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:48:28.005270 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:48:28.005270 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:48:28.005270 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:48:28.005270 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:48:28.005270 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 14 12:48:28.005270 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:48:28.005270 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:48:28.005270 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:48:28.005270 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:48:28.005270 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:48:28.005270 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:48:28.005270 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:48:28.005270 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:48:28.005270 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 12:48:28.006206 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 12:48:28.006206 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:48:28.006206 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 14 12:48:28.006206 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 262/536] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Oct 14 12:48:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:48:28.012228 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b70c433-d163-494d-b195-5011655ab54c None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:28.079821 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365ed06d-c823-4653-9b5a-5590b20738b9 None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:28.080143 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365ed06d-c823-4653-9b5a-5590b20738b9 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:28.080385 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365ed06d-c823-4653-9b5a-5590b20738b9 None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:28.082822 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 263/537] 10.222.0.17 () {54 vars in 927 bytes} [Fri Oct 14 12:48:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 14 12:48:28.087444 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d096ae2-6740-41d7-9a33-9c195fd8bf31 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:28.087731 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d096ae2-6740-41d7-9a33-9c195fd8bf31 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:28.088004 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d096ae2-6740-41d7-9a33-9c195fd8bf31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:28.115976 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-6d096ae2-6740-41d7-9a33-9c195fd8bf31 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:48:28.117518 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-6d096ae2-6740-41d7-9a33-9c195fd8bf31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:48:28.188336 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b70c433-d163-494d-b195-5011655ab54c None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:28.234924 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 264/538] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Oct 14 12:48:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 14 12:48:28.252580 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d096ae2-6740-41d7-9a33-9c195fd8bf31 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:28.256569 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f401d610-d511-4003-9c7e-9cc5e2dc0cb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:28.256738 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:28.257178 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f401d610-d511-4003-9c7e-9cc5e2dc0cb3 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:28.258407 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f401d610-d511-4003-9c7e-9cc5e2dc0cb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:28.258727 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f401d610-d511-4003-9c7e-9cc5e2dc0cb3 None admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:28.259527 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f401d610-d511-4003-9c7e-9cc5e2dc0cb3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:28.259963 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f401d610-d511-4003-9c7e-9cc5e2dc0cb3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:28.261767 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f401d610-d511-4003-9c7e-9cc5e2dc0cb3 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:28.280969 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 275/539] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Oct 14 12:48:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:28.282374 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f401d610-d511-4003-9c7e-9cc5e2dc0cb3 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:28.345783 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:28.466969 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d096ae2-6740-41d7-9a33-9c195fd8bf31 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:28.488623 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f401d610-d511-4003-9c7e-9cc5e2dc0cb3 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:28.530349 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed902d2-4e02-4a8b-96e2-833dcd35ddc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:28.531123 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed902d2-4e02-4a8b-96e2-833dcd35ddc0 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:28.531405 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed902d2-4e02-4a8b-96e2-833dcd35ddc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:28.531676 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed902d2-4e02-4a8b-96e2-833dcd35ddc0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:28.541505 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed902d2-4e02-4a8b-96e2-833dcd35ddc0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:28.543070 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed902d2-4e02-4a8b-96e2-833dcd35ddc0 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:28.557335 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-aed902d2-4e02-4a8b-96e2-833dcd35ddc0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 14 12:48:28.557335 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:28.557335 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:48:28.557335 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:48:28.557335 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:48:28.557335 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:48:28.557335 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:48:28.557335 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:48:28.557335 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:48:28.557335 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:48:28.557335 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:48:28.557335 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:48:28.557335 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 14 12:48:28.557335 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 14 12:48:28.557335 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 14 12:48:28.557335 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 14 12:48:28.558432 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:48:28.558432 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:48:28.558432 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 14 12:48:28.558432 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 12:48:28.558432 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 14 12:48:28.558432 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 12:48:28.558432 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:48:28.558432 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:48:28.558432 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:48:28.558432 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:48:28.558432 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:48:28.558432 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 14 12:48:28.558432 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:48:28.558432 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:48:28.558432 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:48:28.558432 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:48:28.558432 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:48:28.558432 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:48:28.559414 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:48:28.559414 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:48:28.559414 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 14 12:48:28.559414 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 14 12:48:28.559414 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 14 12:48:28.559414 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 14 12:48:28.559414 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 14 12:48:28.559414 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 14 12:48:28.559414 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 14 12:48:28.559414 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 14 12:48:28.559414 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 276/540] 10.222.0.17 () {56 vars in 1093 bytes} [Fri Oct 14 12:48:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:48:28.560723 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92b91ea-06bc-4b15-a725-015752ddfac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:28.560723 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92b91ea-06bc-4b15-a725-015752ddfac9 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:28.560914 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92b91ea-06bc-4b15-a725-015752ddfac9 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:28.561126 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92b91ea-06bc-4b15-a725-015752ddfac9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:28.564649 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed902d2-4e02-4a8b-96e2-833dcd35ddc0 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:28.590174 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92b91ea-06bc-4b15-a725-015752ddfac9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 12:48:28.598010 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-d92b91ea-06bc-4b15-a725-015752ddfac9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 14 12:48:28.598010 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:28.598010 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:48:28.598010 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:48:28.598010 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:48:28.598010 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:48:28.598010 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:48:28.598010 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:48:28.598010 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:48:28.598010 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:48:28.598010 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:48:28.598010 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:48:28.598010 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 12:48:28.598010 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 12:48:28.598010 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 12:48:28.598010 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 12:48:28.599023 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 12:48:28.599023 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 12:48:28.599023 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 12:48:28.599023 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 12:48:28.599023 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:48:28.599023 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:48:28.599023 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:48:28.599023 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:48:28.599023 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:48:28.599023 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:48:28.599023 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:48:28.599023 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 14 12:48:28.599023 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:48:28.599023 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:48:28.599023 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:48:28.599023 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:48:28.599864 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:48:28.599864 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:48:28.599864 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:48:28.599864 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:48:28.599864 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 12:48:28.599864 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 12:48:28.599864 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 12:48:28.599864 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 12:48:28.599864 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 12:48:28.599864 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 12:48:28.599864 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 14 12:48:28.599864 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 14 12:48:28.603206 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 265/541] 10.222.0.17 () {56 vars in 1096 bytes} [Fri Oct 14 12:48:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 351 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 14 12:48:28.604721 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1313c9-423b-4e3a-b4b3-74157679b2f9 None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:28.605836 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1313c9-423b-4e3a-b4b3-74157679b2f9 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:28.606361 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1313c9-423b-4e3a-b4b3-74157679b2f9 None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:28.608854 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 266/542] 10.222.0.17 () {54 vars in 927 bytes} [Fri Oct 14 12:48:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:48:28.609892 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1313c9-423b-4e3a-b4b3-74157679b2f9 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:28.677264 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:28.696299 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:28.698973 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed902d2-4e02-4a8b-96e2-833dcd35ddc0 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:28.740786 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1313c9-423b-4e3a-b4b3-74157679b2f9 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:28.741541 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa05299-fe8b-4eb4-80d6-b5658ec691f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:28.742272 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa05299-fe8b-4eb4-80d6-b5658ec691f0 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:28.742557 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa05299-fe8b-4eb4-80d6-b5658ec691f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:28.742866 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa05299-fe8b-4eb4-80d6-b5658ec691f0 None admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:28.743687 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa05299-fe8b-4eb4-80d6-b5658ec691f0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:28.744013 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa05299-fe8b-4eb4-80d6-b5658ec691f0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:28.745633 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa05299-fe8b-4eb4-80d6-b5658ec691f0 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:28.767545 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 277/543] 10.222.0.17 () {56 vars in 1133 bytes} [Fri Oct 14 12:48:28 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:28.768930 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa05299-fe8b-4eb4-80d6-b5658ec691f0 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:28.786848 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ccaa32-5df1-4f85-ad46-342bd0303363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:28.787646 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ccaa32-5df1-4f85-ad46-342bd0303363 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:28.787935 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ccaa32-5df1-4f85-ad46-342bd0303363 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:28.788212 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ccaa32-5df1-4f85-ad46-342bd0303363 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:28.800915 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ccaa32-5df1-4f85-ad46-342bd0303363 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 12:48:28.805679 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-f8ccaa32-5df1-4f85-ad46-342bd0303363 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 14 12:48:28.805679 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:28.805679 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:48:28.805679 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:48:28.805679 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:48:28.805679 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:48:28.805679 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:48:28.805679 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:48:28.805679 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:48:28.805679 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:48:28.805679 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:48:28.805679 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:48:28.805679 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 12:48:28.805679 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 12:48:28.805679 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 12:48:28.805679 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 12:48:28.806722 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 12:48:28.806722 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 12:48:28.806722 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 12:48:28.806722 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 12:48:28.806722 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:48:28.806722 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:48:28.806722 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:48:28.806722 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:48:28.806722 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:48:28.806722 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:48:28.806722 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:48:28.806722 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 14 12:48:28.806722 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:48:28.806722 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:48:28.806722 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:48:28.806722 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:48:28.807552 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:48:28.807552 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:48:28.807552 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:48:28.807552 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:48:28.807552 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 12:48:28.807552 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 12:48:28.807552 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 12:48:28.807552 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 12:48:28.807552 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 12:48:28.807552 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 12:48:28.807552 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 14 12:48:28.807552 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 14 12:48:28.807552 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 267/544] 10.222.0.17 () {56 vars in 1102 bytes} [Fri Oct 14 12:48:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:48:28.808677 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fb8204-00d6-40b5-9afe-1c2de515098c None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:28.808677 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fb8204-00d6-40b5-9afe-1c2de515098c None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:28.808677 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fb8204-00d6-40b5-9afe-1c2de515098c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:28.828143 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-33fb8204-00d6-40b5-9afe-1c2de515098c None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:48:28.829338 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-33fb8204-00d6-40b5-9afe-1c2de515098c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:48:28.885686 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa05299-fe8b-4eb4-80d6-b5658ec691f0 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:28.913521 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 268/545] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Oct 14 12:48:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 12:48:28.914850 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef296d0a-21ff-4f14-b483-cb533959008a None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:28.915134 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef296d0a-21ff-4f14-b483-cb533959008a None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:28.915404 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef296d0a-21ff-4f14-b483-cb533959008a None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:28.916831 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 269/546] 10.222.0.17 () {54 vars in 927 bytes} [Fri Oct 14 12:48:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:48:28.917446 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef296d0a-21ff-4f14-b483-cb533959008a None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:28.931165 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2bf65b-c85b-42e8-88d8-c24afb26d574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:28.931962 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2bf65b-c85b-42e8-88d8-c24afb26d574 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:28.932322 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2bf65b-c85b-42e8-88d8-c24afb26d574 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:28.932602 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2bf65b-c85b-42e8-88d8-c24afb26d574 None admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:28.933396 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2bf65b-c85b-42e8-88d8-c24afb26d574 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:28.933699 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2bf65b-c85b-42e8-88d8-c24afb26d574 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:28.935238 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2bf65b-c85b-42e8-88d8-c24afb26d574 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:28.944502 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 278/547] 10.222.0.17 () {56 vars in 1099 bytes} [Fri Oct 14 12:48:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:28.945330 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2bf65b-c85b-42e8-88d8-c24afb26d574 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:28.961164 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:28.996774 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:29.064749 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef296d0a-21ff-4f14-b483-cb533959008a None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:29.075385 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2bf65b-c85b-42e8-88d8-c24afb26d574 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:29.113563 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cced1e-c811-42e0-b87e-d7b21f6fd175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:29.114202 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cced1e-c811-42e0-b87e-d7b21f6fd175 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:29.114491 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cced1e-c811-42e0-b87e-d7b21f6fd175 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:29.114935 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cced1e-c811-42e0-b87e-d7b21f6fd175 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:29.124144 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574092e4-97ca-4da8-b49c-f1b46a595428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:29.124860 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574092e4-97ca-4da8-b49c-f1b46a595428 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:29.125538 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574092e4-97ca-4da8-b49c-f1b46a595428 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:29.125538 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574092e4-97ca-4da8-b49c-f1b46a595428 None admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:29.126078 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574092e4-97ca-4da8-b49c-f1b46a595428 None admin] RBAC: Adding query filter params (name=service) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:29.126430 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574092e4-97ca-4da8-b49c-f1b46a595428 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:29.128375 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574092e4-97ca-4da8-b49c-f1b46a595428 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:29.142594 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 279/548] 10.222.0.17 () {56 vars in 1103 bytes} [Fri Oct 14 12:48:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:29.142594 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c48cd1-8829-4fd7-a8f9-6725a294a9c0 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:29.142594 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c48cd1-8829-4fd7-a8f9-6725a294a9c0 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:29.142594 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c48cd1-8829-4fd7-a8f9-6725a294a9c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:29.162577 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-d2c48cd1-8829-4fd7-a8f9-6725a294a9c0 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:48:29.164344 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-d2c48cd1-8829-4fd7-a8f9-6725a294a9c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:48:29.196632 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cced1e-c811-42e0-b87e-d7b21f6fd175 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:29.198607 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cced1e-c811-42e0-b87e-d7b21f6fd175 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:29.231698 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:29.237730 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 280/549] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Oct 14 12:48:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 12:48:29.238629 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c48cd1-8829-4fd7-a8f9-6725a294a9c0 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:29.256658 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:29.308283 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 270/550] 10.222.0.17 () {58 vars in 1282 bytes} [Fri Oct 14 12:48:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 14 12:48:29.309204 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cced1e-c811-42e0-b87e-d7b21f6fd175 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:29.372100 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c48cd1-8829-4fd7-a8f9-6725a294a9c0 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:29.412273 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37edbc24-2cdf-41c0-b416-8d3bc083db19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:29.413252 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37edbc24-2cdf-41c0-b416-8d3bc083db19 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:29.413562 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37edbc24-2cdf-41c0-b416-8d3bc083db19 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:29.413836 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37edbc24-2cdf-41c0-b416-8d3bc083db19 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:29.431006 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37edbc24-2cdf-41c0-b416-8d3bc083db19 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:29.432946 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37edbc24-2cdf-41c0-b416-8d3bc083db19 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:29.435658 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cced1e-c811-42e0-b87e-d7b21f6fd175 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:29.452174 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-37edbc24-2cdf-41c0-b416-8d3bc083db19 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:48:29.452174 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:29.452174 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:48:29.452174 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:48:29.452174 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:48:29.452174 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:48:29.452174 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:48:29.452174 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:48:29.452174 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:48:29.452174 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:48:29.452174 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:48:29.452174 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:48:29.452174 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 12:48:29.452174 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 12:48:29.452174 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 12:48:29.452174 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 12:48:29.454000 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:48:29.454000 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:48:29.454000 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:48:29.454000 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:48:29.454000 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:48:29.454000 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:48:29.454000 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:48:29.454000 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 14 12:48:29.454000 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:48:29.454000 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:48:29.454000 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:48:29.454000 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:48:29.454000 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:48:29.454000 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:48:29.454000 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:48:29.454000 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:48:29.454000 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 12:48:29.456747 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 12:48:29.456747 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:48:29.456747 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 14 12:48:29.457512 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 281/551] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Oct 14 12:48:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:48:29.459050 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37edbc24-2cdf-41c0-b416-8d3bc083db19 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:29.490408 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc71fe1-46ba-4327-afc7-14f84f51918c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:29.491418 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc71fe1-46ba-4327-afc7-14f84f51918c None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:29.491700 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc71fe1-46ba-4327-afc7-14f84f51918c None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:29.492082 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc71fe1-46ba-4327-afc7-14f84f51918c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:29.506026 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc71fe1-46ba-4327-afc7-14f84f51918c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:29.507624 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc71fe1-46ba-4327-afc7-14f84f51918c None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:29.522865 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:29.523739 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-7dc71fe1-46ba-4327-afc7-14f84f51918c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:48:29.523739 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:29.523739 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:48:29.523739 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:48:29.523739 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:48:29.523739 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:48:29.523739 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:48:29.523739 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:48:29.523739 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:48:29.523739 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:48:29.523739 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:48:29.523739 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:48:29.523739 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 12:48:29.523739 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 12:48:29.523739 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 12:48:29.523739 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 12:48:29.524961 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:48:29.524961 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:48:29.524961 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:48:29.524961 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:48:29.524961 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:48:29.524961 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:48:29.524961 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:48:29.524961 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 14 12:48:29.524961 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:48:29.524961 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:48:29.524961 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:48:29.524961 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:48:29.524961 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:48:29.524961 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:48:29.524961 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:48:29.524961 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:48:29.524961 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 12:48:29.525967 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 12:48:29.525967 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:48:29.525967 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 14 12:48:29.525967 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 271/552] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Oct 14 12:48:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:48:29.526295 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc71fe1-46ba-4327-afc7-14f84f51918c None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:29.537092 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:29.584614 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37edbc24-2cdf-41c0-b416-8d3bc083db19 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:29.623602 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9cb767-1ae1-40de-9fb9-ccf98ef28c3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:29.624202 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9cb767-1ae1-40de-9fb9-ccf98ef28c3b None admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:29.624478 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9cb767-1ae1-40de-9fb9-ccf98ef28c3b None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:29.624745 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9cb767-1ae1-40de-9fb9-ccf98ef28c3b None admin] PATH_INFO: `/v3/services` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:29.625387 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9cb767-1ae1-40de-9fb9-ccf98ef28c3b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:29.626779 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9cb767-1ae1-40de-9fb9-ccf98ef28c3b None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:29.641297 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc71fe1-46ba-4327-afc7-14f84f51918c None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:29.644160 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 282/553] 10.222.0.17 () {60 vars in 1141 bytes} [Fri Oct 14 12:48:29 2022] POST /identity/v3/services => generated 251 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 12:48:29.644577 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9cb767-1ae1-40de-9fb9-ccf98ef28c3b None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:29.701273 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70efd22-8717-42f5-b96d-ce09f784a97d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:29.702055 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70efd22-8717-42f5-b96d-ce09f784a97d None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:29.702364 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70efd22-8717-42f5-b96d-ce09f784a97d None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:29.702636 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70efd22-8717-42f5-b96d-ce09f784a97d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:29.715681 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70efd22-8717-42f5-b96d-ce09f784a97d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:29.717316 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70efd22-8717-42f5-b96d-ce09f784a97d None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:29.737697 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-f70efd22-8717-42f5-b96d-ce09f784a97d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:48:29.737697 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:29.737697 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:48:29.737697 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:48:29.737697 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:48:29.737697 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:48:29.737697 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:48:29.737697 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:48:29.737697 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:48:29.737697 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:48:29.737697 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:48:29.737697 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:48:29.737697 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 12:48:29.737697 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 12:48:29.737697 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 12:48:29.737697 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 12:48:29.739213 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:48:29.739213 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:48:29.739213 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:48:29.739213 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:48:29.739213 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:48:29.739213 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:48:29.739213 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:48:29.739213 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 14 12:48:29.739213 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:48:29.739213 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:48:29.739213 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:48:29.739213 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:48:29.739213 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:48:29.739213 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:48:29.739213 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:48:29.739213 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:48:29.739213 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 12:48:29.740333 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 12:48:29.740333 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:48:29.740333 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 14 12:48:29.740333 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 272/554] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Oct 14 12:48:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:48:29.740333 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70efd22-8717-42f5-b96d-ce09f784a97d None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:29.779942 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9cb767-1ae1-40de-9fb9-ccf98ef28c3b None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:29.792754 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:29.822221 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:29.827333 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4db070-f4f6-4948-a926-abf4dfde2b44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:29.827333 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4db070-f4f6-4948-a926-abf4dfde2b44 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:29.827333 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4db070-f4f6-4948-a926-abf4dfde2b44 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:29.827333 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4db070-f4f6-4948-a926-abf4dfde2b44 None admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:29.827762 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4db070-f4f6-4948-a926-abf4dfde2b44 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:29.827762 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4db070-f4f6-4948-a926-abf4dfde2b44 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:29.828903 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4db070-f4f6-4948-a926-abf4dfde2b44 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:29.842692 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 283/555] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Oct 14 12:48:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:29.843635 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4db070-f4f6-4948-a926-abf4dfde2b44 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:29.907046 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70efd22-8717-42f5-b96d-ce09f784a97d None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:29.949696 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63748af-ac7b-4eeb-a818-0f5123021027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:29.950342 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63748af-ac7b-4eeb-a818-0f5123021027 None admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:29.950624 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63748af-ac7b-4eeb-a818-0f5123021027 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:29.950901 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63748af-ac7b-4eeb-a818-0f5123021027 None admin] PATH_INFO: `/v3/services` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:29.951636 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63748af-ac7b-4eeb-a818-0f5123021027 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:29.953060 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63748af-ac7b-4eeb-a818-0f5123021027 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:29.970013 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 273/556] 10.222.0.17 () {60 vars in 1141 bytes} [Fri Oct 14 12:48:29 2022] POST /identity/v3/services => generated 240 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 12:48:29.970871 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63748af-ac7b-4eeb-a818-0f5123021027 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:29.980615 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4db070-f4f6-4948-a926-abf4dfde2b44 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:30.055367 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6e70a1-8939-4d93-8937-2d88bf6be800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:30.056032 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6e70a1-8939-4d93-8937-2d88bf6be800 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:30.056446 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6e70a1-8939-4d93-8937-2d88bf6be800 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:30.056902 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6e70a1-8939-4d93-8937-2d88bf6be800 None admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:30.059451 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6e70a1-8939-4d93-8937-2d88bf6be800 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:30.060560 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6e70a1-8939-4d93-8937-2d88bf6be800 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:30.063099 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6e70a1-8939-4d93-8937-2d88bf6be800 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:30.078983 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 284/557] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Oct 14 12:48:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:30.081214 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6e70a1-8939-4d93-8937-2d88bf6be800 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:30.135831 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:30.194491 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63748af-ac7b-4eeb-a818-0f5123021027 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:30.223183 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:30.236405 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6e70a1-8939-4d93-8937-2d88bf6be800 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:30.268559 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d00a0e-8ea2-4098-ab7f-ec9f48bb356d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:30.269277 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d00a0e-8ea2-4098-ab7f-ec9f48bb356d None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:30.269526 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d00a0e-8ea2-4098-ab7f-ec9f48bb356d None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:30.269760 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d00a0e-8ea2-4098-ab7f-ec9f48bb356d None admin] PATH_INFO: `/v3/domains` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:30.270446 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d00a0e-8ea2-4098-ab7f-ec9f48bb356d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:30.270747 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d00a0e-8ea2-4098-ab7f-ec9f48bb356d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:30.272147 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d00a0e-8ea2-4098-ab7f-ec9f48bb356d None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:30.285647 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 274/558] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Oct 14 12:48:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:30.286574 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d00a0e-8ea2-4098-ab7f-ec9f48bb356d None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:30.295918 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cc0882-17b5-4b85-9a20-6e8e1f748576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:30.296554 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cc0882-17b5-4b85-9a20-6e8e1f748576 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:30.296828 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cc0882-17b5-4b85-9a20-6e8e1f748576 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:30.297149 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cc0882-17b5-4b85-9a20-6e8e1f748576 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:30.307892 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cc0882-17b5-4b85-9a20-6e8e1f748576 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:30.310167 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cc0882-17b5-4b85-9a20-6e8e1f748576 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:30.329725 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-51cc0882-17b5-4b85-9a20-6e8e1f748576 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 14 12:48:30.329725 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:30.329725 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:48:30.329725 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:48:30.329725 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:48:30.329725 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:48:30.329725 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:48:30.329725 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:48:30.329725 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:48:30.329725 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:48:30.329725 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:48:30.329725 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:48:30.329725 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 14 12:48:30.329725 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 14 12:48:30.329725 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 14 12:48:30.329725 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 14 12:48:30.331345 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:48:30.331345 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:48:30.331345 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 14 12:48:30.331345 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 12:48:30.331345 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 14 12:48:30.331345 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 12:48:30.331345 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:48:30.331345 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:48:30.331345 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:48:30.331345 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:48:30.331345 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:48:30.331345 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 14 12:48:30.331345 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:48:30.331345 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:48:30.331345 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:48:30.331345 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:48:30.331345 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:48:30.331345 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:48:30.332270 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:48:30.332270 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:48:30.332270 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 14 12:48:30.332270 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 14 12:48:30.332270 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 14 12:48:30.332270 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 14 12:48:30.332270 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 14 12:48:30.332270 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 14 12:48:30.332270 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 14 12:48:30.332270 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 14 12:48:30.332796 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 285/559] 10.222.0.17 () {56 vars in 1096 bytes} [Fri Oct 14 12:48:30 2022] GET /identity/v3/users/swift => generated 83 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:48:30.333488 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cc0882-17b5-4b85-9a20-6e8e1f748576 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:30.438160 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d00a0e-8ea2-4098-ab7f-ec9f48bb356d None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:30.445160 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:30.464299 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cc0882-17b5-4b85-9a20-6e8e1f748576 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:30.495023 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0475ee3-f42c-4d20-a4a7-64848317d46b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:30.495666 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0475ee3-f42c-4d20-a4a7-64848317d46b None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:30.495996 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0475ee3-f42c-4d20-a4a7-64848317d46b None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:30.496254 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0475ee3-f42c-4d20-a4a7-64848317d46b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:30.506671 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0475ee3-f42c-4d20-a4a7-64848317d46b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:30.508518 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0475ee3-f42c-4d20-a4a7-64848317d46b None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:30.513890 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ae7431-bc12-46c3-8c31-a9d786b087f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:30.514918 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ae7431-bc12-46c3-8c31-a9d786b087f6 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:30.515394 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ae7431-bc12-46c3-8c31-a9d786b087f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:30.515945 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ae7431-bc12-46c3-8c31-a9d786b087f6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:30.524096 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-a0475ee3-f42c-4d20-a4a7-64848317d46b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 14 12:48:30.524096 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:30.524096 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:48:30.524096 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:48:30.524096 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:48:30.524096 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:48:30.524096 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:48:30.524096 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:48:30.524096 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:48:30.524096 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:48:30.524096 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:48:30.524096 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:48:30.524096 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 14 12:48:30.524096 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 14 12:48:30.524096 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 14 12:48:30.524096 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 14 12:48:30.525160 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:48:30.525160 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:48:30.525160 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 14 12:48:30.525160 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 12:48:30.525160 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 14 12:48:30.525160 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 12:48:30.525160 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:48:30.525160 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:48:30.525160 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:48:30.525160 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:48:30.525160 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:48:30.525160 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 14 12:48:30.525160 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:48:30.525160 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:48:30.525160 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:48:30.525160 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:48:30.525160 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:48:30.525160 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:48:30.526071 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:48:30.526071 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:48:30.526071 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 14 12:48:30.526071 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 14 12:48:30.526071 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 14 12:48:30.526071 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 14 12:48:30.526071 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 14 12:48:30.526071 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 14 12:48:30.526071 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 14 12:48:30.526071 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 14 12:48:30.526071 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 275/560] 10.222.0.17 () {56 vars in 1117 bytes} [Fri Oct 14 12:48:30 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:48:30.526071 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0475ee3-f42c-4d20-a4a7-64848317d46b None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:30.532721 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ae7431-bc12-46c3-8c31-a9d786b087f6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:30.534705 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ae7431-bc12-46c3-8c31-a9d786b087f6 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:30.550701 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-e6ae7431-bc12-46c3-8c31-a9d786b087f6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 12:48:30.550701 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:30.550701 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:48:30.550701 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:48:30.550701 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:48:30.550701 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:48:30.550701 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:48:30.550701 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:48:30.550701 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:48:30.550701 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:48:30.550701 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:48:30.550701 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:48:30.550701 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 14 12:48:30.550701 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 14 12:48:30.550701 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 14 12:48:30.551666 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 14 12:48:30.551666 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:48:30.551666 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:48:30.551666 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:48:30.551666 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:48:30.551666 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:48:30.551666 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:48:30.551666 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:48:30.551666 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 14 12:48:30.551666 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:48:30.551666 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:48:30.551666 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:48:30.551666 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:48:30.551666 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:48:30.551666 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:48:30.551666 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:48:30.551666 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:48:30.552587 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 14 12:48:30.552587 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 14 12:48:30.552587 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 14 12:48:30.552587 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 14 12:48:30.552587 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 14 12:48:30.552587 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 14 12:48:30.552587 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 12:48:30.552587 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 14 12:48:30.555123 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 286/561] 10.222.0.17 () {56 vars in 1111 bytes} [Fri Oct 14 12:48:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:48:30.558014 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ae7431-bc12-46c3-8c31-a9d786b087f6 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:30.567230 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:30.649665 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0475ee3-f42c-4d20-a4a7-64848317d46b None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:30.686728 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56f90e4-fc6e-45d6-85cb-308966ad0352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:30.687330 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56f90e4-fc6e-45d6-85cb-308966ad0352 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:30.687607 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56f90e4-fc6e-45d6-85cb-308966ad0352 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:30.687865 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56f90e4-fc6e-45d6-85cb-308966ad0352 None admin] PATH_INFO: `/v3/users` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:30.688589 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56f90e4-fc6e-45d6-85cb-308966ad0352 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:30.688886 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56f90e4-fc6e-45d6-85cb-308966ad0352 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:30.690686 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ae7431-bc12-46c3-8c31-a9d786b087f6 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:30.690865 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56f90e4-fc6e-45d6-85cb-308966ad0352 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:30.709536 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 276/562] 10.222.0.17 () {56 vars in 1135 bytes} [Fri Oct 14 12:48:30 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:30.710445 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56f90e4-fc6e-45d6-85cb-308966ad0352 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:30.732207 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3ea3d2-4612-4ea2-b6a6-23e132d29c86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:30.732820 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3ea3d2-4612-4ea2-b6a6-23e132d29c86 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:30.733921 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3ea3d2-4612-4ea2-b6a6-23e132d29c86 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:30.734236 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3ea3d2-4612-4ea2-b6a6-23e132d29c86 None admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:30.735399 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3ea3d2-4612-4ea2-b6a6-23e132d29c86 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:30.735708 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3ea3d2-4612-4ea2-b6a6-23e132d29c86 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:30.737961 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3ea3d2-4612-4ea2-b6a6-23e132d29c86 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:30.763240 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 287/563] 10.222.0.17 () {56 vars in 1149 bytes} [Fri Oct 14 12:48:30 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:30.764404 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3ea3d2-4612-4ea2-b6a6-23e132d29c86 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:30.772134 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:30.816437 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:30.829513 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56f90e4-fc6e-45d6-85cb-308966ad0352 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:30.883991 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65b8155-c193-44e0-b34b-51625e64cff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:30.884867 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65b8155-c193-44e0-b34b-51625e64cff1 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:30.885302 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65b8155-c193-44e0-b34b-51625e64cff1 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:30.885708 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65b8155-c193-44e0-b34b-51625e64cff1 None admin] PATH_INFO: `/v3/projects` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:30.886506 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65b8155-c193-44e0-b34b-51625e64cff1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:30.886819 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65b8155-c193-44e0-b34b-51625e64cff1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:30.888997 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65b8155-c193-44e0-b34b-51625e64cff1 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:30.907242 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 277/564] 10.222.0.17 () {56 vars in 1148 bytes} [Fri Oct 14 12:48:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:30.908404 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65b8155-c193-44e0-b34b-51625e64cff1 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:30.926998 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3ea3d2-4612-4ea2-b6a6-23e132d29c86 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:30.978224 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e258787c-e9da-4774-9b56-85b02cc966b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:30.979046 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e258787c-e9da-4774-9b56-85b02cc966b9 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:30.979416 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e258787c-e9da-4774-9b56-85b02cc966b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:30.979781 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e258787c-e9da-4774-9b56-85b02cc966b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:30.991838 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e258787c-e9da-4774-9b56-85b02cc966b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:30.993566 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e258787c-e9da-4774-9b56-85b02cc966b9 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:31.010994 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-e258787c-e9da-4774-9b56-85b02cc966b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:48:31.010994 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:31.010994 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:48:31.010994 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:48:31.010994 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:48:31.010994 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:48:31.010994 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:48:31.010994 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:48:31.010994 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:48:31.010994 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:48:31.010994 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:48:31.010994 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:48:31.010994 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 12:48:31.010994 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 12:48:31.010994 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 12:48:31.010994 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 12:48:31.014391 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:48:31.014391 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:48:31.014391 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:48:31.014391 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:48:31.014391 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:48:31.014391 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:48:31.014391 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:48:31.014391 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 14 12:48:31.014391 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:48:31.014391 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:48:31.014391 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:48:31.014391 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:48:31.014391 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:48:31.014391 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:48:31.014391 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:48:31.014391 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:48:31.014391 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 12:48:31.016819 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 12:48:31.016819 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:48:31.016819 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 14 12:48:31.016819 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 288/565] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Oct 14 12:48:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:48:31.016819 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e258787c-e9da-4774-9b56-85b02cc966b9 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:31.031327 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65b8155-c193-44e0-b34b-51625e64cff1 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:31.075299 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cfa098-d583-4413-b248-02ea3ec602cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:31.076023 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cfa098-d583-4413-b248-02ea3ec602cd None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:31.076404 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cfa098-d583-4413-b248-02ea3ec602cd None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:31.076800 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cfa098-d583-4413-b248-02ea3ec602cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:31.094048 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:31.094459 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cfa098-d583-4413-b248-02ea3ec602cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:31.096062 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cfa098-d583-4413-b248-02ea3ec602cd None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:31.119054 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-d7cfa098-d583-4413-b248-02ea3ec602cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:48:31.119054 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:31.119054 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:48:31.119054 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:48:31.119054 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:48:31.119054 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:48:31.119054 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:48:31.119054 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:48:31.119054 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:48:31.119054 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:48:31.119054 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:48:31.119054 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:48:31.119054 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 12:48:31.119054 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 12:48:31.119054 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 12:48:31.119054 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 12:48:31.120053 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:48:31.120053 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:48:31.120053 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:48:31.120053 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:48:31.120053 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:48:31.120053 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:48:31.120053 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:48:31.120053 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 14 12:48:31.120053 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:48:31.120053 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:48:31.120053 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:48:31.120053 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:48:31.120053 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:48:31.120053 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:48:31.120053 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:48:31.120053 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:48:31.120053 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 12:48:31.120953 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 12:48:31.120953 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:48:31.120953 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 14 12:48:31.120953 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 278/566] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Oct 14 12:48:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:48:31.121617 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cfa098-d583-4413-b248-02ea3ec602cd None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:31.126243 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:31.156097 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e258787c-e9da-4774-9b56-85b02cc966b9 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:31.192624 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddf4298-2190-4a8f-a26a-768299638085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:31.193237 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddf4298-2190-4a8f-a26a-768299638085 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:31.193514 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddf4298-2190-4a8f-a26a-768299638085 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:31.193786 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddf4298-2190-4a8f-a26a-768299638085 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:31.194657 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddf4298-2190-4a8f-a26a-768299638085 None admin] RBAC: Adding query filter params (role.id=7f6e29e390bc41f7a9af17659a2e95d1, scope.project.id=2486e73d493b40e18d9d988744993854, user.id=931f4e32c8764514b5efed31b0785be7) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:31.194975 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddf4298-2190-4a8f-a26a-768299638085 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:31.196495 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddf4298-2190-4a8f-a26a-768299638085 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:31.210481 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 289/567] 10.222.0.17 () {56 vars in 1374 bytes} [Fri Oct 14 12:48:31 2022] GET /identity/v3/role_assignments?user.id=931f4e32c8764514b5efed31b0785be7&scope.project.id=2486e73d493b40e18d9d988744993854&role.id=7f6e29e390bc41f7a9af17659a2e95d1 => generated 608 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:31.211511 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddf4298-2190-4a8f-a26a-768299638085 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:31.258215 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cfa098-d583-4413-b248-02ea3ec602cd None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:31.307658 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ca21e4-aa55-4b6f-a3fc-149f7aacb5d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:31.308885 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ca21e4-aa55-4b6f-a3fc-149f7aacb5d7 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:31.309400 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ca21e4-aa55-4b6f-a3fc-149f7aacb5d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:31.310004 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ca21e4-aa55-4b6f-a3fc-149f7aacb5d7 None admin] PATH_INFO: `/v3/domains` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:31.310992 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ca21e4-aa55-4b6f-a3fc-149f7aacb5d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:31.311517 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ca21e4-aa55-4b6f-a3fc-149f7aacb5d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:31.313117 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ca21e4-aa55-4b6f-a3fc-149f7aacb5d7 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:31.347485 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 279/568] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Oct 14 12:48:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:31.355006 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ca21e4-aa55-4b6f-a3fc-149f7aacb5d7 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:31.404199 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddf4298-2190-4a8f-a26a-768299638085 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:31.428242 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:31.464699 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5398583-7c4d-48db-8b04-d9b361f96d3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:31.465340 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5398583-7c4d-48db-8b04-d9b361f96d3e None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:31.465619 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5398583-7c4d-48db-8b04-d9b361f96d3e None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:31.465891 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5398583-7c4d-48db-8b04-d9b361f96d3e None admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:31.466593 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5398583-7c4d-48db-8b04-d9b361f96d3e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:31.466898 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5398583-7c4d-48db-8b04-d9b361f96d3e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:31.468672 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5398583-7c4d-48db-8b04-d9b361f96d3e None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:31.495732 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 290/569] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Oct 14 12:48:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:31.501345 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5398583-7c4d-48db-8b04-d9b361f96d3e None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:31.508871 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:31.561750 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ca21e4-aa55-4b6f-a3fc-149f7aacb5d7 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:31.615382 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad432ffb-52f1-4ddc-b989-c0fdd5fec3fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:31.617034 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad432ffb-52f1-4ddc-b989-c0fdd5fec3fa None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:31.617560 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad432ffb-52f1-4ddc-b989-c0fdd5fec3fa None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:31.618049 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad432ffb-52f1-4ddc-b989-c0fdd5fec3fa None admin] PATH_INFO: `/v3/projects/service` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:31.627810 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad432ffb-52f1-4ddc-b989-c0fdd5fec3fa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:31.629825 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad432ffb-52f1-4ddc-b989-c0fdd5fec3fa None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:31.632523 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5398583-7c4d-48db-8b04-d9b361f96d3e None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:31.645804 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-ad432ffb-52f1-4ddc-b989-c0fdd5fec3fa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 12:48:31.645804 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:31.645804 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:48:31.645804 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:48:31.645804 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:48:31.645804 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:48:31.645804 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:48:31.645804 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:48:31.645804 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:48:31.645804 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:48:31.645804 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:48:31.645804 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:48:31.645804 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 14 12:48:31.645804 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 14 12:48:31.645804 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 14 12:48:31.646844 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 14 12:48:31.646844 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:48:31.646844 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:48:31.646844 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:48:31.646844 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:48:31.646844 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:48:31.646844 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:48:31.646844 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:48:31.646844 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 14 12:48:31.646844 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:48:31.646844 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:48:31.646844 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:48:31.646844 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:48:31.646844 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:48:31.646844 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:48:31.646844 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:48:31.646844 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:48:31.647733 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 14 12:48:31.647733 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 14 12:48:31.647733 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 14 12:48:31.647733 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 14 12:48:31.647733 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 14 12:48:31.647733 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 14 12:48:31.647733 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 12:48:31.647733 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 14 12:48:31.650270 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 280/570] 10.222.0.17 () {56 vars in 1111 bytes} [Fri Oct 14 12:48:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 14 12:48:31.656997 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad432ffb-52f1-4ddc-b989-c0fdd5fec3fa None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:31.681673 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab877b8-2085-4dca-929e-94e700cbb4c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:31.682806 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab877b8-2085-4dca-929e-94e700cbb4c3 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:31.683131 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab877b8-2085-4dca-929e-94e700cbb4c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:31.683386 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab877b8-2085-4dca-929e-94e700cbb4c3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:31.691840 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab877b8-2085-4dca-929e-94e700cbb4c3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:31.693316 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab877b8-2085-4dca-929e-94e700cbb4c3 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:31.706941 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-bab877b8-2085-4dca-929e-94e700cbb4c3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 12:48:31.706941 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:31.706941 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:48:31.706941 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:48:31.706941 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:48:31.706941 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:48:31.706941 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:48:31.706941 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:48:31.706941 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:48:31.706941 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:48:31.706941 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:48:31.706941 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:48:31.706941 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 14 12:48:31.706941 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 14 12:48:31.706941 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 14 12:48:31.707895 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 14 12:48:31.707895 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:48:31.707895 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:48:31.707895 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:48:31.707895 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:48:31.707895 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:48:31.707895 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:48:31.707895 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:48:31.707895 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 14 12:48:31.707895 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:48:31.707895 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:48:31.707895 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:48:31.707895 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:48:31.707895 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:48:31.707895 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:48:31.707895 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:48:31.707895 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:48:31.708789 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 14 12:48:31.708789 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 14 12:48:31.708789 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 14 12:48:31.708789 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 14 12:48:31.708789 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 14 12:48:31.708789 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 14 12:48:31.708789 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 12:48:31.708789 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 14 12:48:31.708789 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 291/571] 10.222.0.17 () {56 vars in 1111 bytes} [Fri Oct 14 12:48:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:48:31.719183 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab877b8-2085-4dca-929e-94e700cbb4c3 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:31.809602 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:31.811128 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad432ffb-52f1-4ddc-b989-c0fdd5fec3fa None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:31.878575 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:31.910985 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3293fd62-9d0c-4f12-ad66-aaa60c7a90a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:31.911614 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3293fd62-9d0c-4f12-ad66-aaa60c7a90a0 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:31.911896 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3293fd62-9d0c-4f12-ad66-aaa60c7a90a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:31.912162 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3293fd62-9d0c-4f12-ad66-aaa60c7a90a0 None admin] PATH_INFO: `/v3/projects` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:31.912869 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3293fd62-9d0c-4f12-ad66-aaa60c7a90a0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:31.913176 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3293fd62-9d0c-4f12-ad66-aaa60c7a90a0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:31.914662 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3293fd62-9d0c-4f12-ad66-aaa60c7a90a0 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:31.936476 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab877b8-2085-4dca-929e-94e700cbb4c3 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:31.937722 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 281/572] 10.222.0.17 () {56 vars in 1148 bytes} [Fri Oct 14 12:48:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:31.944483 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3293fd62-9d0c-4f12-ad66-aaa60c7a90a0 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:32.002410 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3a2fba-9a75-4f30-8398-f4605a15b9e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:32.005532 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3a2fba-9a75-4f30-8398-f4605a15b9e6 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:32.006038 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3a2fba-9a75-4f30-8398-f4605a15b9e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:32.008545 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3a2fba-9a75-4f30-8398-f4605a15b9e6 None admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:32.010500 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3a2fba-9a75-4f30-8398-f4605a15b9e6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:32.010828 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3a2fba-9a75-4f30-8398-f4605a15b9e6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:32.012392 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3a2fba-9a75-4f30-8398-f4605a15b9e6 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:32.052738 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 292/573] 10.222.0.17 () {56 vars in 1148 bytes} [Fri Oct 14 12:48:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:32.057588 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5ccd6e-cba9-4620-8232-a8706d3c155d None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:32.057909 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5ccd6e-cba9-4620-8232-a8706d3c155d None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:32.058156 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5ccd6e-cba9-4620-8232-a8706d3c155d None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:32.061111 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 293/574] 10.222.0.17 () {54 vars in 927 bytes} [Fri Oct 14 12:48:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 14 12:48:32.061927 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5ccd6e-cba9-4620-8232-a8706d3c155d None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:32.113385 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3293fd62-9d0c-4f12-ad66-aaa60c7a90a0 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:32.168126 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b924446-16e7-4065-9390-4bd514609d41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:32.169465 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b924446-16e7-4065-9390-4bd514609d41 None admin] REQUEST_METHOD: `PUT` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:32.169896 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b924446-16e7-4065-9390-4bd514609d41 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:32.170376 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b924446-16e7-4065-9390-4bd514609d41 None admin] PATH_INFO: `/v3/projects/2486e73d493b40e18d9d988744993854/users/86c9fc57b1ec4d00b9f392877f277284/roles/7f6e29e390bc41f7a9af17659a2e95d1` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:32.173093 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b924446-16e7-4065-9390-4bd514609d41 None admin] RBAC: Authorizing `identity:create_grant(project_id=2486e73d493b40e18d9d988744993854, user_id=86c9fc57b1ec4d00b9f392877f277284, role_id=7f6e29e390bc41f7a9af17659a2e95d1)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:32.175119 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b924446-16e7-4065-9390-4bd514609d41 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:32.186038 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:32.193021 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5ccd6e-cba9-4620-8232-a8706d3c155d None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:32.194907 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 282/575] 10.222.0.17 () {58 vars in 1439 bytes} [Fri Oct 14 12:48:31 2022] PUT /identity/v3/projects/2486e73d493b40e18d9d988744993854/users/86c9fc57b1ec4d00b9f392877f277284/roles/7f6e29e390bc41f7a9af17659a2e95d1 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 12:48:32.196656 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2092044f-4067-4b42-b1cc-431d6c29f9b3 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:32.197145 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2092044f-4067-4b42-b1cc-431d6c29f9b3 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:32.198539 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2092044f-4067-4b42-b1cc-431d6c29f9b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:32.223579 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-2092044f-4067-4b42-b1cc-431d6c29f9b3 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:48:32.224668 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-2092044f-4067-4b42-b1cc-431d6c29f9b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:48:32.243229 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dce698-c3c7-49fc-8bd8-ea8874324c8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:32.244331 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dce698-c3c7-49fc-8bd8-ea8874324c8c None admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:32.244845 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dce698-c3c7-49fc-8bd8-ea8874324c8c None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:32.245376 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dce698-c3c7-49fc-8bd8-ea8874324c8c None admin] PATH_INFO: `/v3/projects/2486e73d493b40e18d9d988744993854/users/b83a5a78f3e7486293907cb3012c0ad5/roles/2d0a16b1c5634daf99f2b7ac092d1ddd` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:32.267807 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dce698-c3c7-49fc-8bd8-ea8874324c8c None admin] RBAC: Authorizing `identity:create_grant(project_id=2486e73d493b40e18d9d988744993854, user_id=b83a5a78f3e7486293907cb3012c0ad5, role_id=2d0a16b1c5634daf99f2b7ac092d1ddd)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:32.270654 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dce698-c3c7-49fc-8bd8-ea8874324c8c None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:32.294713 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 294/576] 10.222.0.17 () {58 vars in 1439 bytes} [Fri Oct 14 12:48:32 2022] PUT /identity/v3/projects/2486e73d493b40e18d9d988744993854/users/b83a5a78f3e7486293907cb3012c0ad5/roles/2d0a16b1c5634daf99f2b7ac092d1ddd => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 12:48:32.306487 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:32.361437 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 283/577] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Oct 14 12:48:32 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 14 12:48:32.694352 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dce698-c3c7-49fc-8bd8-ea8874324c8c None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:32.848468 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dce698-c3c7-49fc-8bd8-ea8874324c8c None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:32.895093 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defd9528-4e4b-41af-8581-cb6532e04e50 None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:32.895871 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defd9528-4e4b-41af-8581-cb6532e04e50 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:32.895871 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defd9528-4e4b-41af-8581-cb6532e04e50 None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:32.897173 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 284/578] 10.222.0.17 () {54 vars in 927 bytes} [Fri Oct 14 12:48:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 14 12:48:32.904979 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33a9ad0-8afe-49bb-980b-cac0a54fcb5e None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:32.905342 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33a9ad0-8afe-49bb-980b-cac0a54fcb5e None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:32.905502 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33a9ad0-8afe-49bb-980b-cac0a54fcb5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:32.906883 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19070d06-f07c-4671-99a8-f6994f623a4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:32.907526 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19070d06-f07c-4671-99a8-f6994f623a4a None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:32.907801 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19070d06-f07c-4671-99a8-f6994f623a4a None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:32.908070 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19070d06-f07c-4671-99a8-f6994f623a4a None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:32.909196 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19070d06-f07c-4671-99a8-f6994f623a4a None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:32.910648 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19070d06-f07c-4671-99a8-f6994f623a4a None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:32.924920 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-19070d06-f07c-4671-99a8-f6994f623a4a None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 14 12:48:32.924920 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:32.924920 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 14 12:48:32.924920 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 14 12:48:32.924920 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 14 12:48:32.924920 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 14 12:48:32.924920 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 14 12:48:32.924920 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 12:48:32.924920 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 14 12:48:32.924920 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 14 12:48:32.924920 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 14 12:48:32.924920 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 14 12:48:32.924920 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:32.924920 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:48:32.924920 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:48:32.924920 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:48:32.924920 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:48:32.926036 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:48:32.926036 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:48:32.926036 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:48:32.926036 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:48:32.926036 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:48:32.926036 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:48:32.926036 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 14 12:48:32.926036 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 14 12:48:32.926036 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 14 12:48:32.926036 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 14 12:48:32.926036 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:48:32.926036 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:48:32.926036 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:48:32.926036 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:48:32.926036 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:48:32.926036 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:48:32.926950 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:48:32.926950 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 14 12:48:32.926950 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:48:32.926950 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:48:32.926950 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:48:32.926950 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:48:32.926950 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:48:32.926950 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:48:32.926950 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:48:32.926950 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:48:32.926950 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 14 12:48:32.926950 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 12:48:32.926950 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 14 12:48:32.926950 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 14 12:48:32.927934 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 295/579] 10.222.0.17 () {56 vars in 1129 bytes} [Fri Oct 14 12:48:32 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:48:32.936974 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19070d06-f07c-4671-99a8-f6994f623a4a None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:32.951244 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-f33a9ad0-8afe-49bb-980b-cac0a54fcb5e None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:48:32.952375 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-f33a9ad0-8afe-49bb-980b-cac0a54fcb5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:48:32.978784 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:33.085460 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 285/580] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Oct 14 12:48:32 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 14 12:48:33.168156 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19070d06-f07c-4671-99a8-f6994f623a4a None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:33.238912 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd13d017-6d9b-45de-add6-bdef139e4768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:33.239461 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd13d017-6d9b-45de-add6-bdef139e4768 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:33.239741 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd13d017-6d9b-45de-add6-bdef139e4768 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:33.240010 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd13d017-6d9b-45de-add6-bdef139e4768 None admin] PATH_INFO: `/v3/services` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:33.240650 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd13d017-6d9b-45de-add6-bdef139e4768 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:33.240953 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd13d017-6d9b-45de-add6-bdef139e4768 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:33.242376 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd13d017-6d9b-45de-add6-bdef139e4768 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:33.250390 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 296/581] 10.222.0.17 () {56 vars in 1124 bytes} [Fri Oct 14 12:48:32 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:33.256783 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33a9ad0-8afe-49bb-980b-cac0a54fcb5e None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:33.414373 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33a9ad0-8afe-49bb-980b-cac0a54fcb5e None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:33.417639 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:33.460428 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f07db3a-0090-45de-a4a0-65399bf12720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:33.461049 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f07db3a-0090-45de-a4a0-65399bf12720 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:33.461389 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f07db3a-0090-45de-a4a0-65399bf12720 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:33.461677 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f07db3a-0090-45de-a4a0-65399bf12720 None admin] PATH_INFO: `/v3/services` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:33.462394 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f07db3a-0090-45de-a4a0-65399bf12720 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:33.462713 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f07db3a-0090-45de-a4a0-65399bf12720 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:33.464396 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f07db3a-0090-45de-a4a0-65399bf12720 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:33.470480 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 286/582] 10.222.0.17 () {56 vars in 1124 bytes} [Fri Oct 14 12:48:33 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:33.479268 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd13d017-6d9b-45de-add6-bdef139e4768 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:33.498780 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f07db3a-0090-45de-a4a0-65399bf12720 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:33.655920 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:33.692821 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd13d017-6d9b-45de-add6-bdef139e4768 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:33.703679 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f07db3a-0090-45de-a4a0-65399bf12720 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:33.757162 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63a2c8f-adda-4021-b49d-ff3b4ffc21b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:33.758027 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63a2c8f-adda-4021-b49d-ff3b4ffc21b4 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:33.758501 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63a2c8f-adda-4021-b49d-ff3b4ffc21b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:33.758936 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63a2c8f-adda-4021-b49d-ff3b4ffc21b4 None admin] PATH_INFO: `/v3/services/network` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:33.759408 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce9af38-49bc-48c5-b210-219f3c0be8ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:33.759874 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63a2c8f-adda-4021-b49d-ff3b4ffc21b4 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:33.760026 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce9af38-49bc-48c5-b210-219f3c0be8ac None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:33.760305 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce9af38-49bc-48c5-b210-219f3c0be8ac None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:33.760578 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce9af38-49bc-48c5-b210-219f3c0be8ac None admin] PATH_INFO: `/v3/endpoints` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:33.761283 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce9af38-49bc-48c5-b210-219f3c0be8ac None admin] RBAC: Adding query filter params (interface=public, service_id=8bae78f7974646bd8c02a0fb8122d86e, region_id=RegionOne) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:33.761591 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce9af38-49bc-48c5-b210-219f3c0be8ac None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:33.762456 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63a2c8f-adda-4021-b49d-ff3b4ffc21b4 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:33.762977 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce9af38-49bc-48c5-b210-219f3c0be8ac None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:33.773077 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-e63a2c8f-adda-4021-b49d-ff3b4ffc21b4 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 14 12:48:33.773077 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:33.773077 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 14 12:48:33.773077 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 14 12:48:33.773077 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 14 12:48:33.773077 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 14 12:48:33.773077 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 14 12:48:33.773077 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 12:48:33.773077 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 14 12:48:33.773077 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 14 12:48:33.773077 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 14 12:48:33.773077 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 14 12:48:33.773077 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:33.773077 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:48:33.773077 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:48:33.773077 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:48:33.773077 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:48:33.774427 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:48:33.774427 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:48:33.774427 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:48:33.774427 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:48:33.774427 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:48:33.774427 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:48:33.774427 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 14 12:48:33.774427 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 14 12:48:33.774427 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 14 12:48:33.774427 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 14 12:48:33.774427 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:48:33.774427 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:48:33.774427 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:48:33.774427 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:48:33.774427 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:48:33.774427 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:48:33.775506 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:48:33.775506 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 14 12:48:33.775506 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:48:33.775506 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:48:33.775506 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:48:33.775506 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:48:33.775506 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:48:33.775506 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:48:33.775506 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:48:33.775506 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:48:33.775506 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 14 12:48:33.775506 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 12:48:33.775506 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 14 12:48:33.775506 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 14 12:48:33.777900 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 287/583] 10.222.0.17 () {56 vars in 1111 bytes} [Fri Oct 14 12:48:33 2022] GET /identity/v3/services/network => generated 88 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 14 12:48:33.782267 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 297/584] 10.222.0.17 () {56 vars in 1251 bytes} [Fri Oct 14 12:48:33 2022] GET /identity/v3/endpoints?service_id=8bae78f7974646bd8c02a0fb8122d86e&interface=public®ion_id=RegionOne => generated 194 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:33.784738 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63a2c8f-adda-4021-b49d-ff3b4ffc21b4 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:33.786696 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce9af38-49bc-48c5-b210-219f3c0be8ac None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:33.822825 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:33.953459 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce9af38-49bc-48c5-b210-219f3c0be8ac None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:33.986160 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63a2c8f-adda-4021-b49d-ff3b4ffc21b4 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:33.994568 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97921169-c016-4ad7-b485-47ec47618f01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:33.995173 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97921169-c016-4ad7-b485-47ec47618f01 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:33.995448 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97921169-c016-4ad7-b485-47ec47618f01 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:33.995715 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97921169-c016-4ad7-b485-47ec47618f01 None admin] PATH_INFO: `/v3/services` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:33.996322 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97921169-c016-4ad7-b485-47ec47618f01 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:33.997810 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97921169-c016-4ad7-b485-47ec47618f01 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:34.004473 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 298/585] 10.222.0.17 () {56 vars in 1087 bytes} [Fri Oct 14 12:48:33 2022] GET /identity/v3/services => generated 772 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 12:48:34.005934 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909df448-1ac0-465d-a53f-62975bb63981 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:34.006251 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909df448-1ac0-465d-a53f-62975bb63981 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:34.006633 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909df448-1ac0-465d-a53f-62975bb63981 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:34.012534 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 299/586] 10.222.0.17 () {54 vars in 927 bytes} [Fri Oct 14 12:48:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:48:34.014321 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043387be-4bb7-4508-b13f-9a6e6914b8bd None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:34.014608 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043387be-4bb7-4508-b13f-9a6e6914b8bd None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:34.014886 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043387be-4bb7-4508-b13f-9a6e6914b8bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:34.034550 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:34.037036 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-043387be-4bb7-4508-b13f-9a6e6914b8bd None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:48:34.038390 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-043387be-4bb7-4508-b13f-9a6e6914b8bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:48:34.044051 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355ae68c-c307-4c6b-a6e7-711004a50994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:34.044711 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355ae68c-c307-4c6b-a6e7-711004a50994 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:34.044997 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355ae68c-c307-4c6b-a6e7-711004a50994 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:34.045275 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355ae68c-c307-4c6b-a6e7-711004a50994 None admin] PATH_INFO: `/v3/services` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:34.045939 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355ae68c-c307-4c6b-a6e7-711004a50994 None admin] RBAC: Adding query filter params (name=network) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:34.046280 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355ae68c-c307-4c6b-a6e7-711004a50994 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:34.047732 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355ae68c-c307-4c6b-a6e7-711004a50994 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:34.059094 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 288/587] 10.222.0.17 () {56 vars in 1112 bytes} [Fri Oct 14 12:48:33 2022] GET /identity/v3/services?name=network => generated 124 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:34.065734 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355ae68c-c307-4c6b-a6e7-711004a50994 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:34.194020 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 300/588] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Oct 14 12:48:34 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 14 12:48:34.234499 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:34.244417 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355ae68c-c307-4c6b-a6e7-711004a50994 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:34.287069 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aceb33f7-7b18-422f-9e9f-ee94e73e5235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:34.288562 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceb33f7-7b18-422f-9e9f-ee94e73e5235 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:34.289052 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceb33f7-7b18-422f-9e9f-ee94e73e5235 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:34.289533 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceb33f7-7b18-422f-9e9f-ee94e73e5235 None admin] PATH_INFO: `/v3/services` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:34.290702 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aceb33f7-7b18-422f-9e9f-ee94e73e5235 None admin] RBAC: Adding query filter params (type=network) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:34.291069 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aceb33f7-7b18-422f-9e9f-ee94e73e5235 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:34.293659 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aceb33f7-7b18-422f-9e9f-ee94e73e5235 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:34.303333 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 289/589] 10.222.0.17 () {56 vars in 1112 bytes} [Fri Oct 14 12:48:34 2022] GET /identity/v3/services?type=network => generated 350 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 12:48:34.310251 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043387be-4bb7-4508-b13f-9a6e6914b8bd None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:34.439036 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043387be-4bb7-4508-b13f-9a6e6914b8bd None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:34.480154 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d6fc26-6943-4467-b180-1d7ef52d3155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:34.480776 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d6fc26-6943-4467-b180-1d7ef52d3155 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:34.481055 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d6fc26-6943-4467-b180-1d7ef52d3155 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:34.481331 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d6fc26-6943-4467-b180-1d7ef52d3155 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:34.482169 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d6fc26-6943-4467-b180-1d7ef52d3155 None admin] RBAC: Adding query filter params (interface=public, service_id=8ac59f35046f4d31bfa1b975fedce444, region_id=RegionOne) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:34.482487 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d6fc26-6943-4467-b180-1d7ef52d3155 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:34.484484 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d6fc26-6943-4467-b180-1d7ef52d3155 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:34.491405 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:34.495943 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 301/590] 10.222.0.17 () {56 vars in 1251 bytes} [Fri Oct 14 12:48:34 2022] GET /identity/v3/endpoints?service_id=8ac59f35046f4d31bfa1b975fedce444&interface=public®ion_id=RegionOne => generated 194 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:34.501663 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aceb33f7-7b18-422f-9e9f-ee94e73e5235 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:34.555884 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d6fc26-6943-4467-b180-1d7ef52d3155 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:34.668667 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d6fc26-6943-4467-b180-1d7ef52d3155 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:34.673278 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aceb33f7-7b18-422f-9e9f-ee94e73e5235 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:34.711556 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd8bb44-a77b-4476-8a61-5ce664478d8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:34.712545 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd8bb44-a77b-4476-8a61-5ce664478d8e None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:34.713217 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd8bb44-a77b-4476-8a61-5ce664478d8e None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:34.716406 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd8bb44-a77b-4476-8a61-5ce664478d8e None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:34.717237 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd8bb44-a77b-4476-8a61-5ce664478d8e None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:34.718879 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd8bb44-a77b-4476-8a61-5ce664478d8e None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:34.732988 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-ffd8bb44-a77b-4476-8a61-5ce664478d8e None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 14 12:48:34.732988 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:34.732988 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 14 12:48:34.732988 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 14 12:48:34.732988 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 14 12:48:34.732988 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 14 12:48:34.732988 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 14 12:48:34.732988 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 12:48:34.732988 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 14 12:48:34.732988 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 14 12:48:34.732988 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 14 12:48:34.732988 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 14 12:48:34.732988 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:34.732988 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:48:34.732988 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:48:34.732988 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:48:34.734288 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:48:34.734288 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:48:34.734288 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:48:34.734288 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:48:34.734288 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:48:34.734288 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:48:34.734288 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:48:34.734288 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 14 12:48:34.734288 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 14 12:48:34.734288 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 14 12:48:34.734288 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 14 12:48:34.734288 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:48:34.734288 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:48:34.734288 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:48:34.734288 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:48:34.734288 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:48:34.734288 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:48:34.735151 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:48:34.735151 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 14 12:48:34.735151 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:48:34.735151 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:48:34.735151 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:48:34.735151 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:48:34.735151 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:48:34.735151 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:48:34.735151 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:48:34.735151 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:48:34.735151 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 14 12:48:34.735151 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 12:48:34.735151 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 14 12:48:34.735151 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 14 12:48:34.748241 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 302/591] 10.222.0.17 () {56 vars in 1132 bytes} [Fri Oct 14 12:48:34 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 14 12:48:34.750658 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd8bb44-a77b-4476-8a61-5ce664478d8e None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:34.757590 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002d912a-5782-4a9b-a9ce-6d0828d0008b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:34.758565 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002d912a-5782-4a9b-a9ce-6d0828d0008b None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:34.759066 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002d912a-5782-4a9b-a9ce-6d0828d0008b None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:34.759568 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002d912a-5782-4a9b-a9ce-6d0828d0008b None admin] PATH_INFO: `/v3/services` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:34.760377 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002d912a-5782-4a9b-a9ce-6d0828d0008b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:34.762620 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002d912a-5782-4a9b-a9ce-6d0828d0008b None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:34.774956 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 290/592] 10.222.0.17 () {56 vars in 1087 bytes} [Fri Oct 14 12:48:34 2022] GET /identity/v3/services => generated 772 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:34.856063 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:34.915758 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd8bb44-a77b-4476-8a61-5ce664478d8e None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:34.979962 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02b48b9-736c-43b9-8f33-250aa2ffdf25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:34.980698 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02b48b9-736c-43b9-8f33-250aa2ffdf25 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:34.980963 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02b48b9-736c-43b9-8f33-250aa2ffdf25 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:34.981165 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02b48b9-736c-43b9-8f33-250aa2ffdf25 None admin] PATH_INFO: `/v3/services` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:34.981834 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02b48b9-736c-43b9-8f33-250aa2ffdf25 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:34.982162 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02b48b9-736c-43b9-8f33-250aa2ffdf25 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:34.983905 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02b48b9-736c-43b9-8f33-250aa2ffdf25 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:34.995061 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 303/593] 10.222.0.17 () {56 vars in 1126 bytes} [Fri Oct 14 12:48:34 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 12:48:35.001157 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002d912a-5782-4a9b-a9ce-6d0828d0008b None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:35.038019 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:35.136830 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f67cc73-046e-4ccf-b300-e379e2fa4107 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:35.137012 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f67cc73-046e-4ccf-b300-e379e2fa4107 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:35.137298 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f67cc73-046e-4ccf-b300-e379e2fa4107 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:35.138695 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 304/594] 10.222.0.17 () {54 vars in 927 bytes} [Fri Oct 14 12:48:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 14 12:48:35.144198 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca05042-983a-4200-88e2-1d1627750b4b None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:35.144500 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca05042-983a-4200-88e2-1d1627750b4b None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:35.144745 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca05042-983a-4200-88e2-1d1627750b4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:35.146036 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002d912a-5782-4a9b-a9ce-6d0828d0008b None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:35.183093 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457407e9-c484-4f1d-90c1-add4fbf62737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:35.183836 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457407e9-c484-4f1d-90c1-add4fbf62737 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:35.184217 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457407e9-c484-4f1d-90c1-add4fbf62737 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:35.184642 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457407e9-c484-4f1d-90c1-add4fbf62737 None admin] PATH_INFO: `/v3/services` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:35.185430 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457407e9-c484-4f1d-90c1-add4fbf62737 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:35.185843 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457407e9-c484-4f1d-90c1-add4fbf62737 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:35.187490 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457407e9-c484-4f1d-90c1-add4fbf62737 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:35.188568 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-eca05042-983a-4200-88e2-1d1627750b4b None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:48:35.190236 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-eca05042-983a-4200-88e2-1d1627750b4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:48:35.194172 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 291/595] 10.222.0.17 () {56 vars in 1126 bytes} [Fri Oct 14 12:48:35 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:35.296112 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 305/596] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Oct 14 12:48:35 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 14 12:48:35.595598 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dddeac4-15a3-4d37-aefb-bc1b1baf6fc5 None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:35.596314 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dddeac4-15a3-4d37-aefb-bc1b1baf6fc5 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:35.596914 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dddeac4-15a3-4d37-aefb-bc1b1baf6fc5 None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:35.598787 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 292/597] 10.222.0.17 () {54 vars in 927 bytes} [Fri Oct 14 12:48:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:48:35.604908 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f9086d-70ae-4431-9180-073dadebf73e None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:35.605475 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f9086d-70ae-4431-9180-073dadebf73e None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:35.605978 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f9086d-70ae-4431-9180-073dadebf73e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:35.625875 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-b9f9086d-70ae-4431-9180-073dadebf73e None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:48:35.628048 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-b9f9086d-70ae-4431-9180-073dadebf73e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:48:35.638799 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dddeac4-15a3-4d37-aefb-bc1b1baf6fc5 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:35.709407 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:35.744278 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 306/598] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Oct 14 12:48:35 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 14 12:48:35.790340 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:35.821033 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dddeac4-15a3-4d37-aefb-bc1b1baf6fc5 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:35.912320 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d403ed54-a441-45c8-836d-d83e7e48af8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:35.913232 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d403ed54-a441-45c8-836d-d83e7e48af8e None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:35.913655 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d403ed54-a441-45c8-836d-d83e7e48af8e None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:35.914078 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d403ed54-a441-45c8-836d-d83e7e48af8e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:35.940273 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d403ed54-a441-45c8-836d-d83e7e48af8e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 12:48:35.948667 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-d403ed54-a441-45c8-836d-d83e7e48af8e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 14 12:48:35.948667 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:35.948667 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:48:35.948667 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:48:35.948667 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:48:35.948667 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:48:35.948667 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:48:35.948667 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:48:35.948667 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:48:35.948667 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:48:35.948667 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:48:35.948667 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:48:35.948667 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 12:48:35.948667 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 12:48:35.948667 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 12:48:35.948667 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 12:48:35.949972 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 12:48:35.949972 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 12:48:35.949972 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 12:48:35.949972 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 12:48:35.949972 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:48:35.949972 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:48:35.949972 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:48:35.949972 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:48:35.949972 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:48:35.949972 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:48:35.949972 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:48:35.949972 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 14 12:48:35.949972 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:48:35.949972 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:48:35.949972 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:48:35.949972 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:48:35.951496 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:48:35.951496 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:48:35.951496 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:48:35.951496 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:48:35.951496 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 12:48:35.951496 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 12:48:35.951496 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 12:48:35.951496 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 12:48:35.951496 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 12:48:35.951496 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 12:48:35.951496 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 14 12:48:35.951496 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 14 12:48:35.951496 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 293/599] 10.222.0.17 () {56 vars in 1096 bytes} [Fri Oct 14 12:48:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:48:35.959439 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f9086d-70ae-4431-9180-073dadebf73e None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:36.130254 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f9086d-70ae-4431-9180-073dadebf73e None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:36.168028 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0638010b-9f84-443d-a3af-2984b1efc5e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:36.168570 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0638010b-9f84-443d-a3af-2984b1efc5e5 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:36.168849 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0638010b-9f84-443d-a3af-2984b1efc5e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:36.169121 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0638010b-9f84-443d-a3af-2984b1efc5e5 None admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:36.169795 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0638010b-9f84-443d-a3af-2984b1efc5e5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:36.170098 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0638010b-9f84-443d-a3af-2984b1efc5e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:36.171572 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0638010b-9f84-443d-a3af-2984b1efc5e5 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:36.188710 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 307/600] 10.222.0.17 () {56 vars in 1099 bytes} [Fri Oct 14 12:48:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 12:48:36.192727 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d403ed54-a441-45c8-836d-d83e7e48af8e None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:36.197354 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0638010b-9f84-443d-a3af-2984b1efc5e5 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:36.312211 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:36.400698 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d403ed54-a441-45c8-836d-d83e7e48af8e None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:36.409813 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0638010b-9f84-443d-a3af-2984b1efc5e5 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:36.473840 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45d05d0-12e9-48dd-895b-0ef39d70927f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:36.474407 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45d05d0-12e9-48dd-895b-0ef39d70927f None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:36.474683 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45d05d0-12e9-48dd-895b-0ef39d70927f None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:36.474952 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45d05d0-12e9-48dd-895b-0ef39d70927f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:36.483991 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5882c6-b572-4104-824f-95843eb69c8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:36.484627 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5882c6-b572-4104-824f-95843eb69c8d None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:36.484900 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5882c6-b572-4104-824f-95843eb69c8d None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:36.485165 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5882c6-b572-4104-824f-95843eb69c8d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:36.501703 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45d05d0-12e9-48dd-895b-0ef39d70927f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 12:48:36.510433 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5882c6-b572-4104-824f-95843eb69c8d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:36.511943 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5882c6-b572-4104-824f-95843eb69c8d None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:36.512741 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-e45d05d0-12e9-48dd-895b-0ef39d70927f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 14 12:48:36.512741 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:36.512741 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:48:36.512741 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:48:36.512741 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:48:36.512741 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:48:36.512741 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:48:36.512741 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:48:36.512741 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:48:36.512741 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:48:36.512741 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:48:36.512741 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:48:36.512741 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 12:48:36.512741 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 12:48:36.512741 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 12:48:36.512741 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 12:48:36.513699 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 12:48:36.513699 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 12:48:36.513699 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 12:48:36.513699 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 12:48:36.513699 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:48:36.513699 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:48:36.513699 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:48:36.513699 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:48:36.513699 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:48:36.513699 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:48:36.513699 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:48:36.513699 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 14 12:48:36.513699 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:48:36.513699 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:48:36.513699 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:48:36.513699 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:48:36.514553 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:48:36.514553 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:48:36.514553 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:48:36.514553 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:48:36.514553 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 12:48:36.514553 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 12:48:36.514553 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 12:48:36.514553 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 12:48:36.514553 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 12:48:36.514553 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 12:48:36.514553 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 14 12:48:36.514553 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 14 12:48:36.514553 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 294/601] 10.222.0.17 () {56 vars in 1102 bytes} [Fri Oct 14 12:48:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:48:36.521113 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45d05d0-12e9-48dd-895b-0ef39d70927f None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:36.537716 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:36.545080 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-4e5882c6-b572-4104-824f-95843eb69c8d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:48:36.545080 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:36.545080 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:48:36.545080 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:48:36.545080 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:48:36.545080 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:48:36.545080 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:48:36.545080 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:48:36.545080 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:48:36.545080 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:48:36.545080 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:48:36.545080 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:48:36.545080 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 12:48:36.545080 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 12:48:36.545080 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 12:48:36.545080 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 12:48:36.547316 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:48:36.547316 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:48:36.547316 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:48:36.547316 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:48:36.547316 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:48:36.547316 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:48:36.547316 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:48:36.547316 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 14 12:48:36.547316 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:48:36.547316 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:48:36.547316 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:48:36.547316 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:48:36.547316 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:48:36.547316 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:48:36.547316 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:48:36.547316 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:48:36.547316 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 12:48:36.549954 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 12:48:36.549954 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:48:36.549954 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 14 12:48:36.549954 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 308/602] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Oct 14 12:48:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 353 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 14 12:48:36.557713 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5882c6-b572-4104-824f-95843eb69c8d None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:36.742055 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5882c6-b572-4104-824f-95843eb69c8d None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:36.742253 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45d05d0-12e9-48dd-895b-0ef39d70927f None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:36.745303 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:36.806039 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d978d4-480b-4774-af0c-c34e000a3fbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:36.806679 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d978d4-480b-4774-af0c-c34e000a3fbf None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:36.806961 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d978d4-480b-4774-af0c-c34e000a3fbf None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:36.807224 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d978d4-480b-4774-af0c-c34e000a3fbf None admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:36.810463 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea9cec7-89d4-4226-8dc1-44e1fb5f19ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:36.811072 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea9cec7-89d4-4226-8dc1-44e1fb5f19ed None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:36.811343 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea9cec7-89d4-4226-8dc1-44e1fb5f19ed None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:36.811611 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea9cec7-89d4-4226-8dc1-44e1fb5f19ed None admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:36.812280 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea9cec7-89d4-4226-8dc1-44e1fb5f19ed None admin] RBAC: Adding query filter params (name=service) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:36.812580 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea9cec7-89d4-4226-8dc1-44e1fb5f19ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:36.813949 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea9cec7-89d4-4226-8dc1-44e1fb5f19ed None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:36.815064 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d978d4-480b-4774-af0c-c34e000a3fbf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:36.815670 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d978d4-480b-4774-af0c-c34e000a3fbf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:36.822172 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d978d4-480b-4774-af0c-c34e000a3fbf None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:36.837421 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 309/603] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Oct 14 12:48:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:36.837960 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 295/604] 10.222.0.17 () {56 vars in 1103 bytes} [Fri Oct 14 12:48:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:36.842951 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea9cec7-89d4-4226-8dc1-44e1fb5f19ed None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:36.843752 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d978d4-480b-4774-af0c-c34e000a3fbf None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:36.994027 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:37.067341 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea9cec7-89d4-4226-8dc1-44e1fb5f19ed None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:37.071150 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d978d4-480b-4774-af0c-c34e000a3fbf None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:37.138791 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d525cf-3137-4dba-aa98-846e4ac375f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:37.139486 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d525cf-3137-4dba-aa98-846e4ac375f1 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:37.139758 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d525cf-3137-4dba-aa98-846e4ac375f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:37.140030 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d525cf-3137-4dba-aa98-846e4ac375f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:37.141482 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cbcc44-b8eb-46a8-ae01-f644d70bd874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:37.144500 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cbcc44-b8eb-46a8-ae01-f644d70bd874 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:37.145077 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cbcc44-b8eb-46a8-ae01-f644d70bd874 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:37.145748 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cbcc44-b8eb-46a8-ae01-f644d70bd874 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:37.152664 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d525cf-3137-4dba-aa98-846e4ac375f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:37.154154 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d525cf-3137-4dba-aa98-846e4ac375f1 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:37.156530 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cbcc44-b8eb-46a8-ae01-f644d70bd874 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:37.158245 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cbcc44-b8eb-46a8-ae01-f644d70bd874 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:37.171200 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-21d525cf-3137-4dba-aa98-846e4ac375f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:48:37.171200 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:37.171200 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:48:37.171200 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:48:37.171200 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:48:37.171200 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:48:37.171200 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:48:37.171200 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:48:37.171200 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:48:37.171200 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:48:37.171200 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:48:37.171200 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:48:37.171200 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 12:48:37.171200 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 12:48:37.171200 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 12:48:37.171200 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 12:48:37.172263 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:48:37.172263 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:48:37.172263 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:48:37.172263 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:48:37.172263 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:48:37.172263 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:48:37.172263 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:48:37.172263 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 14 12:48:37.172263 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:48:37.172263 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:48:37.172263 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:48:37.172263 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:48:37.172263 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:48:37.172263 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:48:37.172263 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:48:37.172263 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:48:37.172263 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 12:48:37.173148 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 12:48:37.173148 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:48:37.173148 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 14 12:48:37.175406 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 296/605] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Oct 14 12:48:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:48:37.176858 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b4b9c2-4db6-45b2-8d13-78d562007fb9 None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:37.177301 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b4b9c2-4db6-45b2-8d13-78d562007fb9 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:37.177730 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b4b9c2-4db6-45b2-8d13-78d562007fb9 None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:37.179728 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 297/606] 10.222.0.17 () {54 vars in 927 bytes} [Fri Oct 14 12:48:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:48:37.181518 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b4b9c2-4db6-45b2-8d13-78d562007fb9 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:37.181884 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-71cbcc44-b8eb-46a8-ae01-f644d70bd874 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 14 12:48:37.181884 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:37.181884 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:48:37.181884 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:48:37.181884 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:48:37.181884 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:48:37.181884 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:48:37.181884 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:48:37.181884 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:48:37.181884 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:48:37.181884 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:48:37.181884 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:48:37.181884 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 14 12:48:37.181884 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 14 12:48:37.181884 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 14 12:48:37.181884 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 14 12:48:37.182842 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:48:37.182842 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:48:37.182842 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 14 12:48:37.182842 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 12:48:37.182842 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 14 12:48:37.182842 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 12:48:37.182842 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:48:37.182842 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:48:37.182842 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:48:37.182842 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:48:37.182842 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:48:37.182842 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 14 12:48:37.182842 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:48:37.182842 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:48:37.182842 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:48:37.182842 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:48:37.182842 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:48:37.182842 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:48:37.183802 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:48:37.183802 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:48:37.183802 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 14 12:48:37.183802 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 14 12:48:37.183802 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 14 12:48:37.183802 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 14 12:48:37.183802 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 14 12:48:37.183802 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 14 12:48:37.183802 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 14 12:48:37.183802 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 14 12:48:37.184881 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 310/607] 10.222.0.17 () {56 vars in 1096 bytes} [Fri Oct 14 12:48:36 2022] GET /identity/v3/users/swift => generated 83 bytes in 341 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:48:37.190011 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cbcc44-b8eb-46a8-ae01-f644d70bd874 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:37.224359 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:37.310946 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cbcc44-b8eb-46a8-ae01-f644d70bd874 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:37.320950 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b4b9c2-4db6-45b2-8d13-78d562007fb9 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:37.348653 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5523a504-ee02-4e5c-8d06-d7cf2b24f348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:37.349460 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5523a504-ee02-4e5c-8d06-d7cf2b24f348 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:37.349842 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5523a504-ee02-4e5c-8d06-d7cf2b24f348 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:37.350263 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5523a504-ee02-4e5c-8d06-d7cf2b24f348 None admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:37.351102 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5523a504-ee02-4e5c-8d06-d7cf2b24f348 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:37.351438 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:37.351586 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5523a504-ee02-4e5c-8d06-d7cf2b24f348 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:37.353225 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5523a504-ee02-4e5c-8d06-d7cf2b24f348 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:37.367914 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e31865-bdcd-4e13-8b98-fad5d5f48808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:37.368768 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e31865-bdcd-4e13-8b98-fad5d5f48808 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:37.369252 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e31865-bdcd-4e13-8b98-fad5d5f48808 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:37.369774 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e31865-bdcd-4e13-8b98-fad5d5f48808 None admin] PATH_INFO: `/v3/domains` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:37.370592 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e31865-bdcd-4e13-8b98-fad5d5f48808 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:37.371066 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e31865-bdcd-4e13-8b98-fad5d5f48808 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:37.372587 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e31865-bdcd-4e13-8b98-fad5d5f48808 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:37.378412 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 311/608] 10.222.0.17 () {56 vars in 1135 bytes} [Fri Oct 14 12:48:37 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 12:48:37.379956 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a70c46e-dde6-4bbb-93d4-998cae54d0a4 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:37.380342 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a70c46e-dde6-4bbb-93d4-998cae54d0a4 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:37.380725 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a70c46e-dde6-4bbb-93d4-998cae54d0a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:37.387659 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 298/609] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Oct 14 12:48:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:37.389147 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e31865-bdcd-4e13-8b98-fad5d5f48808 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:37.403702 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-7a70c46e-dde6-4bbb-93d4-998cae54d0a4 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:48:37.405455 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-7a70c46e-dde6-4bbb-93d4-998cae54d0a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:48:37.518433 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e31865-bdcd-4e13-8b98-fad5d5f48808 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:37.524049 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 312/610] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Oct 14 12:48:37 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 14 12:48:37.530216 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a70c46e-dde6-4bbb-93d4-998cae54d0a4 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:37.553682 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:37.591713 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2775fa34-2b2f-4304-b7f9-7cb677299897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:37.592324 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2775fa34-2b2f-4304-b7f9-7cb677299897 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:37.592606 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2775fa34-2b2f-4304-b7f9-7cb677299897 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:37.592869 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2775fa34-2b2f-4304-b7f9-7cb677299897 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:37.676518 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:37.701754 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2775fa34-2b2f-4304-b7f9-7cb677299897 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:37.703325 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2775fa34-2b2f-4304-b7f9-7cb677299897 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:37.717856 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a70c46e-dde6-4bbb-93d4-998cae54d0a4 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:37.766321 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074c252c-21c7-4345-bb84-a63bbf10533e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:37.767447 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074c252c-21c7-4345-bb84-a63bbf10533e None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:37.768489 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074c252c-21c7-4345-bb84-a63bbf10533e None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:37.769061 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074c252c-21c7-4345-bb84-a63bbf10533e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:37.777589 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074c252c-21c7-4345-bb84-a63bbf10533e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:37.779486 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074c252c-21c7-4345-bb84-a63bbf10533e None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:37.798890 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-074c252c-21c7-4345-bb84-a63bbf10533e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 14 12:48:37.798890 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:37.798890 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:48:37.798890 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:48:37.798890 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:48:37.798890 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:48:37.798890 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:48:37.798890 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:48:37.798890 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:48:37.798890 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:48:37.798890 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:48:37.798890 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:48:37.798890 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 14 12:48:37.798890 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 14 12:48:37.798890 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 14 12:48:37.798890 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 14 12:48:37.800402 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:48:37.800402 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:48:37.800402 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 14 12:48:37.800402 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 12:48:37.800402 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 14 12:48:37.800402 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 12:48:37.800402 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:48:37.800402 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:48:37.800402 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:48:37.800402 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:48:37.800402 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:48:37.800402 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 14 12:48:37.800402 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:48:37.800402 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:48:37.800402 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:48:37.800402 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:48:37.800402 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:48:37.800402 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:48:37.801316 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:48:37.801316 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:48:37.801316 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 14 12:48:37.801316 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 14 12:48:37.801316 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 14 12:48:37.801316 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 14 12:48:37.801316 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 14 12:48:37.801316 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 14 12:48:37.801316 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 14 12:48:37.801316 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 14 12:48:37.804096 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 313/611] 10.222.0.17 () {56 vars in 1117 bytes} [Fri Oct 14 12:48:37 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:48:37.805730 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27338ed2-8a87-4d28-9cb3-a6c3b07379de None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:37.806264 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27338ed2-8a87-4d28-9cb3-a6c3b07379de None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:37.806830 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27338ed2-8a87-4d28-9cb3-a6c3b07379de None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:37.808801 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 314/612] 10.222.0.17 () {54 vars in 927 bytes} [Fri Oct 14 12:48:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:48:37.809803 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27338ed2-8a87-4d28-9cb3-a6c3b07379de None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:37.821006 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 299/613] 10.222.0.17 () {58 vars in 1282 bytes} [Fri Oct 14 12:48:37 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 14 12:48:37.821006 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8236876-74dc-42d3-b28b-d604549b7eb8 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:37.821006 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8236876-74dc-42d3-b28b-d604549b7eb8 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:37.821006 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8236876-74dc-42d3-b28b-d604549b7eb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:37.837608 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-c8236876-74dc-42d3-b28b-d604549b7eb8 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:48:37.838913 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-c8236876-74dc-42d3-b28b-d604549b7eb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:48:37.900594 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:37.922336 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 300/614] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Oct 14 12:48:37 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 14 12:48:37.922336 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8236876-74dc-42d3-b28b-d604549b7eb8 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:37.944348 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27338ed2-8a87-4d28-9cb3-a6c3b07379de None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:37.962516 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:37.990574 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42151c9f-9d4e-470c-bcef-95f11efc82dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:37.991183 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42151c9f-9d4e-470c-bcef-95f11efc82dc None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:37.991458 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42151c9f-9d4e-470c-bcef-95f11efc82dc None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:37.991729 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42151c9f-9d4e-470c-bcef-95f11efc82dc None admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:37.992458 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42151c9f-9d4e-470c-bcef-95f11efc82dc None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:37.992762 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42151c9f-9d4e-470c-bcef-95f11efc82dc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:37.994795 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42151c9f-9d4e-470c-bcef-95f11efc82dc None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:38.018333 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 315/615] 10.222.0.17 () {56 vars in 1149 bytes} [Fri Oct 14 12:48:37 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:38.019210 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42151c9f-9d4e-470c-bcef-95f11efc82dc None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:38.061796 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8236876-74dc-42d3-b28b-d604549b7eb8 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:38.111929 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77357f62-4930-4803-bb90-d05ac18fa9f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:38.112690 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77357f62-4930-4803-bb90-d05ac18fa9f4 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:38.113082 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77357f62-4930-4803-bb90-d05ac18fa9f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:38.113356 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77357f62-4930-4803-bb90-d05ac18fa9f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:38.126381 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77357f62-4930-4803-bb90-d05ac18fa9f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:38.128529 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77357f62-4930-4803-bb90-d05ac18fa9f4 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:38.140083 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42151c9f-9d4e-470c-bcef-95f11efc82dc None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:38.145048 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-77357f62-4930-4803-bb90-d05ac18fa9f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:48:38.145048 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:38.145048 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:48:38.145048 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:48:38.145048 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:48:38.145048 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:48:38.145048 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:48:38.145048 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:48:38.145048 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:48:38.145048 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:48:38.145048 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:48:38.145048 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:48:38.145048 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 12:48:38.145048 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 12:48:38.145048 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 12:48:38.145048 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 12:48:38.146068 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:48:38.146068 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:48:38.146068 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:48:38.146068 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:48:38.146068 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:48:38.146068 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:48:38.146068 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:48:38.146068 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 14 12:48:38.146068 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:48:38.146068 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:48:38.146068 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:48:38.146068 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:48:38.146068 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:48:38.146068 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:48:38.146068 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:48:38.146068 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:48:38.146068 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 12:48:38.152018 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 12:48:38.152018 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:48:38.152018 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 14 12:48:38.152018 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 301/616] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Oct 14 12:48:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:48:38.152018 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77357f62-4930-4803-bb90-d05ac18fa9f4 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:38.183151 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:38.196237 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4797f68-19c0-43ba-9413-5818af8d1761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:38.197305 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4797f68-19c0-43ba-9413-5818af8d1761 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:38.197792 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4797f68-19c0-43ba-9413-5818af8d1761 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:38.198328 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4797f68-19c0-43ba-9413-5818af8d1761 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:38.199205 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4797f68-19c0-43ba-9413-5818af8d1761 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:38.201702 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4797f68-19c0-43ba-9413-5818af8d1761 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:38.219081 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-d4797f68-19c0-43ba-9413-5818af8d1761 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 14 12:48:38.219081 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:38.219081 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 14 12:48:38.219081 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 14 12:48:38.219081 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 14 12:48:38.219081 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 14 12:48:38.219081 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 14 12:48:38.219081 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 12:48:38.219081 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 14 12:48:38.219081 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 14 12:48:38.219081 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 14 12:48:38.219081 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 14 12:48:38.219081 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:38.219081 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:48:38.219081 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:48:38.219081 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:48:38.219081 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:48:38.220273 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:48:38.220273 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:48:38.220273 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:48:38.220273 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:48:38.220273 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:48:38.220273 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:48:38.220273 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 14 12:48:38.220273 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 14 12:48:38.220273 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 14 12:48:38.220273 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 14 12:48:38.220273 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:48:38.220273 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:48:38.220273 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:48:38.220273 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:48:38.220273 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:48:38.220273 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:48:38.221497 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:48:38.221497 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 14 12:48:38.221497 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:48:38.221497 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:48:38.221497 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:48:38.221497 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:48:38.221497 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:48:38.221497 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:48:38.221497 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:48:38.221497 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:48:38.221497 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 14 12:48:38.221497 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 12:48:38.221497 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 14 12:48:38.221497 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 14 12:48:38.221497 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 316/617] 10.222.0.17 () {56 vars in 1129 bytes} [Fri Oct 14 12:48:38 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:48:38.222497 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209c0199-4f08-406d-953f-23f1b99d993d None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:38.222497 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209c0199-4f08-406d-953f-23f1b99d993d None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:38.222646 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209c0199-4f08-406d-953f-23f1b99d993d None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:38.225914 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 317/618] 10.222.0.17 () {54 vars in 927 bytes} [Fri Oct 14 12:48:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:48:38.225914 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209c0199-4f08-406d-953f-23f1b99d993d None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:38.229686 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:38.274971 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77357f62-4930-4803-bb90-d05ac18fa9f4 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:38.312818 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d3079e-9852-4857-bb30-eb242b35c54b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:38.313416 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d3079e-9852-4857-bb30-eb242b35c54b None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:38.313689 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d3079e-9852-4857-bb30-eb242b35c54b None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:38.313980 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d3079e-9852-4857-bb30-eb242b35c54b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:38.333301 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209c0199-4f08-406d-953f-23f1b99d993d None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:38.375806 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f45f341-9329-4094-bffc-b883d8c44eca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:38.376414 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f45f341-9329-4094-bffc-b883d8c44eca None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:38.376695 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f45f341-9329-4094-bffc-b883d8c44eca None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:38.376969 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f45f341-9329-4094-bffc-b883d8c44eca None admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:38.378459 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f45f341-9329-4094-bffc-b883d8c44eca None admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:38.378777 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f45f341-9329-4094-bffc-b883d8c44eca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:38.380173 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f45f341-9329-4094-bffc-b883d8c44eca None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:38.392190 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 318/619] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Oct 14 12:48:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:38.393599 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f45f341-9329-4094-bffc-b883d8c44eca None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:38.395309 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d3079e-9852-4857-bb30-eb242b35c54b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:38.396772 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d3079e-9852-4857-bb30-eb242b35c54b None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:38.452979 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:38.472802 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:38.504700 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f45f341-9329-4094-bffc-b883d8c44eca None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:38.513828 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 302/620] 10.222.0.17 () {58 vars in 1282 bytes} [Fri Oct 14 12:48:38 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 14 12:48:38.514704 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d3079e-9852-4857-bb30-eb242b35c54b None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:38.540865 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bd86c5-8d5d-45ef-a0f2-24bb31a0b768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:38.541556 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bd86c5-8d5d-45ef-a0f2-24bb31a0b768 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:38.541861 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bd86c5-8d5d-45ef-a0f2-24bb31a0b768 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:38.542161 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bd86c5-8d5d-45ef-a0f2-24bb31a0b768 None admin] PATH_INFO: `/v3/services/network` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:38.542775 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bd86c5-8d5d-45ef-a0f2-24bb31a0b768 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:38.544160 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bd86c5-8d5d-45ef-a0f2-24bb31a0b768 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:38.553872 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-a8bd86c5-8d5d-45ef-a0f2-24bb31a0b768 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 14 12:48:38.553872 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:38.553872 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 14 12:48:38.553872 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 14 12:48:38.553872 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 14 12:48:38.553872 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 14 12:48:38.553872 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 14 12:48:38.553872 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 12:48:38.553872 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 14 12:48:38.553872 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 14 12:48:38.553872 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 14 12:48:38.553872 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 14 12:48:38.553872 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:38.553872 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:48:38.553872 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:48:38.553872 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:48:38.553872 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:48:38.554923 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:48:38.554923 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:48:38.554923 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:48:38.554923 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:48:38.554923 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:48:38.554923 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:48:38.554923 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 14 12:48:38.554923 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 14 12:48:38.554923 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 14 12:48:38.554923 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 14 12:48:38.554923 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:48:38.554923 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:48:38.554923 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:48:38.554923 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:48:38.554923 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:48:38.554923 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:48:38.555754 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:48:38.555754 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 14 12:48:38.555754 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:48:38.555754 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:48:38.555754 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:48:38.555754 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:48:38.555754 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:48:38.555754 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:48:38.555754 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:48:38.555754 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:48:38.555754 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 14 12:48:38.555754 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 12:48:38.555754 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 14 12:48:38.555754 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 14 12:48:38.555754 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 319/621] 10.222.0.17 () {56 vars in 1111 bytes} [Fri Oct 14 12:48:38 2022] GET /identity/v3/services/network => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:48:38.556569 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e8c998-9228-4dae-82f3-11a149a6a91c None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:38.556569 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e8c998-9228-4dae-82f3-11a149a6a91c None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:38.557086 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e8c998-9228-4dae-82f3-11a149a6a91c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:38.575964 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-36e8c998-9228-4dae-82f3-11a149a6a91c None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:48:38.577185 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-36e8c998-9228-4dae-82f3-11a149a6a91c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:48:38.631777 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d3079e-9852-4857-bb30-eb242b35c54b None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:38.660134 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 320/622] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Oct 14 12:48:38 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 14 12:48:38.661966 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e8c998-9228-4dae-82f3-11a149a6a91c None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:38.668869 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d386bf-2b1e-407b-86ba-f980fb23298e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:38.669670 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d386bf-2b1e-407b-86ba-f980fb23298e None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:38.669950 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d386bf-2b1e-407b-86ba-f980fb23298e None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:38.670251 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d386bf-2b1e-407b-86ba-f980fb23298e None admin] PATH_INFO: `/v3/services` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:38.670880 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d386bf-2b1e-407b-86ba-f980fb23298e None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:38.671189 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d386bf-2b1e-407b-86ba-f980fb23298e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:38.672533 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d386bf-2b1e-407b-86ba-f980fb23298e None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:38.677556 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 303/623] 10.222.0.17 () {56 vars in 1124 bytes} [Fri Oct 14 12:48:38 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:38.678368 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d386bf-2b1e-407b-86ba-f980fb23298e None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:38.710539 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:38.745130 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:38.795929 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d386bf-2b1e-407b-86ba-f980fb23298e None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:38.825902 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e8c998-9228-4dae-82f3-11a149a6a91c None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:38.844666 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6d47a8-ddc2-48fc-84c5-eacecd1aa660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:38.845460 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6d47a8-ddc2-48fc-84c5-eacecd1aa660 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:38.846558 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6d47a8-ddc2-48fc-84c5-eacecd1aa660 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:38.847185 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6d47a8-ddc2-48fc-84c5-eacecd1aa660 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:38.860637 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6d47a8-ddc2-48fc-84c5-eacecd1aa660 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:38.863414 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6d47a8-ddc2-48fc-84c5-eacecd1aa660 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:38.867999 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83df905e-dc8d-44ed-86a2-14d22070101c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:38.868858 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83df905e-dc8d-44ed-86a2-14d22070101c None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:38.869339 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83df905e-dc8d-44ed-86a2-14d22070101c None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:38.869765 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83df905e-dc8d-44ed-86a2-14d22070101c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:38.878878 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-dd6d47a8-ddc2-48fc-84c5-eacecd1aa660 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:48:38.878878 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:38.878878 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:48:38.878878 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:48:38.878878 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:48:38.878878 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:48:38.878878 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:48:38.878878 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:48:38.878878 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:48:38.878878 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:48:38.878878 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:48:38.878878 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:48:38.878878 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 12:48:38.878878 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 12:48:38.878878 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 12:48:38.878878 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 12:48:38.880056 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:48:38.880056 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:48:38.880056 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:48:38.880056 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:48:38.880056 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:48:38.880056 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:48:38.880056 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:48:38.880056 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 14 12:48:38.880056 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:48:38.880056 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:48:38.880056 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:48:38.880056 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:48:38.880056 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:48:38.880056 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:48:38.880056 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:48:38.880056 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:48:38.880056 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 12:48:38.880954 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 12:48:38.880954 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:48:38.880954 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 14 12:48:38.880954 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 304/624] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Oct 14 12:48:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:48:38.880954 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6d47a8-ddc2-48fc-84c5-eacecd1aa660 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:38.884022 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83df905e-dc8d-44ed-86a2-14d22070101c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:38.885504 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83df905e-dc8d-44ed-86a2-14d22070101c None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:38.899762 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-83df905e-dc8d-44ed-86a2-14d22070101c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 12:48:38.899762 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:38.899762 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:48:38.899762 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:48:38.899762 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:48:38.899762 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:48:38.899762 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:48:38.899762 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:48:38.899762 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:48:38.899762 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:48:38.899762 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:48:38.899762 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:48:38.899762 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 14 12:48:38.899762 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 14 12:48:38.899762 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 14 12:48:38.900720 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 14 12:48:38.900720 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:48:38.900720 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:48:38.900720 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:48:38.900720 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:48:38.900720 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:48:38.900720 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:48:38.900720 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:48:38.900720 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 14 12:48:38.900720 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:48:38.900720 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:48:38.900720 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:48:38.900720 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:48:38.900720 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:48:38.900720 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:48:38.900720 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:48:38.900720 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:48:38.901605 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 14 12:48:38.901605 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 14 12:48:38.901605 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 14 12:48:38.901605 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 14 12:48:38.901605 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 14 12:48:38.901605 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 14 12:48:38.901605 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 12:48:38.901605 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 14 12:48:38.901605 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 321/625] 10.222.0.17 () {56 vars in 1111 bytes} [Fri Oct 14 12:48:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:48:38.902589 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83df905e-dc8d-44ed-86a2-14d22070101c None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:38.997113 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:39.016633 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6d47a8-ddc2-48fc-84c5-eacecd1aa660 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:39.029361 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83df905e-dc8d-44ed-86a2-14d22070101c None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:39.037982 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:39.070729 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb66417f-0fe4-47e9-bc22-e26f3dacaae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:39.071343 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb66417f-0fe4-47e9-bc22-e26f3dacaae0 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:39.071481 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d644d67-0f94-4315-8a3e-0c0506bcc7fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:39.071620 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb66417f-0fe4-47e9-bc22-e26f3dacaae0 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:39.071890 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb66417f-0fe4-47e9-bc22-e26f3dacaae0 None admin] PATH_INFO: `/v3/services` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:39.072084 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d644d67-0f94-4315-8a3e-0c0506bcc7fe None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:39.072365 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d644d67-0f94-4315-8a3e-0c0506bcc7fe None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:39.072520 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb66417f-0fe4-47e9-bc22-e26f3dacaae0 None admin] RBAC: Adding query filter params (name=network) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:39.072620 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d644d67-0f94-4315-8a3e-0c0506bcc7fe None admin] PATH_INFO: `/v3/services` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:39.072824 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb66417f-0fe4-47e9-bc22-e26f3dacaae0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:39.073266 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d644d67-0f94-4315-8a3e-0c0506bcc7fe None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:39.073559 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d644d67-0f94-4315-8a3e-0c0506bcc7fe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:39.074225 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb66417f-0fe4-47e9-bc22-e26f3dacaae0 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:39.074960 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d644d67-0f94-4315-8a3e-0c0506bcc7fe None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:39.079216 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 305/626] 10.222.0.17 () {56 vars in 1112 bytes} [Fri Oct 14 12:48:38 2022] GET /identity/v3/services?name=network => generated 124 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:39.084894 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 322/627] 10.222.0.17 () {56 vars in 1124 bytes} [Fri Oct 14 12:48:38 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:39.085089 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb66417f-0fe4-47e9-bc22-e26f3dacaae0 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:39.085175 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d644d67-0f94-4315-8a3e-0c0506bcc7fe None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:39.192548 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb66417f-0fe4-47e9-bc22-e26f3dacaae0 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:39.209019 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d644d67-0f94-4315-8a3e-0c0506bcc7fe None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:39.228583 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7811c5-8af9-40f0-bf0a-1bd9284fa742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:39.229194 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7811c5-8af9-40f0-bf0a-1bd9284fa742 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:39.229472 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7811c5-8af9-40f0-bf0a-1bd9284fa742 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:39.229745 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7811c5-8af9-40f0-bf0a-1bd9284fa742 None admin] PATH_INFO: `/v3/domains` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:39.230425 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7811c5-8af9-40f0-bf0a-1bd9284fa742 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:39.230731 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7811c5-8af9-40f0-bf0a-1bd9284fa742 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:39.232112 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7811c5-8af9-40f0-bf0a-1bd9284fa742 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:39.245943 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d827698-3e11-4cec-b617-cc95b5eda0ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:39.246609 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d827698-3e11-4cec-b617-cc95b5eda0ae None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:39.246884 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d827698-3e11-4cec-b617-cc95b5eda0ae None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:39.247212 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d827698-3e11-4cec-b617-cc95b5eda0ae None admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:39.247869 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d827698-3e11-4cec-b617-cc95b5eda0ae None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:39.248171 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d827698-3e11-4cec-b617-cc95b5eda0ae None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:39.249626 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d827698-3e11-4cec-b617-cc95b5eda0ae None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:39.250894 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 306/628] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Oct 14 12:48:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:39.251886 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7811c5-8af9-40f0-bf0a-1bd9284fa742 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:39.257749 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:39.264719 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 323/629] 10.222.0.17 () {56 vars in 1148 bytes} [Fri Oct 14 12:48:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:39.265554 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d827698-3e11-4cec-b617-cc95b5eda0ae None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:39.305982 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:39.380623 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d827698-3e11-4cec-b617-cc95b5eda0ae None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:39.387922 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7811c5-8af9-40f0-bf0a-1bd9284fa742 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:39.419526 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fef361c-d0d7-450d-988b-25c81ee3e782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:39.420127 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fef361c-d0d7-450d-988b-25c81ee3e782 None admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:39.420399 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fef361c-d0d7-450d-988b-25c81ee3e782 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:39.420667 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fef361c-d0d7-450d-988b-25c81ee3e782 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:39.421326 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fef361c-d0d7-450d-988b-25c81ee3e782 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:39.422727 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fef361c-d0d7-450d-988b-25c81ee3e782 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:39.424080 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eff2bc4-cc77-4182-9207-b5f1361ddbfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:39.424985 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eff2bc4-cc77-4182-9207-b5f1361ddbfc None admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:39.425269 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eff2bc4-cc77-4182-9207-b5f1361ddbfc None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:39.425542 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eff2bc4-cc77-4182-9207-b5f1361ddbfc None admin] PATH_INFO: `/v3/services` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:39.426234 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eff2bc4-cc77-4182-9207-b5f1361ddbfc None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:39.427608 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eff2bc4-cc77-4182-9207-b5f1361ddbfc None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:39.444975 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 324/630] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Oct 14 12:48:39 2022] POST /identity/v3/endpoints => generated 346 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 12:48:39.445816 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fef361c-d0d7-450d-988b-25c81ee3e782 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:39.450344 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 307/631] 10.222.0.17 () {60 vars in 1141 bytes} [Fri Oct 14 12:48:39 2022] POST /identity/v3/services => generated 269 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 12:48:39.451407 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eff2bc4-cc77-4182-9207-b5f1361ddbfc None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:39.550565 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:39.599903 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:39.641193 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eff2bc4-cc77-4182-9207-b5f1361ddbfc None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:39.644364 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fef361c-d0d7-450d-988b-25c81ee3e782 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:39.686789 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaba8e0-ae15-497f-81af-f0e3d74f749e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:39.688203 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaba8e0-ae15-497f-81af-f0e3d74f749e None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:39.688707 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaba8e0-ae15-497f-81af-f0e3d74f749e None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:39.689962 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaba8e0-ae15-497f-81af-f0e3d74f749e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:39.694037 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca631e0b-c865-49d7-9dfd-4f77a089a5a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:39.695187 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca631e0b-c865-49d7-9dfd-4f77a089a5a3 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:39.695187 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca631e0b-c865-49d7-9dfd-4f77a089a5a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:39.695187 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca631e0b-c865-49d7-9dfd-4f77a089a5a3 None admin] PATH_INFO: `/v3/services` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:39.695835 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca631e0b-c865-49d7-9dfd-4f77a089a5a3 None admin] RBAC: Adding query filter params (type=network) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:39.696134 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca631e0b-c865-49d7-9dfd-4f77a089a5a3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:39.697635 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca631e0b-c865-49d7-9dfd-4f77a089a5a3 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:39.700080 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaba8e0-ae15-497f-81af-f0e3d74f749e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:39.701703 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaba8e0-ae15-497f-81af-f0e3d74f749e None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:39.703194 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 325/632] 10.222.0.17 () {56 vars in 1112 bytes} [Fri Oct 14 12:48:39 2022] GET /identity/v3/services?type=network => generated 350 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:39.704019 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca631e0b-c865-49d7-9dfd-4f77a089a5a3 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:39.717540 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-dfaba8e0-ae15-497f-81af-f0e3d74f749e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 12:48:39.717540 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:39.717540 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:48:39.717540 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:48:39.717540 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:48:39.717540 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:48:39.717540 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:48:39.717540 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:48:39.717540 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:48:39.717540 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:48:39.717540 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:48:39.717540 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:48:39.717540 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 14 12:48:39.717540 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 14 12:48:39.717540 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 14 12:48:39.718650 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 14 12:48:39.718650 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:48:39.718650 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:48:39.718650 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:48:39.718650 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:48:39.718650 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:48:39.718650 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:48:39.718650 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:48:39.718650 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 14 12:48:39.718650 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:48:39.718650 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:48:39.718650 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:48:39.718650 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:48:39.718650 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:48:39.718650 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:48:39.718650 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:48:39.718650 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:48:39.719549 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 14 12:48:39.719549 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 14 12:48:39.719549 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 14 12:48:39.719549 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 14 12:48:39.719549 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 14 12:48:39.719549 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 14 12:48:39.719549 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 12:48:39.719549 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 14 12:48:39.723961 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 308/633] 10.222.0.17 () {56 vars in 1111 bytes} [Fri Oct 14 12:48:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:48:39.723961 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaba8e0-ae15-497f-81af-f0e3d74f749e None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:39.847409 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca631e0b-c865-49d7-9dfd-4f77a089a5a3 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:39.869011 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaba8e0-ae15-497f-81af-f0e3d74f749e None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:39.888944 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14202051-cad1-4b81-8505-731b5237e490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:39.889666 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14202051-cad1-4b81-8505-731b5237e490 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:39.889829 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14202051-cad1-4b81-8505-731b5237e490 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:39.890186 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14202051-cad1-4b81-8505-731b5237e490 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:39.890999 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14202051-cad1-4b81-8505-731b5237e490 None admin] RBAC: Adding query filter params (role.id=7f6e29e390bc41f7a9af17659a2e95d1, scope.project.id=2486e73d493b40e18d9d988744993854, user.id=86c9fc57b1ec4d00b9f392877f277284) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:39.891311 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14202051-cad1-4b81-8505-731b5237e490 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:39.893154 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14202051-cad1-4b81-8505-731b5237e490 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:39.898690 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:39.904857 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 326/634] 10.222.0.17 () {56 vars in 1374 bytes} [Fri Oct 14 12:48:39 2022] GET /identity/v3/role_assignments?user.id=86c9fc57b1ec4d00b9f392877f277284&scope.project.id=2486e73d493b40e18d9d988744993854&role.id=7f6e29e390bc41f7a9af17659a2e95d1 => generated 608 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:39.904857 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14202051-cad1-4b81-8505-731b5237e490 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:39.922045 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:39.942474 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19712e8a-4459-460e-9d33-46e54b1aea45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:39.943103 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19712e8a-4459-460e-9d33-46e54b1aea45 None admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:39.943380 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19712e8a-4459-460e-9d33-46e54b1aea45 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:39.943716 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19712e8a-4459-460e-9d33-46e54b1aea45 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:39.944487 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19712e8a-4459-460e-9d33-46e54b1aea45 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:39.947535 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19712e8a-4459-460e-9d33-46e54b1aea45 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:39.994822 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 309/635] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Oct 14 12:48:39 2022] POST /identity/v3/endpoints => generated 337 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 12:48:40.094177 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14202051-cad1-4b81-8505-731b5237e490 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:40.178190 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e827b26-5c93-4d5b-a288-13efc4ff1de2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:40.179096 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e827b26-5c93-4d5b-a288-13efc4ff1de2 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:40.179096 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e827b26-5c93-4d5b-a288-13efc4ff1de2 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:40.179374 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e827b26-5c93-4d5b-a288-13efc4ff1de2 None admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:40.180134 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e827b26-5c93-4d5b-a288-13efc4ff1de2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:40.180444 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e827b26-5c93-4d5b-a288-13efc4ff1de2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:40.181951 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e827b26-5c93-4d5b-a288-13efc4ff1de2 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:40.204195 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 327/636] 10.222.0.17 () {56 vars in 1148 bytes} [Fri Oct 14 12:48:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:40.214281 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19712e8a-4459-460e-9d33-46e54b1aea45 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:40.363208 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19712e8a-4459-460e-9d33-46e54b1aea45 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:40.437869 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50de1fa8-e07b-46a3-9f8a-b7824fc0da79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:40.438934 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50de1fa8-e07b-46a3-9f8a-b7824fc0da79 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:40.439308 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50de1fa8-e07b-46a3-9f8a-b7824fc0da79 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:40.440259 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50de1fa8-e07b-46a3-9f8a-b7824fc0da79 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:40.441286 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50de1fa8-e07b-46a3-9f8a-b7824fc0da79 None admin] RBAC: Adding query filter params (role.id=2d0a16b1c5634daf99f2b7ac092d1ddd, scope.project.id=2486e73d493b40e18d9d988744993854, user.id=b83a5a78f3e7486293907cb3012c0ad5) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:40.441760 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50de1fa8-e07b-46a3-9f8a-b7824fc0da79 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:40.444403 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50de1fa8-e07b-46a3-9f8a-b7824fc0da79 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:40.456742 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 310/637] 10.222.0.17 () {56 vars in 1374 bytes} [Fri Oct 14 12:48:40 2022] GET /identity/v3/role_assignments?user.id=b83a5a78f3e7486293907cb3012c0ad5&scope.project.id=2486e73d493b40e18d9d988744993854&role.id=2d0a16b1c5634daf99f2b7ac092d1ddd => generated 608 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:41.864160 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7360f538-8992-4c22-9f96-fb19425295f8 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:41.864728 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7360f538-8992-4c22-9f96-fb19425295f8 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:41.864728 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7360f538-8992-4c22-9f96-fb19425295f8 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:41.866327 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 328/638] 10.222.0.17 () {54 vars in 927 bytes} [Fri Oct 14 12:48:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:48:41.871969 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbc6e21-b335-445c-a178-b6b7bc969bd8 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:41.872438 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbc6e21-b335-445c-a178-b6b7bc969bd8 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:41.872517 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbc6e21-b335-445c-a178-b6b7bc969bd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:41.895867 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-dbbc6e21-b335-445c-a178-b6b7bc969bd8 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:48:41.897088 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-dbbc6e21-b335-445c-a178-b6b7bc969bd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:48:41.938474 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:41.975213 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 311/639] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Oct 14 12:48:41 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 14 12:48:42.170490 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39572cd7-a722-4324-ad34-dc6965e8d56f None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:42.170671 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39572cd7-a722-4324-ad34-dc6965e8d56f None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:42.170955 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39572cd7-a722-4324-ad34-dc6965e8d56f None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:42.172727 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 329/640] 10.222.0.17 () {54 vars in 927 bytes} [Fri Oct 14 12:48:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:48:42.179786 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d0aae2-77b5-469a-b329-d83d82418241 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:42.180199 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d0aae2-77b5-469a-b329-d83d82418241 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:42.180577 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d0aae2-77b5-469a-b329-d83d82418241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:42.200045 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-56d0aae2-77b5-469a-b329-d83d82418241 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:48:42.201237 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-56d0aae2-77b5-469a-b329-d83d82418241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:48:42.283751 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 312/641] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Oct 14 12:48:42 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 14 12:48:42.287543 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39572cd7-a722-4324-ad34-dc6965e8d56f None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:42.359866 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b018ca83-6fc4-454b-a02c-dd5b09034943 None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:42.360154 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b018ca83-6fc4-454b-a02c-dd5b09034943 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:42.360427 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b018ca83-6fc4-454b-a02c-dd5b09034943 None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:42.366159 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 313/642] 10.222.0.17 () {54 vars in 927 bytes} [Fri Oct 14 12:48:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:48:42.374629 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ed4bfd-10b9-452d-84b6-52b58358185e None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:42.375075 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ed4bfd-10b9-452d-84b6-52b58358185e None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:42.375508 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ed4bfd-10b9-452d-84b6-52b58358185e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:42.405888 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-47ed4bfd-10b9-452d-84b6-52b58358185e None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:48:42.407178 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-47ed4bfd-10b9-452d-84b6-52b58358185e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:48:42.414565 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:42.431255 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39572cd7-a722-4324-ad34-dc6965e8d56f None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:42.476972 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8db7c7-21d2-48eb-b7e7-ffa4588f5ff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:42.477610 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8db7c7-21d2-48eb-b7e7-ffa4588f5ff8 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:42.477883 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8db7c7-21d2-48eb-b7e7-ffa4588f5ff8 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:42.478196 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8db7c7-21d2-48eb-b7e7-ffa4588f5ff8 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:42.478789 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8db7c7-21d2-48eb-b7e7-ffa4588f5ff8 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:42.480167 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8db7c7-21d2-48eb-b7e7-ffa4588f5ff8 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:42.490653 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-4b8db7c7-21d2-48eb-b7e7-ffa4588f5ff8 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 14 12:48:42.490653 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:42.490653 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 14 12:48:42.490653 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 14 12:48:42.490653 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 14 12:48:42.490653 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 14 12:48:42.490653 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 14 12:48:42.490653 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 12:48:42.490653 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 14 12:48:42.490653 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 14 12:48:42.490653 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 14 12:48:42.490653 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 14 12:48:42.490653 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:42.490653 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:48:42.490653 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:48:42.490653 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:48:42.491662 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:48:42.491662 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:48:42.491662 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:48:42.491662 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:48:42.491662 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:48:42.491662 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:48:42.491662 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:48:42.491662 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 14 12:48:42.491662 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 14 12:48:42.491662 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 14 12:48:42.491662 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 14 12:48:42.491662 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:48:42.491662 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:48:42.491662 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:48:42.491662 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:48:42.491662 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:48:42.491662 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:48:42.492550 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:48:42.492550 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 14 12:48:42.492550 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:48:42.492550 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:48:42.492550 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:48:42.492550 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:48:42.492550 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:48:42.492550 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:48:42.492550 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:48:42.492550 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:48:42.492550 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 14 12:48:42.492550 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 12:48:42.492550 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 14 12:48:42.492550 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 14 12:48:42.492550 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 330/643] 10.222.0.17 () {56 vars in 1132 bytes} [Fri Oct 14 12:48:42 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:48:42.501389 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8db7c7-21d2-48eb-b7e7-ffa4588f5ff8 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:42.509136 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 314/644] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Oct 14 12:48:42 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 14 12:48:42.612849 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ed4bfd-10b9-452d-84b6-52b58358185e None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:42.616279 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8db7c7-21d2-48eb-b7e7-ffa4588f5ff8 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:42.646900 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:42.647326 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:42.654870 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adae45a2-741b-48ee-9805-c661e4d82a65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:42.655472 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adae45a2-741b-48ee-9805-c661e4d82a65 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:42.655827 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adae45a2-741b-48ee-9805-c661e4d82a65 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:42.656103 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adae45a2-741b-48ee-9805-c661e4d82a65 None admin] PATH_INFO: `/v3/services` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:42.656733 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adae45a2-741b-48ee-9805-c661e4d82a65 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:42.657035 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adae45a2-741b-48ee-9805-c661e4d82a65 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:42.658970 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adae45a2-741b-48ee-9805-c661e4d82a65 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:42.668473 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 331/645] 10.222.0.17 () {56 vars in 1126 bytes} [Fri Oct 14 12:48:42 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 12:48:42.669594 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adae45a2-741b-48ee-9805-c661e4d82a65 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:42.760622 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ed4bfd-10b9-452d-84b6-52b58358185e None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:42.810067 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adae45a2-741b-48ee-9805-c661e4d82a65 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:42.823350 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00802ef1-acc1-442b-9c6c-138a32618c51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:42.824366 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00802ef1-acc1-442b-9c6c-138a32618c51 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:42.824788 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00802ef1-acc1-442b-9c6c-138a32618c51 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:42.825230 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00802ef1-acc1-442b-9c6c-138a32618c51 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:42.826259 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00802ef1-acc1-442b-9c6c-138a32618c51 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:42.828374 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00802ef1-acc1-442b-9c6c-138a32618c51 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:42.844771 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-00802ef1-acc1-442b-9c6c-138a32618c51 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 14 12:48:42.844771 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:42.844771 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 14 12:48:42.844771 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 14 12:48:42.844771 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 14 12:48:42.844771 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 14 12:48:42.844771 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 14 12:48:42.844771 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 12:48:42.844771 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 14 12:48:42.844771 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 14 12:48:42.844771 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 14 12:48:42.844771 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 14 12:48:42.844771 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:42.844771 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:48:42.844771 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:48:42.844771 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:48:42.844771 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:48:42.846415 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:48:42.846415 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:48:42.846415 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:48:42.846415 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:48:42.846415 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:48:42.846415 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:48:42.846415 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 14 12:48:42.846415 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 14 12:48:42.846415 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 14 12:48:42.846415 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 14 12:48:42.846415 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:48:42.846415 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:48:42.846415 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:48:42.846415 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:48:42.846415 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:48:42.846415 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:48:42.853194 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:48:42.853194 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 14 12:48:42.853194 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:48:42.853194 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:48:42.853194 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:48:42.853194 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:48:42.853194 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:48:42.853194 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:48:42.853194 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:48:42.853194 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:48:42.853194 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 14 12:48:42.853194 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 12:48:42.853194 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 14 12:48:42.853194 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 14 12:48:42.853194 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 315/646] 10.222.0.17 () {56 vars in 1114 bytes} [Fri Oct 14 12:48:42 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:48:42.853983 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00802ef1-acc1-442b-9c6c-138a32618c51 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:42.860572 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8d663f-db28-48aa-bfbb-0b835106a625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:42.861878 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8d663f-db28-48aa-bfbb-0b835106a625 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:42.862816 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8d663f-db28-48aa-bfbb-0b835106a625 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:42.863293 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8d663f-db28-48aa-bfbb-0b835106a625 None admin] PATH_INFO: `/v3/services` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:42.864138 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8d663f-db28-48aa-bfbb-0b835106a625 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:42.864648 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8d663f-db28-48aa-bfbb-0b835106a625 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:42.866771 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8d663f-db28-48aa-bfbb-0b835106a625 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:42.872672 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 332/647] 10.222.0.17 () {56 vars in 1126 bytes} [Fri Oct 14 12:48:42 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:42.873845 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8d663f-db28-48aa-bfbb-0b835106a625 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:42.937335 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:42.968892 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:42.977847 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00802ef1-acc1-442b-9c6c-138a32618c51 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:42.990235 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8d663f-db28-48aa-bfbb-0b835106a625 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:43.013702 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07eef62-f7dd-4729-ab37-3e0651353183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:43.014261 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07eef62-f7dd-4729-ab37-3e0651353183 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:43.014551 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07eef62-f7dd-4729-ab37-3e0651353183 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:43.014823 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07eef62-f7dd-4729-ab37-3e0651353183 None admin] PATH_INFO: `/v3/services` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:43.015454 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07eef62-f7dd-4729-ab37-3e0651353183 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:43.015759 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07eef62-f7dd-4729-ab37-3e0651353183 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:43.017156 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07eef62-f7dd-4729-ab37-3e0651353183 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:43.022084 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 316/648] 10.222.0.17 () {56 vars in 1114 bytes} [Fri Oct 14 12:48:42 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 12:48:43.022918 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07eef62-f7dd-4729-ab37-3e0651353183 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:43.025216 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b07899-6c1b-4d03-9380-b826a338dcbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:43.025855 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b07899-6c1b-4d03-9380-b826a338dcbd None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:43.026143 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b07899-6c1b-4d03-9380-b826a338dcbd None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:43.027064 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b07899-6c1b-4d03-9380-b826a338dcbd None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:43.027064 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b07899-6c1b-4d03-9380-b826a338dcbd None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:43.028466 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b07899-6c1b-4d03-9380-b826a338dcbd None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:43.044941 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-24b07899-6c1b-4d03-9380-b826a338dcbd None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 14 12:48:43.044941 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:43.044941 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 14 12:48:43.044941 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 14 12:48:43.044941 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 14 12:48:43.044941 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 14 12:48:43.044941 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 14 12:48:43.044941 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 12:48:43.044941 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 14 12:48:43.044941 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 14 12:48:43.044941 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 14 12:48:43.044941 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 14 12:48:43.044941 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:43.044941 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:48:43.044941 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:48:43.044941 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:48:43.044941 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:48:43.046036 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:48:43.046036 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:48:43.046036 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:48:43.046036 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:48:43.046036 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:48:43.046036 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:48:43.046036 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 14 12:48:43.046036 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 14 12:48:43.046036 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 14 12:48:43.046036 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 14 12:48:43.046036 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:48:43.046036 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:48:43.046036 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:48:43.046036 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:48:43.046036 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:48:43.046036 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:48:43.046912 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:48:43.046912 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 14 12:48:43.046912 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:48:43.046912 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:48:43.046912 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:48:43.046912 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:48:43.046912 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:48:43.046912 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:48:43.046912 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:48:43.046912 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:48:43.046912 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 14 12:48:43.046912 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 12:48:43.046912 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 14 12:48:43.046912 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 14 12:48:43.046912 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 333/649] 10.222.0.17 () {56 vars in 1126 bytes} [Fri Oct 14 12:48:42 2022] GET /identity/v3/services/object-store => generated 93 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:48:43.047726 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed811b8-219e-4479-83ce-42d0eee0a553 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:43.048151 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed811b8-219e-4479-83ce-42d0eee0a553 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:43.048254 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed811b8-219e-4479-83ce-42d0eee0a553 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:43.050022 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 334/650] 10.222.0.17 () {54 vars in 927 bytes} [Fri Oct 14 12:48:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:48:43.050760 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed811b8-219e-4479-83ce-42d0eee0a553 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:43.153751 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07eef62-f7dd-4729-ab37-3e0651353183 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:43.166584 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed811b8-219e-4479-83ce-42d0eee0a553 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:43.193418 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:43.195120 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd12aa8-a79c-4732-85a4-e53a0003465c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:43.195874 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd12aa8-a79c-4732-85a4-e53a0003465c None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:43.196158 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd12aa8-a79c-4732-85a4-e53a0003465c None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:43.196511 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd12aa8-a79c-4732-85a4-e53a0003465c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:43.197127 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd12aa8-a79c-4732-85a4-e53a0003465c None admin] RBAC: Adding query filter params (interface=public, service_id=078bf6f52c3f41f480cc3eea65e4a10c, region_id=RegionOne) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:43.197435 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd12aa8-a79c-4732-85a4-e53a0003465c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:43.198838 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd12aa8-a79c-4732-85a4-e53a0003465c None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:43.206411 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 317/651] 10.222.0.17 () {56 vars in 1251 bytes} [Fri Oct 14 12:48:43 2022] GET /identity/v3/endpoints?service_id=078bf6f52c3f41f480cc3eea65e4a10c&interface=public®ion_id=RegionOne => generated 194 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:43.207222 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd12aa8-a79c-4732-85a4-e53a0003465c None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:43.208244 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68272dbc-c149-4a2f-801d-3740a3128b6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:43.209002 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68272dbc-c149-4a2f-801d-3740a3128b6d None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:43.209426 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68272dbc-c149-4a2f-801d-3740a3128b6d None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:43.209847 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68272dbc-c149-4a2f-801d-3740a3128b6d None admin] PATH_INFO: `/v3/services` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:43.210657 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68272dbc-c149-4a2f-801d-3740a3128b6d None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:43.211258 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68272dbc-c149-4a2f-801d-3740a3128b6d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:43.212846 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68272dbc-c149-4a2f-801d-3740a3128b6d None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:43.217743 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 335/652] 10.222.0.17 () {56 vars in 1114 bytes} [Fri Oct 14 12:48:43 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:43.219135 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f577fb6c-c47a-47c8-b9d2-e14cbd604892 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:43.219421 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f577fb6c-c47a-47c8-b9d2-e14cbd604892 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:43.219700 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f577fb6c-c47a-47c8-b9d2-e14cbd604892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:43.235295 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:43.242851 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-f577fb6c-c47a-47c8-b9d2-e14cbd604892 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:48:43.244830 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-f577fb6c-c47a-47c8-b9d2-e14cbd604892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:48:43.342677 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 336/653] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Oct 14 12:48:43 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 14 12:48:43.342677 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f577fb6c-c47a-47c8-b9d2-e14cbd604892 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:43.346436 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd12aa8-a79c-4732-85a4-e53a0003465c None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:43.403144 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0886194a-bcea-4f69-9946-af683440c7bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:43.404023 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0886194a-bcea-4f69-9946-af683440c7bd None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:43.404306 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0886194a-bcea-4f69-9946-af683440c7bd None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:43.404580 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0886194a-bcea-4f69-9946-af683440c7bd None admin] PATH_INFO: `/v3/services` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:43.405227 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0886194a-bcea-4f69-9946-af683440c7bd None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:43.405534 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0886194a-bcea-4f69-9946-af683440c7bd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:43.406996 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0886194a-bcea-4f69-9946-af683440c7bd None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:43.414767 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 318/654] 10.222.0.17 () {56 vars in 1122 bytes} [Fri Oct 14 12:48:43 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:43.420813 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0886194a-bcea-4f69-9946-af683440c7bd None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:43.498157 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f577fb6c-c47a-47c8-b9d2-e14cbd604892 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:43.516056 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:43.536310 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8a824a-8342-455d-8b1f-b2e45b94440b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:43.537023 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8a824a-8342-455d-8b1f-b2e45b94440b None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:43.537406 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8a824a-8342-455d-8b1f-b2e45b94440b None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:43.537800 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8a824a-8342-455d-8b1f-b2e45b94440b None admin] PATH_INFO: `/v3/services` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:43.538554 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8a824a-8342-455d-8b1f-b2e45b94440b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:43.540026 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8a824a-8342-455d-8b1f-b2e45b94440b None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:43.540777 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:43.546732 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 337/655] 10.222.0.17 () {56 vars in 1087 bytes} [Fri Oct 14 12:48:43 2022] GET /identity/v3/services => generated 1029 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 12:48:43.559088 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0886194a-bcea-4f69-9946-af683440c7bd None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:43.604588 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0827bd-f7c2-4e21-879d-a4f55b1f5e9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:43.605137 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0827bd-f7c2-4e21-879d-a4f55b1f5e9e None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:43.605417 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0827bd-f7c2-4e21-879d-a4f55b1f5e9e None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:43.605692 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0827bd-f7c2-4e21-879d-a4f55b1f5e9e None admin] PATH_INFO: `/v3/services` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:43.606448 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0827bd-f7c2-4e21-879d-a4f55b1f5e9e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:43.606760 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0827bd-f7c2-4e21-879d-a4f55b1f5e9e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:43.608269 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0827bd-f7c2-4e21-879d-a4f55b1f5e9e None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:43.615139 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 319/656] 10.222.0.17 () {56 vars in 1122 bytes} [Fri Oct 14 12:48:43 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 12:48:43.663606 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8a824a-8342-455d-8b1f-b2e45b94440b None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:43.794990 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8a824a-8342-455d-8b1f-b2e45b94440b None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:43.834020 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4063b706-e796-4389-b392-86b1f1cd9a70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:43.834784 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4063b706-e796-4389-b392-86b1f1cd9a70 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:43.835362 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4063b706-e796-4389-b392-86b1f1cd9a70 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:43.835728 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4063b706-e796-4389-b392-86b1f1cd9a70 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:43.849762 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4063b706-e796-4389-b392-86b1f1cd9a70 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 12:48:43.855513 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-4063b706-e796-4389-b392-86b1f1cd9a70 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 14 12:48:43.855513 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:43.855513 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:48:43.855513 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:48:43.855513 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:48:43.855513 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:48:43.855513 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:48:43.855513 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:48:43.855513 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:48:43.855513 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:48:43.855513 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:48:43.855513 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:48:43.855513 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 12:48:43.855513 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 12:48:43.855513 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 12:48:43.855513 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 12:48:43.856530 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 12:48:43.856530 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 12:48:43.856530 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 12:48:43.856530 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 12:48:43.856530 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:48:43.856530 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:48:43.856530 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:48:43.856530 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:48:43.856530 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:48:43.856530 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:48:43.856530 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:48:43.856530 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 14 12:48:43.856530 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:48:43.856530 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:48:43.856530 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:48:43.856530 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:48:43.857782 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:48:43.857782 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:48:43.857782 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:48:43.857782 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:48:43.857782 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 12:48:43.857782 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 12:48:43.857782 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 12:48:43.857782 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 12:48:43.857782 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 12:48:43.857782 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 12:48:43.857782 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 14 12:48:43.857782 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 14 12:48:43.857782 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 338/657] 10.222.0.17 () {56 vars in 1120 bytes} [Fri Oct 14 12:48:43 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:48:43.863693 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0827bd-f7c2-4e21-879d-a4f55b1f5e9e None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:44.007550 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0827bd-f7c2-4e21-879d-a4f55b1f5e9e None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:44.050090 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8beff2-88dc-440e-8040-31e90adc035a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:44.051123 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8beff2-88dc-440e-8040-31e90adc035a None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:44.051626 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8beff2-88dc-440e-8040-31e90adc035a None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:44.052101 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8beff2-88dc-440e-8040-31e90adc035a None admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:44.052985 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8beff2-88dc-440e-8040-31e90adc035a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:44.053492 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8beff2-88dc-440e-8040-31e90adc035a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:44.055125 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8beff2-88dc-440e-8040-31e90adc035a None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:44.065361 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 320/658] 10.222.0.17 () {56 vars in 1115 bytes} [Fri Oct 14 12:48:43 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:44.071247 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4063b706-e796-4389-b392-86b1f1cd9a70 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:44.128169 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:44.197845 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4063b706-e796-4389-b392-86b1f1cd9a70 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:44.247511 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cd59ca-d101-4288-8ce4-b391da365a20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:44.248143 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cd59ca-d101-4288-8ce4-b391da365a20 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:44.248421 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cd59ca-d101-4288-8ce4-b391da365a20 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:44.248690 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cd59ca-d101-4288-8ce4-b391da365a20 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:44.260289 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cd59ca-d101-4288-8ce4-b391da365a20 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:44.261752 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cd59ca-d101-4288-8ce4-b391da365a20 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:44.276745 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-d1cd59ca-d101-4288-8ce4-b391da365a20 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:48:44.276745 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:44.276745 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:48:44.276745 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:48:44.276745 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:48:44.276745 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:48:44.276745 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:48:44.276745 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:48:44.276745 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:48:44.276745 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:48:44.276745 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:48:44.276745 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:48:44.276745 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 12:48:44.276745 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 12:48:44.276745 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 12:48:44.276745 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 12:48:44.277794 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:48:44.277794 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:48:44.277794 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:48:44.277794 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:48:44.277794 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:48:44.277794 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:48:44.277794 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:48:44.277794 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 14 12:48:44.277794 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:48:44.277794 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:48:44.277794 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:48:44.277794 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:48:44.277794 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:48:44.277794 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:48:44.277794 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:48:44.277794 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:48:44.277794 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 12:48:44.278733 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 12:48:44.278733 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:48:44.278733 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 14 12:48:44.278733 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 339/659] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Oct 14 12:48:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:48:44.285768 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8beff2-88dc-440e-8040-31e90adc035a None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:44.306499 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:44.396970 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8beff2-88dc-440e-8040-31e90adc035a None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:44.433413 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a24412e-d20a-4316-bd82-f2c5731c837f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:44.434478 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a24412e-d20a-4316-bd82-f2c5731c837f None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:44.434969 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a24412e-d20a-4316-bd82-f2c5731c837f None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:44.435449 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a24412e-d20a-4316-bd82-f2c5731c837f None admin] PATH_INFO: `/v3/domains` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:44.436313 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a24412e-d20a-4316-bd82-f2c5731c837f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:44.436826 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a24412e-d20a-4316-bd82-f2c5731c837f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:44.438479 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a24412e-d20a-4316-bd82-f2c5731c837f None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:44.453303 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 321/660] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Oct 14 12:48:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:44.459463 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cd59ca-d101-4288-8ce4-b391da365a20 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:44.565777 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:44.577988 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cd59ca-d101-4288-8ce4-b391da365a20 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:44.621819 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30149152-4638-4a3b-98e4-689e108c24dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:44.622889 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30149152-4638-4a3b-98e4-689e108c24dc None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:44.623365 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30149152-4638-4a3b-98e4-689e108c24dc None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:44.623829 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30149152-4638-4a3b-98e4-689e108c24dc None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:44.633132 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30149152-4638-4a3b-98e4-689e108c24dc None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:44.635053 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30149152-4638-4a3b-98e4-689e108c24dc None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:44.647979 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-30149152-4638-4a3b-98e4-689e108c24dc None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 14 12:48:44.647979 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:44.647979 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:48:44.647979 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:48:44.647979 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:48:44.647979 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:48:44.647979 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:48:44.647979 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:48:44.647979 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:48:44.647979 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:48:44.647979 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:48:44.647979 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:48:44.647979 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 14 12:48:44.647979 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 14 12:48:44.647979 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 14 12:48:44.647979 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 14 12:48:44.648930 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:48:44.648930 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:48:44.648930 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 14 12:48:44.648930 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 12:48:44.648930 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 14 12:48:44.648930 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 12:48:44.648930 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:48:44.648930 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:48:44.648930 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:48:44.648930 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:48:44.648930 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:48:44.648930 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 14 12:48:44.648930 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:48:44.648930 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:48:44.648930 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:48:44.648930 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:48:44.648930 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:48:44.648930 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:48:44.649868 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:48:44.649868 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:48:44.649868 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 14 12:48:44.649868 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 14 12:48:44.649868 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 14 12:48:44.649868 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 14 12:48:44.649868 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 14 12:48:44.649868 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 14 12:48:44.649868 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 14 12:48:44.649868 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 14 12:48:44.652650 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 340/661] 10.222.0.17 () {56 vars in 1117 bytes} [Fri Oct 14 12:48:44 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:48:44.662226 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a24412e-d20a-4316-bd82-f2c5731c837f None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:44.735572 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:44.767303 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a24412e-d20a-4316-bd82-f2c5731c837f None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:44.803564 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359cf008-29c4-445b-a62d-5dcbee87e3b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:44.804180 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359cf008-29c4-445b-a62d-5dcbee87e3b5 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:44.804458 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359cf008-29c4-445b-a62d-5dcbee87e3b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:44.804736 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359cf008-29c4-445b-a62d-5dcbee87e3b5 None admin] PATH_INFO: `/v3/users` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:44.805473 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359cf008-29c4-445b-a62d-5dcbee87e3b5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:44.805784 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359cf008-29c4-445b-a62d-5dcbee87e3b5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:44.807254 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359cf008-29c4-445b-a62d-5dcbee87e3b5 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:44.826637 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 322/662] 10.222.0.17 () {56 vars in 1149 bytes} [Fri Oct 14 12:48:44 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:44.832390 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30149152-4638-4a3b-98e4-689e108c24dc None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:44.949364 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30149152-4638-4a3b-98e4-689e108c24dc None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:44.991647 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8ba1d9-6532-4770-8e38-0bb365e8deab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:44.992292 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8ba1d9-6532-4770-8e38-0bb365e8deab None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:44.992571 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8ba1d9-6532-4770-8e38-0bb365e8deab None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:44.992843 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8ba1d9-6532-4770-8e38-0bb365e8deab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:45.005770 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8ba1d9-6532-4770-8e38-0bb365e8deab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:45.007304 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8ba1d9-6532-4770-8e38-0bb365e8deab None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:45.022899 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-0c8ba1d9-6532-4770-8e38-0bb365e8deab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:48:45.022899 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:45.022899 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:48:45.022899 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:48:45.022899 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:48:45.022899 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:48:45.022899 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:48:45.022899 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:48:45.022899 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:48:45.022899 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:48:45.022899 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:48:45.022899 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:48:45.022899 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 12:48:45.022899 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 12:48:45.022899 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 12:48:45.022899 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 12:48:45.023869 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:48:45.023869 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:48:45.023869 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:48:45.023869 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:48:45.023869 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:48:45.023869 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:48:45.023869 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:48:45.023869 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 14 12:48:45.023869 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:48:45.023869 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:48:45.023869 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:48:45.023869 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:48:45.023869 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:48:45.023869 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:48:45.023869 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:48:45.023869 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:48:45.023869 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 12:48:45.024730 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 12:48:45.024730 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:48:45.024730 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 14 12:48:45.024730 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 341/663] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Oct 14 12:48:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:48:45.029949 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359cf008-29c4-445b-a62d-5dcbee87e3b5 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:45.148452 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359cf008-29c4-445b-a62d-5dcbee87e3b5 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:45.182499 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:45.192524 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b145b2-6d19-4a70-a1fa-718add59db33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:45.193484 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b145b2-6d19-4a70-a1fa-718add59db33 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:45.193969 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b145b2-6d19-4a70-a1fa-718add59db33 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:45.194473 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b145b2-6d19-4a70-a1fa-718add59db33 None admin] PATH_INFO: `/v3/domains` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:45.195343 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b145b2-6d19-4a70-a1fa-718add59db33 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:45.195853 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b145b2-6d19-4a70-a1fa-718add59db33 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:45.197459 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b145b2-6d19-4a70-a1fa-718add59db33 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:45.210883 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 323/664] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Oct 14 12:48:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:45.216590 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8ba1d9-6532-4770-8e38-0bb365e8deab None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:45.221075 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:45.343074 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8ba1d9-6532-4770-8e38-0bb365e8deab None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:45.385144 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba05aef4-aa54-4fa5-9e2a-55e83b618e93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:45.385785 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba05aef4-aa54-4fa5-9e2a-55e83b618e93 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:45.386066 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba05aef4-aa54-4fa5-9e2a-55e83b618e93 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:45.386363 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba05aef4-aa54-4fa5-9e2a-55e83b618e93 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:45.394544 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba05aef4-aa54-4fa5-9e2a-55e83b618e93 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:45.396040 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba05aef4-aa54-4fa5-9e2a-55e83b618e93 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:45.416416 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-ba05aef4-aa54-4fa5-9e2a-55e83b618e93 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 12:48:45.416416 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:45.416416 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:48:45.416416 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:48:45.416416 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:48:45.416416 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:48:45.416416 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:48:45.416416 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:48:45.416416 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:48:45.416416 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:48:45.416416 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:48:45.416416 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:48:45.416416 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 14 12:48:45.416416 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 14 12:48:45.416416 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 14 12:48:45.417338 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 14 12:48:45.417338 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:48:45.417338 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:48:45.417338 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:48:45.417338 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:48:45.417338 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:48:45.417338 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:48:45.417338 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:48:45.417338 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 14 12:48:45.417338 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:48:45.417338 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:48:45.417338 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:48:45.417338 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:48:45.417338 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:48:45.417338 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:48:45.417338 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:48:45.417338 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:48:45.418279 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 14 12:48:45.418279 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 14 12:48:45.418279 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 14 12:48:45.418279 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 14 12:48:45.418279 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 14 12:48:45.418279 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 14 12:48:45.418279 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 12:48:45.418279 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 14 12:48:45.418698 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 342/665] 10.222.0.17 () {56 vars in 1111 bytes} [Fri Oct 14 12:48:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:48:45.425069 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b145b2-6d19-4a70-a1fa-718add59db33 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:45.531214 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b145b2-6d19-4a70-a1fa-718add59db33 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:45.568989 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321d58d3-3541-4c70-bdc6-ce7a3fd9a895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:45.569944 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321d58d3-3541-4c70-bdc6-ce7a3fd9a895 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:45.570424 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321d58d3-3541-4c70-bdc6-ce7a3fd9a895 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:45.570870 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321d58d3-3541-4c70-bdc6-ce7a3fd9a895 None admin] PATH_INFO: `/v3/projects` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:45.571744 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321d58d3-3541-4c70-bdc6-ce7a3fd9a895 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:45.572225 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321d58d3-3541-4c70-bdc6-ce7a3fd9a895 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:45.573873 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321d58d3-3541-4c70-bdc6-ce7a3fd9a895 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:45.588047 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 324/666] 10.222.0.17 () {56 vars in 1148 bytes} [Fri Oct 14 12:48:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:45.594840 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba05aef4-aa54-4fa5-9e2a-55e83b618e93 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:45.664457 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe14550-7098-4893-90ca-4ddb80fc5498 None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:45.664973 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe14550-7098-4893-90ca-4ddb80fc5498 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:45.665455 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe14550-7098-4893-90ca-4ddb80fc5498 None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:45.667250 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 325/667] 10.222.0.17 () {54 vars in 927 bytes} [Fri Oct 14 12:48:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 14 12:48:45.670763 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:45.679965 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0154db09-90f1-4285-bbd5-6a160f03df15 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:45.680637 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0154db09-90f1-4285-bbd5-6a160f03df15 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:45.680997 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0154db09-90f1-4285-bbd5-6a160f03df15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:45.700901 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-0154db09-90f1-4285-bbd5-6a160f03df15 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:48:45.702332 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-0154db09-90f1-4285-bbd5-6a160f03df15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:48:45.717907 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba05aef4-aa54-4fa5-9e2a-55e83b618e93 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:45.756902 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f97bab-8d78-470c-91c5-7efcf786b600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:45.757572 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f97bab-8d78-470c-91c5-7efcf786b600 None admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:45.757854 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f97bab-8d78-470c-91c5-7efcf786b600 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:45.758142 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f97bab-8d78-470c-91c5-7efcf786b600 None admin] PATH_INFO: `/v3/projects/2486e73d493b40e18d9d988744993854/users/b83a5a78f3e7486293907cb3012c0ad5/roles/5dbcc3f2e7dd43dba994ee44cb11535e` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:45.759883 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:45.761736 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f97bab-8d78-470c-91c5-7efcf786b600 None admin] RBAC: Authorizing `identity:create_grant(project_id=2486e73d493b40e18d9d988744993854, user_id=b83a5a78f3e7486293907cb3012c0ad5, role_id=5dbcc3f2e7dd43dba994ee44cb11535e)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:45.763373 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f97bab-8d78-470c-91c5-7efcf786b600 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:45.781762 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 343/668] 10.222.0.17 () {58 vars in 1439 bytes} [Fri Oct 14 12:48:45 2022] PUT /identity/v3/projects/2486e73d493b40e18d9d988744993854/users/b83a5a78f3e7486293907cb3012c0ad5/roles/5dbcc3f2e7dd43dba994ee44cb11535e => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 12:48:45.796150 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 326/669] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Oct 14 12:48:45 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 14 12:48:45.958371 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29023771-7777-4270-b27c-39acdf5d7a37 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:45.958877 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29023771-7777-4270-b27c-39acdf5d7a37 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:45.959263 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29023771-7777-4270-b27c-39acdf5d7a37 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:45.961151 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 344/670] 10.222.0.17 () {54 vars in 927 bytes} [Fri Oct 14 12:48:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:48:45.967929 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b17e6bc-0aca-4035-9bca-dc78e453f98c None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:45.968315 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b17e6bc-0aca-4035-9bca-dc78e453f98c None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:45.968483 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b17e6bc-0aca-4035-9bca-dc78e453f98c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:45.992244 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-6b17e6bc-0aca-4035-9bca-dc78e453f98c None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:48:45.994327 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-6b17e6bc-0aca-4035-9bca-dc78e453f98c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:48:46.088044 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29023771-7777-4270-b27c-39acdf5d7a37 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:46.117818 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 327/671] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Oct 14 12:48:45 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 14 12:48:46.161146 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0574d8e6-630d-433f-b4cf-c8777af0532f None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:46.161636 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0574d8e6-630d-433f-b4cf-c8777af0532f None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:46.162113 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0574d8e6-630d-433f-b4cf-c8777af0532f None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:46.170682 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 328/672] 10.222.0.17 () {54 vars in 927 bytes} [Fri Oct 14 12:48:46 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:48:46.174262 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a2e300-fefb-4b22-a130-55d62ca87542 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:46.174753 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a2e300-fefb-4b22-a130-55d62ca87542 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:46.175231 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a2e300-fefb-4b22-a130-55d62ca87542 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:46.205903 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-68a2e300-fefb-4b22-a130-55d62ca87542 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:48:46.208228 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-68a2e300-fefb-4b22-a130-55d62ca87542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:48:46.212294 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29023771-7777-4270-b27c-39acdf5d7a37 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:46.250391 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:46.270290 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9a913c-9752-4916-a8b2-1853bbd9b542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:46.271828 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9a913c-9752-4916-a8b2-1853bbd9b542 None admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:46.272666 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9a913c-9752-4916-a8b2-1853bbd9b542 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:46.273546 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9a913c-9752-4916-a8b2-1853bbd9b542 None admin] PATH_INFO: `/v3/services` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:46.275035 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9a913c-9752-4916-a8b2-1853bbd9b542 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:46.278205 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9a913c-9752-4916-a8b2-1853bbd9b542 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:46.300310 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 329/673] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Oct 14 12:48:46 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 14 12:48:46.318596 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 345/674] 10.222.0.17 () {60 vars in 1141 bytes} [Fri Oct 14 12:48:46 2022] POST /identity/v3/services => generated 251 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 12:48:46.429297 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a2e300-fefb-4b22-a130-55d62ca87542 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:46.499582 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:46.596013 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a2e300-fefb-4b22-a130-55d62ca87542 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:46.641372 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18f16ef-946b-422f-85f3-c530cacb57f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:46.642011 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18f16ef-946b-422f-85f3-c530cacb57f8 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:46.642384 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18f16ef-946b-422f-85f3-c530cacb57f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:46.643342 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18f16ef-946b-422f-85f3-c530cacb57f8 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:46.644005 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18f16ef-946b-422f-85f3-c530cacb57f8 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:46.645785 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18f16ef-946b-422f-85f3-c530cacb57f8 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:46.655343 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-a18f16ef-946b-422f-85f3-c530cacb57f8 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 14 12:48:46.655343 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:46.655343 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 14 12:48:46.655343 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 14 12:48:46.655343 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 14 12:48:46.655343 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 14 12:48:46.655343 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 14 12:48:46.655343 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 12:48:46.655343 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 14 12:48:46.655343 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 14 12:48:46.655343 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 14 12:48:46.655343 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 14 12:48:46.655343 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:46.655343 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:48:46.655343 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:48:46.655343 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:48:46.656328 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:48:46.656328 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:48:46.656328 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:48:46.656328 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:48:46.656328 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:48:46.656328 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:48:46.656328 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:48:46.656328 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 14 12:48:46.656328 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 14 12:48:46.656328 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 14 12:48:46.656328 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 14 12:48:46.656328 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:48:46.656328 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:48:46.656328 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:48:46.656328 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:48:46.656328 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:48:46.656328 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:48:46.657205 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:48:46.657205 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 14 12:48:46.657205 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:48:46.657205 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:48:46.657205 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:48:46.657205 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:48:46.657205 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:48:46.657205 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:48:46.657205 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:48:46.657205 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:48:46.657205 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 14 12:48:46.657205 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 12:48:46.657205 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 14 12:48:46.657205 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 14 12:48:46.661676 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 330/675] 10.222.0.17 () {56 vars in 1132 bytes} [Fri Oct 14 12:48:46 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:48:46.664093 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9a913c-9752-4916-a8b2-1853bbd9b542 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:46.753118 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18f16ef-946b-422f-85f3-c530cacb57f8 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:46.800958 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9a913c-9752-4916-a8b2-1853bbd9b542 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:46.845546 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db898c4-e532-4cac-bc8c-02a62b15961c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:46.847046 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db898c4-e532-4cac-bc8c-02a62b15961c None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:46.847561 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db898c4-e532-4cac-bc8c-02a62b15961c None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:46.848038 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db898c4-e532-4cac-bc8c-02a62b15961c None admin] PATH_INFO: `/v3/services` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:46.848885 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db898c4-e532-4cac-bc8c-02a62b15961c None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:46.849393 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db898c4-e532-4cac-bc8c-02a62b15961c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:46.851052 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db898c4-e532-4cac-bc8c-02a62b15961c None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:46.862508 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 346/676] 10.222.0.17 () {56 vars in 1126 bytes} [Fri Oct 14 12:48:46 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:46.864774 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db898c4-e532-4cac-bc8c-02a62b15961c None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:46.896769 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:46.906187 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18f16ef-946b-422f-85f3-c530cacb57f8 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:46.921806 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:46.960571 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfc529f-d15c-46e6-9645-008fd9cf3e03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:46.961607 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfc529f-d15c-46e6-9645-008fd9cf3e03 None admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:46.961893 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfc529f-d15c-46e6-9645-008fd9cf3e03 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:46.962196 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfc529f-d15c-46e6-9645-008fd9cf3e03 None admin] PATH_INFO: `/v3/services` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:46.963133 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfc529f-d15c-46e6-9645-008fd9cf3e03 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:46.964551 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfc529f-d15c-46e6-9645-008fd9cf3e03 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:46.990163 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 331/677] 10.222.0.17 () {60 vars in 1141 bytes} [Fri Oct 14 12:48:46 2022] POST /identity/v3/services => generated 241 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 12:48:46.993278 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db898c4-e532-4cac-bc8c-02a62b15961c None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:47.043749 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be9646d-40e0-4b39-8ef4-fdb0a252138f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:47.044293 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be9646d-40e0-4b39-8ef4-fdb0a252138f None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:47.044575 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be9646d-40e0-4b39-8ef4-fdb0a252138f None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:47.044849 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be9646d-40e0-4b39-8ef4-fdb0a252138f None admin] PATH_INFO: `/v3/services` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:47.045490 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be9646d-40e0-4b39-8ef4-fdb0a252138f None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:47.045797 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be9646d-40e0-4b39-8ef4-fdb0a252138f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:47.047570 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be9646d-40e0-4b39-8ef4-fdb0a252138f None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:47.054733 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 347/678] 10.222.0.17 () {56 vars in 1126 bytes} [Fri Oct 14 12:48:46 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:47.063444 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfc529f-d15c-46e6-9645-008fd9cf3e03 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:47.199129 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfc529f-d15c-46e6-9645-008fd9cf3e03 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:47.242675 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ab04f6-e38e-42d8-9b27-c7d18e3fb6bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:47.243295 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ab04f6-e38e-42d8-9b27-c7d18e3fb6bd None admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:47.243578 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ab04f6-e38e-42d8-9b27-c7d18e3fb6bd None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:47.243851 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ab04f6-e38e-42d8-9b27-c7d18e3fb6bd None admin] PATH_INFO: `/v3/endpoints` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:47.244524 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ab04f6-e38e-42d8-9b27-c7d18e3fb6bd None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:47.245904 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ab04f6-e38e-42d8-9b27-c7d18e3fb6bd None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:47.267857 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 332/679] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Oct 14 12:48:47 2022] POST /identity/v3/endpoints => generated 347 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 12:48:48.261209 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8162ad0d-143c-4f31-af34-02f06dcc2304 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:48.261727 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8162ad0d-143c-4f31-af34-02f06dcc2304 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:48.261727 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8162ad0d-143c-4f31-af34-02f06dcc2304 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:48.263517 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 348/680] 10.222.0.17 () {54 vars in 927 bytes} [Fri Oct 14 12:48:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:48:48.269106 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5426f905-64a4-4e34-837c-e8a53fa77e30 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:48.270052 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5426f905-64a4-4e34-837c-e8a53fa77e30 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:48.270574 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5426f905-64a4-4e34-837c-e8a53fa77e30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:48.289542 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-5426f905-64a4-4e34-837c-e8a53fa77e30 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:48:48.291127 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-5426f905-64a4-4e34-837c-e8a53fa77e30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:48:48.303108 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:48.374826 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 333/681] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Oct 14 12:48:48 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 14 12:48:48.639746 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b202cf50-49ac-47cf-a25e-6df6b612d6a3 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:48.640245 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b202cf50-49ac-47cf-a25e-6df6b612d6a3 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:48.640659 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b202cf50-49ac-47cf-a25e-6df6b612d6a3 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:48.642491 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 349/682] 10.222.0.17 () {54 vars in 927 bytes} [Fri Oct 14 12:48:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:48:48.647998 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616f8ea0-54de-4ec4-809b-a5b31768f7fe None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:48.648549 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616f8ea0-54de-4ec4-809b-a5b31768f7fe None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:48.649018 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616f8ea0-54de-4ec4-809b-a5b31768f7fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:48.650979 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b202cf50-49ac-47cf-a25e-6df6b612d6a3 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:48.667970 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-616f8ea0-54de-4ec4-809b-a5b31768f7fe None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:48:48.669352 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-616f8ea0-54de-4ec4-809b-a5b31768f7fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:48:48.750245 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 334/683] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Oct 14 12:48:48 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 14 12:48:48.763414 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b202cf50-49ac-47cf-a25e-6df6b612d6a3 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:48.773386 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:48.800897 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ef4b4d-9ab7-4498-96a8-9c4c996ec217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:48.801529 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ef4b4d-9ab7-4498-96a8-9c4c996ec217 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:48.801808 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ef4b4d-9ab7-4498-96a8-9c4c996ec217 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:48.802078 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ef4b4d-9ab7-4498-96a8-9c4c996ec217 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:48.812717 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ef4b4d-9ab7-4498-96a8-9c4c996ec217 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 12:48:48.818372 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-b0ef4b4d-9ab7-4498-96a8-9c4c996ec217 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 14 12:48:48.818372 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:48.818372 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:48:48.818372 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:48:48.818372 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:48:48.818372 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:48:48.818372 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:48:48.818372 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:48:48.818372 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:48:48.818372 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:48:48.818372 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:48:48.818372 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:48:48.818372 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 12:48:48.818372 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 12:48:48.818372 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 12:48:48.818372 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 12:48:48.819272 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 12:48:48.819272 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 12:48:48.819272 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 12:48:48.819272 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 12:48:48.819272 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:48:48.819272 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:48:48.819272 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:48:48.819272 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:48:48.819272 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:48:48.819272 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:48:48.819272 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:48:48.819272 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 14 12:48:48.819272 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:48:48.819272 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:48:48.819272 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:48:48.819272 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:48:48.820081 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:48:48.820081 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:48:48.820081 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:48:48.820081 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:48:48.820081 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 12:48:48.820081 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 12:48:48.820081 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 12:48:48.820081 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 12:48:48.820081 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 12:48:48.820081 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 12:48:48.820081 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 14 12:48:48.820081 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 14 12:48:48.824398 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 350/684] 10.222.0.17 () {56 vars in 1120 bytes} [Fri Oct 14 12:48:48 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 14 12:48:48.825774 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616f8ea0-54de-4ec4-809b-a5b31768f7fe None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:48.897074 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:48.927096 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616f8ea0-54de-4ec4-809b-a5b31768f7fe None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:48.962090 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ae53cf-d6f4-4fc0-9b8b-476b6d864b4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:48.962727 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ae53cf-d6f4-4fc0-9b8b-476b6d864b4b None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:48.963005 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ae53cf-d6f4-4fc0-9b8b-476b6d864b4b None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:48.963281 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ae53cf-d6f4-4fc0-9b8b-476b6d864b4b None admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:48.963949 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ae53cf-d6f4-4fc0-9b8b-476b6d864b4b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:48.964256 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ae53cf-d6f4-4fc0-9b8b-476b6d864b4b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:48.965631 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ae53cf-d6f4-4fc0-9b8b-476b6d864b4b None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:48.978231 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 335/685] 10.222.0.17 () {56 vars in 1115 bytes} [Fri Oct 14 12:48:48 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:48.980000 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ef4b4d-9ab7-4498-96a8-9c4c996ec217 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:49.030112 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ae53cf-d6f4-4fc0-9b8b-476b6d864b4b None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:49.094905 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ef4b4d-9ab7-4498-96a8-9c4c996ec217 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:49.133975 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6368876d-7d1e-43c7-b7fd-47c78bd12b30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:49.135050 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6368876d-7d1e-43c7-b7fd-47c78bd12b30 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:49.135338 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6368876d-7d1e-43c7-b7fd-47c78bd12b30 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:49.135617 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6368876d-7d1e-43c7-b7fd-47c78bd12b30 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:49.148104 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6368876d-7d1e-43c7-b7fd-47c78bd12b30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:49.149274 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6368876d-7d1e-43c7-b7fd-47c78bd12b30 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:49.165431 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-6368876d-7d1e-43c7-b7fd-47c78bd12b30 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:48:49.165431 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:49.165431 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:48:49.165431 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:48:49.165431 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:48:49.165431 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:48:49.165431 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:48:49.165431 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:48:49.165431 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:48:49.165431 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:48:49.165431 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:48:49.165431 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:48:49.165431 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 12:48:49.165431 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 12:48:49.165431 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 12:48:49.165431 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 12:48:49.166496 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:48:49.166496 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:48:49.166496 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:48:49.166496 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:48:49.166496 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:48:49.166496 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:48:49.166496 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:48:49.166496 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 14 12:48:49.166496 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:48:49.166496 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:48:49.166496 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:48:49.166496 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:48:49.166496 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:48:49.166496 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:48:49.166496 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:48:49.166496 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:48:49.166496 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 12:48:49.167412 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 12:48:49.167412 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:48:49.167412 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 14 12:48:49.168750 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ae53cf-d6f4-4fc0-9b8b-476b6d864b4b None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:49.170251 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 351/686] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Oct 14 12:48:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:48:49.172798 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6368876d-7d1e-43c7-b7fd-47c78bd12b30 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:49.196245 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:49.219825 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b5ab4a-7386-4cbf-bad4-5116b9994a91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:49.221553 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b5ab4a-7386-4cbf-bad4-5116b9994a91 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:49.222545 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b5ab4a-7386-4cbf-bad4-5116b9994a91 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:49.225079 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b5ab4a-7386-4cbf-bad4-5116b9994a91 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:49.225424 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b5ab4a-7386-4cbf-bad4-5116b9994a91 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:49.226899 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b5ab4a-7386-4cbf-bad4-5116b9994a91 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:49.237134 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-86b5ab4a-7386-4cbf-bad4-5116b9994a91 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 14 12:48:49.237134 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:49.237134 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 14 12:48:49.237134 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 14 12:48:49.237134 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 14 12:48:49.237134 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 14 12:48:49.237134 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 14 12:48:49.237134 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 12:48:49.237134 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 14 12:48:49.237134 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 14 12:48:49.237134 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 14 12:48:49.237134 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 14 12:48:49.237134 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:49.237134 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:48:49.237134 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:48:49.237134 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:48:49.237134 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:48:49.238311 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:48:49.238311 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:48:49.238311 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:48:49.238311 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:48:49.238311 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:48:49.238311 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:48:49.238311 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 14 12:48:49.238311 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 14 12:48:49.238311 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 14 12:48:49.238311 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 14 12:48:49.238311 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:48:49.238311 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:48:49.238311 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:48:49.238311 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:48:49.238311 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:48:49.238311 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:48:49.239176 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:48:49.239176 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 14 12:48:49.239176 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:48:49.239176 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:48:49.239176 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:48:49.239176 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:48:49.239176 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:48:49.239176 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:48:49.239176 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:48:49.239176 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:48:49.239176 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 14 12:48:49.239176 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 12:48:49.239176 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 14 12:48:49.239176 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 14 12:48:49.239176 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 336/687] 10.222.0.17 () {56 vars in 1114 bytes} [Fri Oct 14 12:48:49 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 14 12:48:49.244820 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:49.246620 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b5ab4a-7386-4cbf-bad4-5116b9994a91 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:49.319458 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6368876d-7d1e-43c7-b7fd-47c78bd12b30 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:49.359356 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3293634-6895-4375-b555-e2ab00629833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:49.359959 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3293634-6895-4375-b555-e2ab00629833 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:49.360241 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3293634-6895-4375-b555-e2ab00629833 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:49.360515 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3293634-6895-4375-b555-e2ab00629833 None admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:49.360835 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b5ab4a-7386-4cbf-bad4-5116b9994a91 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:49.361952 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3293634-6895-4375-b555-e2ab00629833 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:49.362037 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3293634-6895-4375-b555-e2ab00629833 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:49.364750 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3293634-6895-4375-b555-e2ab00629833 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:49.377923 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 352/688] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Oct 14 12:48:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:49.379523 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33b0fe2-0ae0-4be6-999a-12cdbc0d958e None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:49.379955 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33b0fe2-0ae0-4be6-999a-12cdbc0d958e None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:49.380373 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33b0fe2-0ae0-4be6-999a-12cdbc0d958e None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:49.385950 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 353/689] 10.222.0.17 () {54 vars in 927 bytes} [Fri Oct 14 12:48:49 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:48:49.386741 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33b0fe2-0ae0-4be6-999a-12cdbc0d958e None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:49.404680 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9999aff-b296-4bf1-99dc-f8df362db466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:49.405213 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9999aff-b296-4bf1-99dc-f8df362db466 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:49.405495 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9999aff-b296-4bf1-99dc-f8df362db466 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:49.405947 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9999aff-b296-4bf1-99dc-f8df362db466 None admin] PATH_INFO: `/v3/services` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:49.406649 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9999aff-b296-4bf1-99dc-f8df362db466 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:49.406958 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9999aff-b296-4bf1-99dc-f8df362db466 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:49.409145 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9999aff-b296-4bf1-99dc-f8df362db466 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:49.414196 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 337/690] 10.222.0.17 () {56 vars in 1114 bytes} [Fri Oct 14 12:48:49 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:49.415638 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef57582-0da4-42ae-abcd-8c3c1ec5c605 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:49.415921 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef57582-0da4-42ae-abcd-8c3c1ec5c605 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:49.416199 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef57582-0da4-42ae-abcd-8c3c1ec5c605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:49.435971 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-eef57582-0da4-42ae-abcd-8c3c1ec5c605 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:48:49.437217 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-eef57582-0da4-42ae-abcd-8c3c1ec5c605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:48:49.482862 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:49.504342 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33b0fe2-0ae0-4be6-999a-12cdbc0d958e None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:49.504520 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:49.516219 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 338/691] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Oct 14 12:48:49 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 14 12:48:49.517345 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef57582-0da4-42ae-abcd-8c3c1ec5c605 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:49.546612 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1173723e-28ab-4f2c-adc7-69bbb86c9bc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:49.547268 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1173723e-28ab-4f2c-adc7-69bbb86c9bc5 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:49.547634 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1173723e-28ab-4f2c-adc7-69bbb86c9bc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:49.547914 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1173723e-28ab-4f2c-adc7-69bbb86c9bc5 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:49.556706 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1173723e-28ab-4f2c-adc7-69bbb86c9bc5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:49.558196 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1173723e-28ab-4f2c-adc7-69bbb86c9bc5 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:49.570643 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-1173723e-28ab-4f2c-adc7-69bbb86c9bc5 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 14 12:48:49.570643 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:49.570643 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:48:49.570643 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:48:49.570643 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:48:49.570643 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:48:49.570643 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:48:49.570643 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:48:49.570643 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:48:49.570643 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:48:49.570643 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:48:49.570643 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:48:49.570643 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 14 12:48:49.570643 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 14 12:48:49.570643 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 14 12:48:49.570643 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 14 12:48:49.571673 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:48:49.571673 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:48:49.571673 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 14 12:48:49.571673 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 12:48:49.571673 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 14 12:48:49.571673 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 12:48:49.571673 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:48:49.571673 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:48:49.571673 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:48:49.571673 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:48:49.571673 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:48:49.571673 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 14 12:48:49.571673 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:48:49.571673 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:48:49.571673 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:48:49.571673 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:48:49.571673 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:48:49.571673 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:48:49.572613 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:48:49.572613 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:48:49.572613 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 14 12:48:49.572613 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 14 12:48:49.572613 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 14 12:48:49.572613 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 14 12:48:49.572613 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 14 12:48:49.572613 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 14 12:48:49.572613 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 14 12:48:49.572613 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 14 12:48:49.572613 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 354/692] 10.222.0.17 () {56 vars in 1117 bytes} [Fri Oct 14 12:48:49 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:48:49.573673 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274942bf-02a4-4b6c-af7a-078bd64ce979 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:49.573673 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274942bf-02a4-4b6c-af7a-078bd64ce979 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:49.573827 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274942bf-02a4-4b6c-af7a-078bd64ce979 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:49.579534 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 355/693] 10.222.0.17 () {54 vars in 927 bytes} [Fri Oct 14 12:48:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:48:49.579534 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274942bf-02a4-4b6c-af7a-078bd64ce979 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:49.645350 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef57582-0da4-42ae-abcd-8c3c1ec5c605 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:49.683230 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13d8041-4286-46c9-956d-967179386b2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:49.683759 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13d8041-4286-46c9-956d-967179386b2f None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:49.684041 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13d8041-4286-46c9-956d-967179386b2f None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:49.684295 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13d8041-4286-46c9-956d-967179386b2f None admin] PATH_INFO: `/v3/services` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:49.684642 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274942bf-02a4-4b6c-af7a-078bd64ce979 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:49.684920 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13d8041-4286-46c9-956d-967179386b2f None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:49.685220 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13d8041-4286-46c9-956d-967179386b2f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:49.686635 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13d8041-4286-46c9-956d-967179386b2f None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:49.691958 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 339/694] 10.222.0.17 () {56 vars in 1114 bytes} [Fri Oct 14 12:48:49 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:49.697860 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a200572-3a23-4644-90aa-67d3764488c2 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:49.698165 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a200572-3a23-4644-90aa-67d3764488c2 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:49.698441 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a200572-3a23-4644-90aa-67d3764488c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:49.716616 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-6a200572-3a23-4644-90aa-67d3764488c2 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:48:49.717813 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-6a200572-3a23-4644-90aa-67d3764488c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:48:49.721080 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be11f77d-8a8a-4d06-86dd-34f86878293f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:49.721687 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be11f77d-8a8a-4d06-86dd-34f86878293f None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:49.721971 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be11f77d-8a8a-4d06-86dd-34f86878293f None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:49.722355 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be11f77d-8a8a-4d06-86dd-34f86878293f None admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:49.723085 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be11f77d-8a8a-4d06-86dd-34f86878293f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:49.723396 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be11f77d-8a8a-4d06-86dd-34f86878293f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:49.724817 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be11f77d-8a8a-4d06-86dd-34f86878293f None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:49.733768 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:49.743936 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 356/695] 10.222.0.17 () {56 vars in 1149 bytes} [Fri Oct 14 12:48:49 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 12:48:49.747697 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be11f77d-8a8a-4d06-86dd-34f86878293f None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:49.780936 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:49.798244 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 340/696] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Oct 14 12:48:49 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 14 12:48:49.799770 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a200572-3a23-4644-90aa-67d3764488c2 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:49.855321 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be11f77d-8a8a-4d06-86dd-34f86878293f None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:49.893015 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba4ca01-e176-46ac-9627-622d0b4babbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:49.893719 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba4ca01-e176-46ac-9627-622d0b4babbc None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:49.893996 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba4ca01-e176-46ac-9627-622d0b4babbc None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:49.894299 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba4ca01-e176-46ac-9627-622d0b4babbc None admin] PATH_INFO: `/v3/endpoints` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:49.895001 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba4ca01-e176-46ac-9627-622d0b4babbc None admin] RBAC: Adding query filter params (interface=public, service_id=a1eb7322eec0457bb88f5c0b6b9ff52d, region_id=RegionOne) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:49.895331 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba4ca01-e176-46ac-9627-622d0b4babbc None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:49.896697 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba4ca01-e176-46ac-9627-622d0b4babbc None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:49.906195 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 357/697] 10.222.0.17 () {56 vars in 1251 bytes} [Fri Oct 14 12:48:49 2022] GET /identity/v3/endpoints?service_id=a1eb7322eec0457bb88f5c0b6b9ff52d&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:49.906195 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba4ca01-e176-46ac-9627-622d0b4babbc None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:49.912726 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a200572-3a23-4644-90aa-67d3764488c2 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:49.948870 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d027b193-b333-4093-ad39-139573a8a782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:49.949402 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d027b193-b333-4093-ad39-139573a8a782 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:49.949711 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d027b193-b333-4093-ad39-139573a8a782 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:49.949956 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d027b193-b333-4093-ad39-139573a8a782 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:49.965703 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:50.009186 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:50.009850 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba4ca01-e176-46ac-9627-622d0b4babbc None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:50.025243 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d027b193-b333-4093-ad39-139573a8a782 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:50.026924 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d027b193-b333-4093-ad39-139573a8a782 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:50.047854 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61b1bca-d7a7-4b09-b401-c1733cbbcb2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:50.049257 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61b1bca-d7a7-4b09-b401-c1733cbbcb2e None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:50.050160 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61b1bca-d7a7-4b09-b401-c1733cbbcb2e None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:50.050651 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61b1bca-d7a7-4b09-b401-c1733cbbcb2e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:50.051667 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61b1bca-d7a7-4b09-b401-c1733cbbcb2e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:50.054113 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61b1bca-d7a7-4b09-b401-c1733cbbcb2e None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:50.063653 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-d61b1bca-d7a7-4b09-b401-c1733cbbcb2e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 14 12:48:50.063653 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:50.063653 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 14 12:48:50.063653 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 14 12:48:50.063653 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 14 12:48:50.063653 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 14 12:48:50.063653 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 14 12:48:50.063653 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 12:48:50.063653 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 14 12:48:50.063653 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 14 12:48:50.063653 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 14 12:48:50.063653 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 14 12:48:50.063653 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:50.063653 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:48:50.063653 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:48:50.063653 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:48:50.063653 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:48:50.065298 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:48:50.065298 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:48:50.065298 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:48:50.065298 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:48:50.065298 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:48:50.065298 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:48:50.065298 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 14 12:48:50.065298 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 14 12:48:50.065298 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 14 12:48:50.065298 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 14 12:48:50.065298 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:48:50.065298 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:48:50.065298 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:48:50.065298 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:48:50.065298 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:48:50.065298 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:48:50.066605 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:48:50.066605 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 14 12:48:50.066605 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:48:50.066605 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:48:50.066605 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:48:50.066605 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:48:50.066605 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:48:50.066605 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:48:50.066605 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:48:50.066605 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:48:50.066605 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 14 12:48:50.066605 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 12:48:50.066605 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 14 12:48:50.066605 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 14 12:48:50.070321 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 358/698] 10.222.0.17 () {56 vars in 1126 bytes} [Fri Oct 14 12:48:49 2022] GET /identity/v3/services/object-store => generated 93 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:48:50.070999 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61b1bca-d7a7-4b09-b401-c1733cbbcb2e None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:50.130934 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 341/699] 10.222.0.17 () {58 vars in 1282 bytes} [Fri Oct 14 12:48:49 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 14 12:48:50.131776 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d027b193-b333-4093-ad39-139573a8a782 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:50.180297 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61b1bca-d7a7-4b09-b401-c1733cbbcb2e None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:50.204875 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:50.212729 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:50.214157 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a68fe4-378d-4f5b-bbc5-bf7ca9865dc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:50.214799 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a68fe4-378d-4f5b-bbc5-bf7ca9865dc9 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:50.215080 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a68fe4-378d-4f5b-bbc5-bf7ca9865dc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:50.215353 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a68fe4-378d-4f5b-bbc5-bf7ca9865dc9 None admin] PATH_INFO: `/v3/services` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:50.215961 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a68fe4-378d-4f5b-bbc5-bf7ca9865dc9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:50.217350 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a68fe4-378d-4f5b-bbc5-bf7ca9865dc9 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:50.223850 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 359/700] 10.222.0.17 () {56 vars in 1087 bytes} [Fri Oct 14 12:48:50 2022] GET /identity/v3/services => generated 1497 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 12:48:50.224714 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a68fe4-378d-4f5b-bbc5-bf7ca9865dc9 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:50.234693 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d027b193-b333-4093-ad39-139573a8a782 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:50.275986 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6d2895-43c9-4791-97cd-a8ef0618556f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:50.276627 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6d2895-43c9-4791-97cd-a8ef0618556f None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:50.276904 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6d2895-43c9-4791-97cd-a8ef0618556f None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:50.277176 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6d2895-43c9-4791-97cd-a8ef0618556f None admin] PATH_INFO: `/v3/services/compute` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:50.277771 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6d2895-43c9-4791-97cd-a8ef0618556f None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:50.279228 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6d2895-43c9-4791-97cd-a8ef0618556f None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:50.290588 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-6e6d2895-43c9-4791-97cd-a8ef0618556f None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 14 12:48:50.290588 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:50.290588 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 14 12:48:50.290588 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 14 12:48:50.290588 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 14 12:48:50.290588 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 14 12:48:50.290588 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 14 12:48:50.290588 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 12:48:50.290588 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 14 12:48:50.290588 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 14 12:48:50.290588 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 14 12:48:50.290588 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 14 12:48:50.290588 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:50.290588 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:48:50.290588 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:48:50.290588 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:48:50.290588 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:48:50.291672 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:48:50.291672 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:48:50.291672 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:48:50.291672 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:48:50.291672 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:48:50.291672 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:48:50.291672 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 14 12:48:50.291672 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 14 12:48:50.291672 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 14 12:48:50.291672 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 14 12:48:50.291672 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:48:50.291672 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:48:50.291672 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:48:50.291672 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:48:50.291672 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:48:50.291672 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:48:50.292503 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:48:50.292503 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 14 12:48:50.292503 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:48:50.292503 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:48:50.292503 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:48:50.292503 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:48:50.292503 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:48:50.292503 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:48:50.292503 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:48:50.292503 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:48:50.292503 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 14 12:48:50.292503 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 12:48:50.292503 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 14 12:48:50.292503 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 14 12:48:50.292503 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 342/701] 10.222.0.17 () {56 vars in 1111 bytes} [Fri Oct 14 12:48:50 2022] GET /identity/v3/services/compute => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:48:50.293296 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6d2895-43c9-4791-97cd-a8ef0618556f None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:50.337162 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a68fe4-378d-4f5b-bbc5-bf7ca9865dc9 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:50.374754 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a1fd32-a738-45d4-b509-4b062c7d0946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:50.375378 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a1fd32-a738-45d4-b509-4b062c7d0946 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:50.375659 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a1fd32-a738-45d4-b509-4b062c7d0946 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:50.375931 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a1fd32-a738-45d4-b509-4b062c7d0946 None admin] PATH_INFO: `/v3/services` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:50.376617 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a1fd32-a738-45d4-b509-4b062c7d0946 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:50.376925 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a1fd32-a738-45d4-b509-4b062c7d0946 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:50.378340 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a1fd32-a738-45d4-b509-4b062c7d0946 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:50.388568 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 360/702] 10.222.0.17 () {56 vars in 1122 bytes} [Fri Oct 14 12:48:50 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:50.389434 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a1fd32-a738-45d4-b509-4b062c7d0946 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:50.418316 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6d2895-43c9-4791-97cd-a8ef0618556f None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:50.450693 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:50.458807 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b18d7f-57e0-4086-8cd9-cc0c39240450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:50.459368 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b18d7f-57e0-4086-8cd9-cc0c39240450 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:50.459648 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b18d7f-57e0-4086-8cd9-cc0c39240450 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:50.459926 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b18d7f-57e0-4086-8cd9-cc0c39240450 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:50.471848 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b18d7f-57e0-4086-8cd9-cc0c39240450 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:50.473321 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b18d7f-57e0-4086-8cd9-cc0c39240450 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:50.489073 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-d1b18d7f-57e0-4086-8cd9-cc0c39240450 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:48:50.489073 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:50.489073 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:48:50.489073 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:48:50.489073 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:48:50.489073 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:48:50.489073 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:48:50.489073 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:48:50.489073 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:48:50.489073 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:48:50.489073 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:48:50.489073 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:48:50.489073 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 12:48:50.489073 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 12:48:50.489073 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 12:48:50.489073 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 12:48:50.490037 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:48:50.490037 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:48:50.490037 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:48:50.490037 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:48:50.490037 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:48:50.490037 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:48:50.490037 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:48:50.490037 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 14 12:48:50.490037 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:48:50.490037 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:48:50.490037 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:48:50.490037 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:48:50.490037 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:48:50.490037 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:48:50.490037 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:48:50.490037 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:48:50.490037 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 12:48:50.490966 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 12:48:50.490966 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:48:50.490966 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 14 12:48:50.490966 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 343/703] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Oct 14 12:48:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:48:50.491197 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b18d7f-57e0-4086-8cd9-cc0c39240450 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:50.494190 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:50.505307 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a1fd32-a738-45d4-b509-4b062c7d0946 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:50.540098 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360ca295-5580-4f29-a95c-84a26bad507d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:50.540712 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360ca295-5580-4f29-a95c-84a26bad507d None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:50.540990 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360ca295-5580-4f29-a95c-84a26bad507d None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:50.541267 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360ca295-5580-4f29-a95c-84a26bad507d None admin] PATH_INFO: `/v3/services` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:50.541888 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360ca295-5580-4f29-a95c-84a26bad507d None admin] RBAC: Adding query filter params (name=compute) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:50.542221 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360ca295-5580-4f29-a95c-84a26bad507d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:50.543627 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360ca295-5580-4f29-a95c-84a26bad507d None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:50.548980 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 361/704] 10.222.0.17 () {56 vars in 1112 bytes} [Fri Oct 14 12:48:50 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:50.549930 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360ca295-5580-4f29-a95c-84a26bad507d None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:50.605506 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b18d7f-57e0-4086-8cd9-cc0c39240450 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:50.642044 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c844ed53-9f3d-4c9a-a599-695bf915dedd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:50.642698 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c844ed53-9f3d-4c9a-a599-695bf915dedd None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:50.642973 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c844ed53-9f3d-4c9a-a599-695bf915dedd None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:50.643240 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c844ed53-9f3d-4c9a-a599-695bf915dedd None admin] PATH_INFO: `/v3/services` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:50.643860 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c844ed53-9f3d-4c9a-a599-695bf915dedd None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:50.644158 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c844ed53-9f3d-4c9a-a599-695bf915dedd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:50.645532 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c844ed53-9f3d-4c9a-a599-695bf915dedd None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:50.654895 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 344/705] 10.222.0.17 () {56 vars in 1122 bytes} [Fri Oct 14 12:48:50 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:50.654895 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c844ed53-9f3d-4c9a-a599-695bf915dedd None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:50.661798 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360ca295-5580-4f29-a95c-84a26bad507d None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:50.680434 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:50.698819 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713f9061-ed13-459c-8e5c-eb26eba0d955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:50.699588 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713f9061-ed13-459c-8e5c-eb26eba0d955 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:50.699873 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713f9061-ed13-459c-8e5c-eb26eba0d955 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:50.700155 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713f9061-ed13-459c-8e5c-eb26eba0d955 None admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:50.700801 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713f9061-ed13-459c-8e5c-eb26eba0d955 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:50.701109 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713f9061-ed13-459c-8e5c-eb26eba0d955 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:50.702510 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713f9061-ed13-459c-8e5c-eb26eba0d955 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:50.718107 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 362/706] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Oct 14 12:48:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:50.718107 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713f9061-ed13-459c-8e5c-eb26eba0d955 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:50.729483 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:50.769805 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c844ed53-9f3d-4c9a-a599-695bf915dedd None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:50.805778 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e76a1a-bad6-44d3-835d-ba10e2d9a618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:50.806421 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e76a1a-bad6-44d3-835d-ba10e2d9a618 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:50.806698 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e76a1a-bad6-44d3-835d-ba10e2d9a618 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:50.806963 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e76a1a-bad6-44d3-835d-ba10e2d9a618 None admin] PATH_INFO: `/v3/services` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:50.807580 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e76a1a-bad6-44d3-835d-ba10e2d9a618 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:50.807877 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e76a1a-bad6-44d3-835d-ba10e2d9a618 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:50.809259 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e76a1a-bad6-44d3-835d-ba10e2d9a618 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:50.822152 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 345/707] 10.222.0.17 () {56 vars in 1112 bytes} [Fri Oct 14 12:48:50 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:50.822152 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e76a1a-bad6-44d3-835d-ba10e2d9a618 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:50.827232 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713f9061-ed13-459c-8e5c-eb26eba0d955 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:50.869074 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f27d27-2101-40f5-9d01-752537e0f746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:50.870099 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f27d27-2101-40f5-9d01-752537e0f746 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:50.870380 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f27d27-2101-40f5-9d01-752537e0f746 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:50.870650 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f27d27-2101-40f5-9d01-752537e0f746 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:50.871362 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f27d27-2101-40f5-9d01-752537e0f746 None admin] RBAC: Adding query filter params (interface=public, service_id=f5226a523a0f4b77ba77c35514cc055e, region_id=RegionOne) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:50.871790 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f27d27-2101-40f5-9d01-752537e0f746 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:50.873221 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f27d27-2101-40f5-9d01-752537e0f746 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:50.879550 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 363/708] 10.222.0.17 () {56 vars in 1251 bytes} [Fri Oct 14 12:48:50 2022] GET /identity/v3/endpoints?service_id=f5226a523a0f4b77ba77c35514cc055e&interface=public®ion_id=RegionOne => generated 194 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:50.885105 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f27d27-2101-40f5-9d01-752537e0f746 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:50.933952 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:50.947102 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e76a1a-bad6-44d3-835d-ba10e2d9a618 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:50.985638 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:50.995756 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8681621-edfa-4260-bd23-95fe9292ddb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:50.996429 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8681621-edfa-4260-bd23-95fe9292ddb5 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:50.996712 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8681621-edfa-4260-bd23-95fe9292ddb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:50.997251 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8681621-edfa-4260-bd23-95fe9292ddb5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:51.001748 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f27d27-2101-40f5-9d01-752537e0f746 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:51.007202 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8681621-edfa-4260-bd23-95fe9292ddb5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:51.008693 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8681621-edfa-4260-bd23-95fe9292ddb5 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:51.025203 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-e8681621-edfa-4260-bd23-95fe9292ddb5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 12:48:51.025203 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:51.025203 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:48:51.025203 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:48:51.025203 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:48:51.025203 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:48:51.025203 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:48:51.025203 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:48:51.025203 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:48:51.025203 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:48:51.025203 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:48:51.025203 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:48:51.025203 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 14 12:48:51.025203 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 14 12:48:51.025203 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 14 12:48:51.026165 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 14 12:48:51.026165 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:48:51.026165 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:48:51.026165 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:48:51.026165 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:48:51.026165 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:48:51.026165 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:48:51.026165 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:48:51.026165 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 14 12:48:51.026165 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:48:51.026165 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:48:51.026165 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:48:51.026165 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:48:51.026165 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:48:51.026165 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:48:51.026165 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:48:51.026165 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:48:51.027090 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 14 12:48:51.027090 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 14 12:48:51.027090 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 14 12:48:51.027090 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 14 12:48:51.027090 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 14 12:48:51.027090 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 14 12:48:51.027090 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 12:48:51.027090 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 14 12:48:51.030638 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 346/709] 10.222.0.17 () {56 vars in 1111 bytes} [Fri Oct 14 12:48:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:48:51.033998 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8681621-edfa-4260-bd23-95fe9292ddb5 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:51.049468 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29d251b-0b68-42dd-9f7f-f103cedb4b1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:51.050084 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29d251b-0b68-42dd-9f7f-f103cedb4b1f None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:51.050420 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29d251b-0b68-42dd-9f7f-f103cedb4b1f None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:51.050694 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29d251b-0b68-42dd-9f7f-f103cedb4b1f None admin] PATH_INFO: `/v3/services` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:51.051302 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29d251b-0b68-42dd-9f7f-f103cedb4b1f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:51.052748 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29d251b-0b68-42dd-9f7f-f103cedb4b1f None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:51.061051 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 364/710] 10.222.0.17 () {56 vars in 1087 bytes} [Fri Oct 14 12:48:50 2022] GET /identity/v3/services => generated 1497 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 14 12:48:51.169219 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8681621-edfa-4260-bd23-95fe9292ddb5 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:51.208731 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1cfaa1-628d-4296-b386-98ebd9a57f0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:51.209353 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1cfaa1-628d-4296-b386-98ebd9a57f0b None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:51.209630 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1cfaa1-628d-4296-b386-98ebd9a57f0b None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:51.209902 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1cfaa1-628d-4296-b386-98ebd9a57f0b None admin] PATH_INFO: `/v3/projects` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:51.210642 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1cfaa1-628d-4296-b386-98ebd9a57f0b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:51.210950 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1cfaa1-628d-4296-b386-98ebd9a57f0b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:51.212444 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1cfaa1-628d-4296-b386-98ebd9a57f0b None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:51.227141 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 347/711] 10.222.0.17 () {56 vars in 1148 bytes} [Fri Oct 14 12:48:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:51.232982 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29d251b-0b68-42dd-9f7f-f103cedb4b1f None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:51.346139 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29d251b-0b68-42dd-9f7f-f103cedb4b1f None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:51.353722 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:51.384532 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ebb5d0-9673-4b18-81e6-adb38be4afe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:51.385138 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ebb5d0-9673-4b18-81e6-adb38be4afe4 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:51.385415 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ebb5d0-9673-4b18-81e6-adb38be4afe4 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:51.385689 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ebb5d0-9673-4b18-81e6-adb38be4afe4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:51.386447 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ebb5d0-9673-4b18-81e6-adb38be4afe4 None admin] RBAC: Adding query filter params (role.id=5dbcc3f2e7dd43dba994ee44cb11535e, scope.project.id=2486e73d493b40e18d9d988744993854, user.id=b83a5a78f3e7486293907cb3012c0ad5) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:51.386753 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ebb5d0-9673-4b18-81e6-adb38be4afe4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:51.388193 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ebb5d0-9673-4b18-81e6-adb38be4afe4 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:51.396741 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 365/712] 10.222.0.17 () {56 vars in 1374 bytes} [Fri Oct 14 12:48:51 2022] GET /identity/v3/role_assignments?user.id=b83a5a78f3e7486293907cb3012c0ad5&scope.project.id=2486e73d493b40e18d9d988744993854&role.id=5dbcc3f2e7dd43dba994ee44cb11535e => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:52.417560 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5aa406-af1a-49dd-b6d6-8019add59ab4 None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:52.418055 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5aa406-af1a-49dd-b6d6-8019add59ab4 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:52.418055 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5aa406-af1a-49dd-b6d6-8019add59ab4 None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:52.419587 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 348/713] 10.222.0.17 () {54 vars in 927 bytes} [Fri Oct 14 12:48:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:48:52.424987 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707717d2-3dcb-488e-a38e-cba765da037a None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:52.425397 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707717d2-3dcb-488e-a38e-cba765da037a None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:52.425564 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707717d2-3dcb-488e-a38e-cba765da037a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:52.444293 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-707717d2-3dcb-488e-a38e-cba765da037a None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:48:52.445469 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-707717d2-3dcb-488e-a38e-cba765da037a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:48:52.514018 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 366/714] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Oct 14 12:48:52 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 14 12:48:52.791541 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5aa406-af1a-49dd-b6d6-8019add59ab4 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:52.846021 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:52.901256 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5aa406-af1a-49dd-b6d6-8019add59ab4 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:52.937542 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116a73a5-0030-4cc5-930e-b962ba89ba45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:52.938594 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116a73a5-0030-4cc5-930e-b962ba89ba45 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:52.939629 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116a73a5-0030-4cc5-930e-b962ba89ba45 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:52.940101 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116a73a5-0030-4cc5-930e-b962ba89ba45 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:52.940882 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116a73a5-0030-4cc5-930e-b962ba89ba45 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:52.942713 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116a73a5-0030-4cc5-930e-b962ba89ba45 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:52.952145 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-116a73a5-0030-4cc5-930e-b962ba89ba45 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 14 12:48:52.952145 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:52.952145 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 14 12:48:52.952145 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 14 12:48:52.952145 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 14 12:48:52.952145 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 14 12:48:52.952145 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 14 12:48:52.952145 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 12:48:52.952145 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 14 12:48:52.952145 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 14 12:48:52.952145 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 14 12:48:52.952145 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 14 12:48:52.952145 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:52.952145 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:48:52.952145 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:48:52.952145 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:48:52.952145 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:48:52.953164 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:48:52.953164 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:48:52.953164 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:48:52.953164 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:48:52.953164 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:48:52.953164 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:48:52.953164 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 14 12:48:52.953164 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 14 12:48:52.953164 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 14 12:48:52.953164 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 14 12:48:52.953164 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:48:52.953164 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:48:52.953164 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:48:52.953164 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:48:52.953164 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:48:52.953164 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:48:52.954009 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:48:52.954009 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 14 12:48:52.954009 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:48:52.954009 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:48:52.954009 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:48:52.954009 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:48:52.954009 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:48:52.954009 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:48:52.954009 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:48:52.954009 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:48:52.954009 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 14 12:48:52.954009 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 12:48:52.954009 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 14 12:48:52.954009 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 14 12:48:52.961423 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 349/715] 10.222.0.17 () {56 vars in 1114 bytes} [Fri Oct 14 12:48:52 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:48:52.963055 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707717d2-3dcb-488e-a38e-cba765da037a None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:53.068108 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:53.071725 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707717d2-3dcb-488e-a38e-cba765da037a None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:53.110196 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf43672d-be1a-427e-9a04-f9da6e824dc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:53.111359 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf43672d-be1a-427e-9a04-f9da6e824dc9 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:53.111892 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf43672d-be1a-427e-9a04-f9da6e824dc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:53.112368 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf43672d-be1a-427e-9a04-f9da6e824dc9 None admin] PATH_INFO: `/v3/services` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:53.113213 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf43672d-be1a-427e-9a04-f9da6e824dc9 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:53.113718 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf43672d-be1a-427e-9a04-f9da6e824dc9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:53.115336 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf43672d-be1a-427e-9a04-f9da6e824dc9 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:53.125262 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 367/716] 10.222.0.17 () {56 vars in 1114 bytes} [Fri Oct 14 12:48:52 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:53.127656 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116a73a5-0030-4cc5-930e-b962ba89ba45 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:53.138365 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9cdbb9-c685-42c5-89fe-52750c25ac32 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:53.138638 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9cdbb9-c685-42c5-89fe-52750c25ac32 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:53.139007 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9cdbb9-c685-42c5-89fe-52750c25ac32 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:53.140579 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 368/717] 10.222.0.17 () {54 vars in 927 bytes} [Fri Oct 14 12:48:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 14 12:48:53.150510 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be95600-1605-4dda-bbf3-a7c1b6487b40 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:53.150803 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be95600-1605-4dda-bbf3-a7c1b6487b40 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:53.151072 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be95600-1605-4dda-bbf3-a7c1b6487b40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:53.169946 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-6be95600-1605-4dda-bbf3-a7c1b6487b40 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:48:53.171602 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-6be95600-1605-4dda-bbf3-a7c1b6487b40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:48:53.250465 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 369/718] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Oct 14 12:48:53 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 14 12:48:53.255906 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116a73a5-0030-4cc5-930e-b962ba89ba45 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:53.271129 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:53.293607 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17c8212-ddbe-476d-9b8e-6db12e6aae74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:53.294618 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17c8212-ddbe-476d-9b8e-6db12e6aae74 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:53.295100 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17c8212-ddbe-476d-9b8e-6db12e6aae74 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:53.295584 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17c8212-ddbe-476d-9b8e-6db12e6aae74 None admin] PATH_INFO: `/v3/services` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:53.296427 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17c8212-ddbe-476d-9b8e-6db12e6aae74 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:53.296938 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17c8212-ddbe-476d-9b8e-6db12e6aae74 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:53.298681 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17c8212-ddbe-476d-9b8e-6db12e6aae74 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:53.308665 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 350/719] 10.222.0.17 () {56 vars in 1114 bytes} [Fri Oct 14 12:48:53 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:53.310259 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be95600-1605-4dda-bbf3-a7c1b6487b40 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:53.318736 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5977364-f124-4761-bfe5-0ebf1b3350ff None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:53.318968 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5977364-f124-4761-bfe5-0ebf1b3350ff None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:53.319218 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5977364-f124-4761-bfe5-0ebf1b3350ff None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:53.320973 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 351/720] 10.222.0.17 () {54 vars in 927 bytes} [Fri Oct 14 12:48:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 14 12:48:53.326238 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4f919a-6693-44d3-893b-788f2725b65f None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:53.326519 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4f919a-6693-44d3-893b-788f2725b65f None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:53.326791 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4f919a-6693-44d3-893b-788f2725b65f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:53.346523 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-6d4f919a-6693-44d3-893b-788f2725b65f None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:48:53.347902 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-6d4f919a-6693-44d3-893b-788f2725b65f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:48:53.430501 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 352/721] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Oct 14 12:48:53 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 14 12:48:53.434940 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:53.442309 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be95600-1605-4dda-bbf3-a7c1b6487b40 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:53.477963 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca834c48-79b2-421a-aef2-8f03f1894591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:53.478602 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca834c48-79b2-421a-aef2-8f03f1894591 None admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:53.478881 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca834c48-79b2-421a-aef2-8f03f1894591 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:53.479153 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca834c48-79b2-421a-aef2-8f03f1894591 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:53.479827 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca834c48-79b2-421a-aef2-8f03f1894591 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:53.481186 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca834c48-79b2-421a-aef2-8f03f1894591 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:53.510329 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 370/722] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Oct 14 12:48:53 2022] POST /identity/v3/endpoints => generated 346 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 12:48:53.534067 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4f919a-6693-44d3-893b-788f2725b65f None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:53.631113 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2e1170-dee2-48cc-9aae-92cdefa72121 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:53.631454 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2e1170-dee2-48cc-9aae-92cdefa72121 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:53.631669 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2e1170-dee2-48cc-9aae-92cdefa72121 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:53.633672 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 371/723] 10.222.0.17 () {54 vars in 927 bytes} [Fri Oct 14 12:48:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 14 12:48:53.639666 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7434090-5d4a-46fc-9066-13d4ace0979b None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:53.639978 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7434090-5d4a-46fc-9066-13d4ace0979b None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:53.640219 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7434090-5d4a-46fc-9066-13d4ace0979b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:53.653109 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4f919a-6693-44d3-893b-788f2725b65f None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:53.660934 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-f7434090-5d4a-46fc-9066-13d4ace0979b None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:48:53.662335 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-f7434090-5d4a-46fc-9066-13d4ace0979b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:48:53.663973 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:53.698863 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240ee96d-1790-4e46-9f1d-22ef9f8d6fc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:53.699478 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240ee96d-1790-4e46-9f1d-22ef9f8d6fc2 None admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:53.699795 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240ee96d-1790-4e46-9f1d-22ef9f8d6fc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:53.700075 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240ee96d-1790-4e46-9f1d-22ef9f8d6fc2 None admin] PATH_INFO: `/v3/services` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:53.700731 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240ee96d-1790-4e46-9f1d-22ef9f8d6fc2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:53.702148 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240ee96d-1790-4e46-9f1d-22ef9f8d6fc2 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:53.721698 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 353/724] 10.222.0.17 () {60 vars in 1141 bytes} [Fri Oct 14 12:48:53 2022] POST /identity/v3/services => generated 242 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 12:48:53.722851 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240ee96d-1790-4e46-9f1d-22ef9f8d6fc2 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:53.756350 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 372/725] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Oct 14 12:48:53 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 14 12:48:53.849469 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240ee96d-1790-4e46-9f1d-22ef9f8d6fc2 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:53.887568 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9543a2be-fa91-480e-b687-a2ca6d2cbcfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:53.888439 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9543a2be-fa91-480e-b687-a2ca6d2cbcfd None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:53.888861 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9543a2be-fa91-480e-b687-a2ca6d2cbcfd None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:53.889290 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9543a2be-fa91-480e-b687-a2ca6d2cbcfd None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:53.890015 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9543a2be-fa91-480e-b687-a2ca6d2cbcfd None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:53.891577 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9543a2be-fa91-480e-b687-a2ca6d2cbcfd None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:53.901343 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-9543a2be-fa91-480e-b687-a2ca6d2cbcfd None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 14 12:48:53.901343 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:53.901343 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 14 12:48:53.901343 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 14 12:48:53.901343 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 14 12:48:53.901343 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 14 12:48:53.901343 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 14 12:48:53.901343 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 12:48:53.901343 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 14 12:48:53.901343 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 14 12:48:53.901343 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 14 12:48:53.901343 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 14 12:48:53.901343 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:53.901343 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:48:53.901343 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:48:53.901343 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:48:53.901343 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:48:53.902521 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:48:53.902521 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:48:53.902521 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:48:53.902521 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:48:53.902521 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:48:53.902521 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:48:53.902521 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 14 12:48:53.902521 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 14 12:48:53.902521 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 14 12:48:53.902521 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 14 12:48:53.902521 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:48:53.902521 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:48:53.902521 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:48:53.902521 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:48:53.902521 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:48:53.902521 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:48:53.903330 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:48:53.903330 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 14 12:48:53.903330 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:48:53.903330 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:48:53.903330 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:48:53.903330 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:48:53.903330 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:48:53.903330 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:48:53.903330 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:48:53.903330 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:48:53.903330 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 14 12:48:53.903330 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 12:48:53.903330 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 14 12:48:53.903330 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 14 12:48:53.904055 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 354/726] 10.222.0.17 () {56 vars in 1126 bytes} [Fri Oct 14 12:48:53 2022] GET /identity/v3/services/object-store => generated 93 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:48:53.910152 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7434090-5d4a-46fc-9066-13d4ace0979b None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:53.996682 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:54.022408 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7434090-5d4a-46fc-9066-13d4ace0979b None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:54.043149 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9543a2be-fa91-480e-b687-a2ca6d2cbcfd None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:54.060997 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837bf3a0-cb8d-4bb6-bfee-aed7fee513a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:54.061726 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837bf3a0-cb8d-4bb6-bfee-aed7fee513a2 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:54.062005 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837bf3a0-cb8d-4bb6-bfee-aed7fee513a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:54.062304 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837bf3a0-cb8d-4bb6-bfee-aed7fee513a2 None admin] PATH_INFO: `/v3/services` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:54.062929 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837bf3a0-cb8d-4bb6-bfee-aed7fee513a2 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:54.063233 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837bf3a0-cb8d-4bb6-bfee-aed7fee513a2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:54.064930 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837bf3a0-cb8d-4bb6-bfee-aed7fee513a2 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:54.074964 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 373/727] 10.222.0.17 () {56 vars in 1122 bytes} [Fri Oct 14 12:48:53 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:54.075769 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:54.077023 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837bf3a0-cb8d-4bb6-bfee-aed7fee513a2 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:54.180386 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9543a2be-fa91-480e-b687-a2ca6d2cbcfd None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:54.188200 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837bf3a0-cb8d-4bb6-bfee-aed7fee513a2 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:54.223749 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235699d6-ecf6-4254-b1fb-e09628387749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:54.224383 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235699d6-ecf6-4254-b1fb-e09628387749 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:54.224664 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235699d6-ecf6-4254-b1fb-e09628387749 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:54.224933 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235699d6-ecf6-4254-b1fb-e09628387749 None admin] PATH_INFO: `/v3/services/image` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:54.225515 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235699d6-ecf6-4254-b1fb-e09628387749 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:54.226968 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235699d6-ecf6-4254-b1fb-e09628387749 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:54.228032 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a604bf-2186-4bc3-af0f-397fa7416247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:54.228985 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a604bf-2186-4bc3-af0f-397fa7416247 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:54.229332 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a604bf-2186-4bc3-af0f-397fa7416247 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:54.230009 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a604bf-2186-4bc3-af0f-397fa7416247 None admin] PATH_INFO: `/v3/services` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:54.230671 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a604bf-2186-4bc3-af0f-397fa7416247 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:54.231246 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a604bf-2186-4bc3-af0f-397fa7416247 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:54.232606 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a604bf-2186-4bc3-af0f-397fa7416247 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:54.237292 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-235699d6-ecf6-4254-b1fb-e09628387749 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 14 12:48:54.237292 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:54.237292 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 14 12:48:54.237292 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 14 12:48:54.237292 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 14 12:48:54.237292 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 14 12:48:54.237292 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 14 12:48:54.237292 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 12:48:54.237292 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 14 12:48:54.237292 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 14 12:48:54.237292 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 14 12:48:54.237292 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 14 12:48:54.237292 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:54.237292 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:48:54.237292 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:48:54.237292 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:48:54.237292 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:48:54.238471 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:48:54.238471 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:48:54.238471 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:48:54.238471 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:48:54.238471 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:48:54.238471 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:48:54.238471 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 14 12:48:54.238471 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 14 12:48:54.238471 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 14 12:48:54.238471 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 14 12:48:54.238471 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:48:54.238471 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:48:54.238471 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:48:54.238471 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:48:54.238471 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:48:54.238471 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:48:54.239297 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:48:54.239297 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 14 12:48:54.239297 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:48:54.239297 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:48:54.239297 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:48:54.239297 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:48:54.239297 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:48:54.239297 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:48:54.239297 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:48:54.239297 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:48:54.239297 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 14 12:48:54.239297 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 12:48:54.239297 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 14 12:48:54.239297 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 14 12:48:54.240597 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 374/728] 10.222.0.17 () {56 vars in 1122 bytes} [Fri Oct 14 12:48:54 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:54.243529 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 355/729] 10.222.0.17 () {56 vars in 1105 bytes} [Fri Oct 14 12:48:54 2022] GET /identity/v3/services/image => generated 86 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 14 12:48:54.244613 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a604bf-2186-4bc3-af0f-397fa7416247 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:54.249506 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235699d6-ecf6-4254-b1fb-e09628387749 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:54.251262 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:54.358952 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a604bf-2186-4bc3-af0f-397fa7416247 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:54.372219 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:54.385274 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235699d6-ecf6-4254-b1fb-e09628387749 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:54.397413 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e85b07-87e3-4f7d-993f-e99a17076195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:54.398314 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e85b07-87e3-4f7d-993f-e99a17076195 None admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:54.398693 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e85b07-87e3-4f7d-993f-e99a17076195 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:54.399052 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e85b07-87e3-4f7d-993f-e99a17076195 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:54.399839 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e85b07-87e3-4f7d-993f-e99a17076195 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:54.401373 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e85b07-87e3-4f7d-993f-e99a17076195 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:54.427499 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 375/730] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Oct 14 12:48:54 2022] POST /identity/v3/endpoints => generated 349 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 12:48:54.434995 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284aff9e-6079-4704-b8f4-dc0045eccdbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:54.435543 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284aff9e-6079-4704-b8f4-dc0045eccdbd None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:54.435796 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284aff9e-6079-4704-b8f4-dc0045eccdbd None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:54.436068 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284aff9e-6079-4704-b8f4-dc0045eccdbd None admin] PATH_INFO: `/v3/services` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:54.436708 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284aff9e-6079-4704-b8f4-dc0045eccdbd None admin] RBAC: Adding query filter params (name=image) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:54.437011 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284aff9e-6079-4704-b8f4-dc0045eccdbd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:54.438473 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284aff9e-6079-4704-b8f4-dc0045eccdbd None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:54.449021 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 356/731] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Oct 14 12:48:54 2022] GET /identity/v3/services?name=image => generated 122 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:54.455171 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e85b07-87e3-4f7d-993f-e99a17076195 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:54.530486 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:54.576895 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e85b07-87e3-4f7d-993f-e99a17076195 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:54.617278 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24773a2c-df2b-4698-b0ab-81d2d5ec1e83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:54.617913 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24773a2c-df2b-4698-b0ab-81d2d5ec1e83 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:54.618223 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24773a2c-df2b-4698-b0ab-81d2d5ec1e83 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:54.618615 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24773a2c-df2b-4698-b0ab-81d2d5ec1e83 None admin] PATH_INFO: `/v3/services` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:54.619279 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24773a2c-df2b-4698-b0ab-81d2d5ec1e83 None admin] RBAC: Adding query filter params (type=image) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:54.619583 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24773a2c-df2b-4698-b0ab-81d2d5ec1e83 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:54.621028 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24773a2c-df2b-4698-b0ab-81d2d5ec1e83 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:54.627324 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 376/732] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Oct 14 12:48:54 2022] GET /identity/v3/services?type=image => generated 122 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:55.946826 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983b81e8-866c-4c42-b27d-ce983c262f1a None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:55.947358 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983b81e8-866c-4c42-b27d-ce983c262f1a None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:55.947358 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983b81e8-866c-4c42-b27d-ce983c262f1a None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:55.948970 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 357/733] 10.222.0.17 () {54 vars in 927 bytes} [Fri Oct 14 12:48:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:48:55.955109 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac0904f-f704-4f70-865b-26179c727e70 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:55.955545 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac0904f-f704-4f70-865b-26179c727e70 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:55.955726 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac0904f-f704-4f70-865b-26179c727e70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:55.976293 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-9ac0904f-f704-4f70-865b-26179c727e70 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:48:55.978286 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-9ac0904f-f704-4f70-865b-26179c727e70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:48:56.044237 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaa39b0-6b9d-40e7-8d66-42dae3b9d3cd None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:56.044566 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaa39b0-6b9d-40e7-8d66-42dae3b9d3cd None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:56.044788 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaa39b0-6b9d-40e7-8d66-42dae3b9d3cd None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:56.046617 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 358/734] 10.222.0.17 () {54 vars in 927 bytes} [Fri Oct 14 12:48:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 14 12:48:56.051906 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf2e601-87c0-444a-8ed3-5cdc3f8c5422 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:56.052036 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 377/735] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Oct 14 12:48:55 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 14 12:48:56.052204 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf2e601-87c0-444a-8ed3-5cdc3f8c5422 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:56.052464 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf2e601-87c0-444a-8ed3-5cdc3f8c5422 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:56.072496 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-6cf2e601-87c0-444a-8ed3-5cdc3f8c5422 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:48:56.073692 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-6cf2e601-87c0-444a-8ed3-5cdc3f8c5422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:48:56.150662 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 359/736] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Oct 14 12:48:56 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 14 12:48:56.342639 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac0904f-f704-4f70-865b-26179c727e70 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:56.400600 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:56.425512 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf2e601-87c0-444a-8ed3-5cdc3f8c5422 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:56.450872 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac0904f-f704-4f70-865b-26179c727e70 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:56.490212 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd7f386-2de4-4f55-827d-29c869a6b657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:56.490928 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd7f386-2de4-4f55-827d-29c869a6b657 None admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:56.491215 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd7f386-2de4-4f55-827d-29c869a6b657 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:56.491489 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd7f386-2de4-4f55-827d-29c869a6b657 None admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:56.492151 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd7f386-2de4-4f55-827d-29c869a6b657 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:56.493790 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd7f386-2de4-4f55-827d-29c869a6b657 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:56.496669 dv-cinder-820994-7-smb devstack@keystone.service[81438]: WARNING keystone.server.flask.common [None req-6dd7f386-2de4-4f55-827d-29c869a6b657 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Oct 14 12:48:56.515609 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.sql.core [None req-6dd7f386-2de4-4f55-827d-29c869a6b657 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 14 12:48:56.515609 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 14 12:48:56.515609 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [parameters: {'id': 'eb206b96d92642158cbaaf2e02246ca2', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 14 12:48:56.515609 dv-cinder-820994-7-smb devstack@keystone.service[81438]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81438) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 14 12:48:56.519479 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:56.524731 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-6dd7f386-2de4-4f55-827d-29c869a6b657 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id eb206b96d92642158cbaaf2e02246ca2.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id eb206b96d92642158cbaaf2e02246ca2. Oct 14 12:48:56.524731 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:56.524731 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 14 12:48:56.524731 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 14 12:48:56.524731 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 14 12:48:56.524731 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 14 12:48:56.524731 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 14 12:48:56.524731 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application result = self._query(query) Oct 14 12:48:56.524731 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 14 12:48:56.524731 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application conn.query(q) Oct 14 12:48:56.524731 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 14 12:48:56.524731 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 14 12:48:56.524731 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 14 12:48:56.525543 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application result.read() Oct 14 12:48:56.525543 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 14 12:48:56.525543 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 14 12:48:56.525543 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 14 12:48:56.525543 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 14 12:48:56.525543 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 14 12:48:56.525543 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 14 12:48:56.525543 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 14 12:48:56.525543 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 14 12:48:56.525543 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 14 12:48:56.525543 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 14 12:48:56.525543 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 14 12:48:56.525543 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 14 12:48:56.525543 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:56.525543 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 14 12:48:56.525543 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 14 12:48:56.525543 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 14 12:48:56.525543 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 14 12:48:56.526627 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 14 12:48:56.526627 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application next(self.gen) Oct 14 12:48:56.526627 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 14 12:48:56.526627 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application yield resource Oct 14 12:48:56.526627 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 14 12:48:56.526627 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application next(self.gen) Oct 14 12:48:56.526627 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 14 12:48:56.526627 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application self.session.rollback() Oct 14 12:48:56.526627 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 14 12:48:56.526627 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application self.force_reraise() Oct 14 12:48:56.526627 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 14 12:48:56.526627 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise self.value Oct 14 12:48:56.526627 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 14 12:48:56.526627 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 14 12:48:56.526627 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 14 12:48:56.526627 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application session.commit() Oct 14 12:48:56.526627 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 14 12:48:56.527529 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 14 12:48:56.527529 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 14 12:48:56.527529 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application self._prepare_impl() Oct 14 12:48:56.527529 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 14 12:48:56.527529 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application self.session.flush() Oct 14 12:48:56.527529 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 14 12:48:56.527529 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application self._flush(objects) Oct 14 12:48:56.527529 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 14 12:48:56.527529 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 14 12:48:56.527529 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 14 12:48:56.527529 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application compat.raise_( Oct 14 12:48:56.527529 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 14 12:48:56.527529 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception Oct 14 12:48:56.527529 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 14 12:48:56.527529 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application flush_context.execute() Oct 14 12:48:56.527529 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 14 12:48:56.527529 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rec.execute(self) Oct 14 12:48:56.528442 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 14 12:48:56.528442 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 14 12:48:56.528442 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 14 12:48:56.528442 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 14 12:48:56.528442 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 14 12:48:56.528442 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 14 12:48:56.528442 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 14 12:48:56.528442 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 14 12:48:56.528442 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 14 12:48:56.528442 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 14 12:48:56.528442 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 14 12:48:56.528442 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 14 12:48:56.528442 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 14 12:48:56.528442 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 14 12:48:56.528442 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 14 12:48:56.529235 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 14 12:48:56.529235 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 14 12:48:56.529235 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception Oct 14 12:48:56.529235 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 14 12:48:56.529235 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 14 12:48:56.529235 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 14 12:48:56.529235 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 14 12:48:56.529235 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 14 12:48:56.529235 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application result = self._query(query) Oct 14 12:48:56.529235 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 14 12:48:56.529235 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application conn.query(q) Oct 14 12:48:56.529235 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 14 12:48:56.529235 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 14 12:48:56.529235 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 14 12:48:56.529235 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application result.read() Oct 14 12:48:56.529235 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 14 12:48:56.529235 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 14 12:48:56.530108 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 14 12:48:56.530108 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 14 12:48:56.530108 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 14 12:48:56.530108 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 14 12:48:56.530108 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 14 12:48:56.530108 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 14 12:48:56.530108 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 14 12:48:56.530108 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 14 12:48:56.530108 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [parameters: {'id': 'eb206b96d92642158cbaaf2e02246ca2', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 14 12:48:56.530108 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 14 12:48:56.530108 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 14 12:48:56.530108 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 14 12:48:56.530108 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 14 12:48:56.530108 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:56.530108 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 14 12:48:56.532273 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 14 12:48:56.532273 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 14 12:48:56.532273 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 14 12:48:56.532273 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Oct 14 12:48:56.532273 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 14 12:48:56.532273 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 14 12:48:56.532273 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 14 12:48:56.532273 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:56.532273 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:48:56.532273 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:48:56.532273 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:48:56.532273 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:48:56.532273 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:48:56.532273 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:48:56.532273 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:48:56.532273 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:48:56.532273 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:48:56.533521 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:48:56.533521 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Oct 14 12:48:56.533521 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Oct 14 12:48:56.533521 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:48:56.533521 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:48:56.533521 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 14 12:48:56.533521 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 14 12:48:56.533521 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id eb206b96d92642158cbaaf2e02246ca2. Oct 14 12:48:56.533521 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 14 12:48:56.533521 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 378/737] 10.222.0.17 () {60 vars in 1140 bytes} [Fri Oct 14 12:48:56 2022] POST /identity/v3/projects => generated 262 bytes in 185 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:48:56.533521 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd7f386-2de4-4f55-827d-29c869a6b657 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:56.545182 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf2e601-87c0-444a-8ed3-5cdc3f8c5422 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:56.586639 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe149ce-ea0d-4c5a-8226-cc521ce1e9d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:56.587358 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe149ce-ea0d-4c5a-8226-cc521ce1e9d6 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:56.587731 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe149ce-ea0d-4c5a-8226-cc521ce1e9d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:56.588007 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe149ce-ea0d-4c5a-8226-cc521ce1e9d6 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:56.589044 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe149ce-ea0d-4c5a-8226-cc521ce1e9d6 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:56.591001 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe149ce-ea0d-4c5a-8226-cc521ce1e9d6 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:56.606988 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-6fe149ce-ea0d-4c5a-8226-cc521ce1e9d6 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 14 12:48:56.606988 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:56.606988 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 14 12:48:56.606988 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 14 12:48:56.606988 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 14 12:48:56.606988 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 14 12:48:56.606988 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 14 12:48:56.606988 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 12:48:56.606988 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 14 12:48:56.606988 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 14 12:48:56.606988 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 14 12:48:56.606988 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 14 12:48:56.606988 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:56.606988 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:48:56.606988 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:48:56.606988 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:48:56.606988 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:48:56.608008 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:48:56.608008 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:48:56.608008 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:48:56.608008 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:48:56.608008 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:48:56.608008 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:48:56.608008 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 14 12:48:56.608008 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 14 12:48:56.608008 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 14 12:48:56.608008 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 14 12:48:56.608008 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:48:56.608008 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:48:56.608008 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:48:56.608008 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:48:56.608008 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:48:56.608008 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:48:56.609117 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:48:56.609117 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 14 12:48:56.609117 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:48:56.609117 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:48:56.609117 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:48:56.609117 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:48:56.609117 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:48:56.609117 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:48:56.609117 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:48:56.609117 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:48:56.609117 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 14 12:48:56.609117 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 12:48:56.609117 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 14 12:48:56.609117 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 14 12:48:56.613038 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 360/738] 10.222.0.17 () {56 vars in 1111 bytes} [Fri Oct 14 12:48:56 2022] GET /identity/v3/services/compute => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 14 12:48:56.619371 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe149ce-ea0d-4c5a-8226-cc521ce1e9d6 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:56.690053 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd7f386-2de4-4f55-827d-29c869a6b657 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:56.703996 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:56.737534 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67707e71-d6c5-40c8-9867-275da932e2ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:56.738635 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67707e71-d6c5-40c8-9867-275da932e2ba None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:56.739130 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67707e71-d6c5-40c8-9867-275da932e2ba None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:56.739696 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67707e71-d6c5-40c8-9867-275da932e2ba None admin] PATH_INFO: `/v3/projects/service` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:56.747446 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67707e71-d6c5-40c8-9867-275da932e2ba None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:56.749544 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67707e71-d6c5-40c8-9867-275da932e2ba None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:56.754878 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe149ce-ea0d-4c5a-8226-cc521ce1e9d6 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:56.763607 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-67707e71-d6c5-40c8-9867-275da932e2ba None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 12:48:56.763607 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:56.763607 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:48:56.763607 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:48:56.763607 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:48:56.763607 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:48:56.763607 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:48:56.763607 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:48:56.763607 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:48:56.763607 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:48:56.763607 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:48:56.763607 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:48:56.763607 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 14 12:48:56.763607 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 14 12:48:56.763607 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 14 12:48:56.764564 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 14 12:48:56.764564 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:48:56.764564 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:48:56.764564 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:48:56.764564 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:48:56.764564 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:48:56.764564 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:48:56.764564 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:48:56.764564 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 14 12:48:56.764564 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:48:56.764564 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:48:56.764564 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:48:56.764564 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:48:56.764564 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:48:56.764564 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:48:56.764564 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:48:56.764564 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:48:56.765493 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 14 12:48:56.765493 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 14 12:48:56.765493 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 14 12:48:56.765493 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 14 12:48:56.765493 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 14 12:48:56.765493 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 14 12:48:56.765493 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 12:48:56.765493 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 14 12:48:56.772554 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 379/739] 10.222.0.17 () {56 vars in 1111 bytes} [Fri Oct 14 12:48:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:48:56.773754 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67707e71-d6c5-40c8-9867-275da932e2ba None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:56.795185 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670389ea-2311-4e4e-90ed-8ace0573d38a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:56.795805 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670389ea-2311-4e4e-90ed-8ace0573d38a None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:56.796087 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670389ea-2311-4e4e-90ed-8ace0573d38a None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:56.796360 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670389ea-2311-4e4e-90ed-8ace0573d38a None admin] PATH_INFO: `/v3/services` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:56.797003 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670389ea-2311-4e4e-90ed-8ace0573d38a None admin] RBAC: Adding query filter params (name=compute) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:56.797347 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670389ea-2311-4e4e-90ed-8ace0573d38a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:56.800810 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670389ea-2311-4e4e-90ed-8ace0573d38a None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:56.813482 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 361/740] 10.222.0.17 () {56 vars in 1112 bytes} [Fri Oct 14 12:48:56 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:56.813482 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9ab621-7e56-4e19-a862-a064dc2ef5e5 None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:56.813482 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9ab621-7e56-4e19-a862-a064dc2ef5e5 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:56.813482 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9ab621-7e56-4e19-a862-a064dc2ef5e5 None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:56.815295 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 362/741] 10.222.0.17 () {54 vars in 927 bytes} [Fri Oct 14 12:48:56 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:48:56.817460 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9ab621-7e56-4e19-a862-a064dc2ef5e5 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:56.831426 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:56.912054 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67707e71-d6c5-40c8-9867-275da932e2ba None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:56.947561 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9ab621-7e56-4e19-a862-a064dc2ef5e5 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:56.952312 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8225e30-222f-4365-81ad-ac5e2f5c1643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:56.952935 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8225e30-222f-4365-81ad-ac5e2f5c1643 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:56.953530 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8225e30-222f-4365-81ad-ac5e2f5c1643 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:56.953806 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8225e30-222f-4365-81ad-ac5e2f5c1643 None admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:56.954541 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8225e30-222f-4365-81ad-ac5e2f5c1643 None admin] RBAC: Adding query filter params (name=service) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:56.955862 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8225e30-222f-4365-81ad-ac5e2f5c1643 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:56.957359 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8225e30-222f-4365-81ad-ac5e2f5c1643 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:56.980223 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 380/742] 10.222.0.17 () {56 vars in 1112 bytes} [Fri Oct 14 12:48:56 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:56.981553 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148689e6-1de0-4217-8f4f-3e580c3b884d None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:56.981841 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148689e6-1de0-4217-8f4f-3e580c3b884d None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:56.982139 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148689e6-1de0-4217-8f4f-3e580c3b884d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:56.995576 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f8fbdb-60fd-45b4-bd88-77a928df15dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:56.996271 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f8fbdb-60fd-45b4-bd88-77a928df15dc None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:56.996555 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f8fbdb-60fd-45b4-bd88-77a928df15dc None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:56.996829 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f8fbdb-60fd-45b4-bd88-77a928df15dc None admin] PATH_INFO: `/v3/services` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:56.997499 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f8fbdb-60fd-45b4-bd88-77a928df15dc None admin] RBAC: Adding query filter params (type=compute) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:56.997863 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f8fbdb-60fd-45b4-bd88-77a928df15dc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:56.999389 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f8fbdb-60fd-45b4-bd88-77a928df15dc None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:57.004508 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-148689e6-1de0-4217-8f4f-3e580c3b884d None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:48:57.014306 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 363/743] 10.222.0.17 () {56 vars in 1112 bytes} [Fri Oct 14 12:48:56 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:57.014535 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-148689e6-1de0-4217-8f4f-3e580c3b884d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:48:57.014652 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3591192-7676-4bf5-aeff-21c64b7bc92c None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:57.014652 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3591192-7676-4bf5-aeff-21c64b7bc92c None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:57.014652 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3591192-7676-4bf5-aeff-21c64b7bc92c None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:57.014652 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 364/744] 10.222.0.17 () {54 vars in 927 bytes} [Fri Oct 14 12:48:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:48:57.014652 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3591192-7676-4bf5-aeff-21c64b7bc92c None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:57.036551 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:57.107786 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 381/745] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Oct 14 12:48:56 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 14 12:48:57.115755 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86a57d4-cae6-4db0-87ab-b3a1aa9526f6 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:57.116039 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86a57d4-cae6-4db0-87ab-b3a1aa9526f6 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:57.116315 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86a57d4-cae6-4db0-87ab-b3a1aa9526f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:57.129825 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:57.150709 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-e86a57d4-cae6-4db0-87ab-b3a1aa9526f6 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:48:57.152907 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-e86a57d4-cae6-4db0-87ab-b3a1aa9526f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:48:57.164367 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3591192-7676-4bf5-aeff-21c64b7bc92c None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:57.217603 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd20ce6-2fc0-40ab-a1d1-10121d75a4a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:57.218571 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd20ce6-2fc0-40ab-a1d1-10121d75a4a8 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:57.218852 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd20ce6-2fc0-40ab-a1d1-10121d75a4a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:57.219123 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd20ce6-2fc0-40ab-a1d1-10121d75a4a8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:57.219836 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd20ce6-2fc0-40ab-a1d1-10121d75a4a8 None admin] RBAC: Adding query filter params (interface=public, service_id=6e128c0ae895493ab5b6ef626403d955, region_id=RegionOne) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:57.220743 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd20ce6-2fc0-40ab-a1d1-10121d75a4a8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:57.222179 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd20ce6-2fc0-40ab-a1d1-10121d75a4a8 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:57.228135 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 365/746] 10.222.0.17 () {56 vars in 1251 bytes} [Fri Oct 14 12:48:57 2022] GET /identity/v3/endpoints?service_id=6e128c0ae895493ab5b6ef626403d955&interface=public®ion_id=RegionOne => generated 194 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:57.234449 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd20ce6-2fc0-40ab-a1d1-10121d75a4a8 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:57.251704 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 382/747] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Oct 14 12:48:57 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 14 12:48:57.346400 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd20ce6-2fc0-40ab-a1d1-10121d75a4a8 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:57.383457 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86a57d4-cae6-4db0-87ab-b3a1aa9526f6 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:57.384437 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1e024e-dfd1-4209-8c0f-bd6ea41b6aeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:57.385275 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1e024e-dfd1-4209-8c0f-bd6ea41b6aeb None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:57.385781 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1e024e-dfd1-4209-8c0f-bd6ea41b6aeb None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:57.386283 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1e024e-dfd1-4209-8c0f-bd6ea41b6aeb None admin] PATH_INFO: `/v3/services` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:57.387092 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1e024e-dfd1-4209-8c0f-bd6ea41b6aeb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:57.388634 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1e024e-dfd1-4209-8c0f-bd6ea41b6aeb None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:57.398166 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 366/748] 10.222.0.17 () {56 vars in 1087 bytes} [Fri Oct 14 12:48:57 2022] GET /identity/v3/services => generated 1727 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 12:48:57.499059 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:57.509971 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86a57d4-cae6-4db0-87ab-b3a1aa9526f6 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:57.541412 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1e024e-dfd1-4209-8c0f-bd6ea41b6aeb None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:57.544697 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:57.555943 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf2e0f9-47a7-4e36-9844-528e6086b55c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:57.557562 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf2e0f9-47a7-4e36-9844-528e6086b55c None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:57.558561 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf2e0f9-47a7-4e36-9844-528e6086b55c None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:57.559052 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf2e0f9-47a7-4e36-9844-528e6086b55c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:57.560152 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf2e0f9-47a7-4e36-9844-528e6086b55c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:57.562702 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf2e0f9-47a7-4e36-9844-528e6086b55c None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:57.576531 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-ccf2e0f9-47a7-4e36-9844-528e6086b55c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 14 12:48:57.576531 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:57.576531 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 14 12:48:57.576531 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 14 12:48:57.576531 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 14 12:48:57.576531 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 14 12:48:57.576531 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 14 12:48:57.576531 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 12:48:57.576531 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 14 12:48:57.576531 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 14 12:48:57.576531 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 14 12:48:57.576531 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 14 12:48:57.576531 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:57.576531 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:48:57.576531 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:48:57.576531 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:48:57.576531 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:48:57.577609 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:48:57.577609 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:48:57.577609 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:48:57.577609 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:48:57.577609 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:48:57.577609 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:48:57.577609 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 14 12:48:57.577609 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 14 12:48:57.577609 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 14 12:48:57.577609 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 14 12:48:57.577609 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:48:57.577609 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:48:57.577609 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:48:57.577609 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:48:57.577609 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:48:57.577609 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:48:57.578559 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:48:57.578559 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 14 12:48:57.578559 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:48:57.578559 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:48:57.578559 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:48:57.578559 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:48:57.578559 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:48:57.578559 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:48:57.578559 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:48:57.578559 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:48:57.578559 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 14 12:48:57.578559 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 12:48:57.578559 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 14 12:48:57.578559 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 14 12:48:57.582480 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 383/749] 10.222.0.17 () {56 vars in 1126 bytes} [Fri Oct 14 12:48:57 2022] GET /identity/v3/services/object-store => generated 93 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 14 12:48:57.586900 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf2e0f9-47a7-4e36-9844-528e6086b55c None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:57.670363 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1e024e-dfd1-4209-8c0f-bd6ea41b6aeb None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:57.713729 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d89e597-0f80-455c-bb45-89f2d2ecde75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:57.714393 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d89e597-0f80-455c-bb45-89f2d2ecde75 None admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:57.714682 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d89e597-0f80-455c-bb45-89f2d2ecde75 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:57.714956 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d89e597-0f80-455c-bb45-89f2d2ecde75 None admin] PATH_INFO: `/v3/services` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:57.715661 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d89e597-0f80-455c-bb45-89f2d2ecde75 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:57.717007 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d89e597-0f80-455c-bb45-89f2d2ecde75 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:57.724431 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf2e0f9-47a7-4e36-9844-528e6086b55c None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:57.742158 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 367/750] 10.222.0.17 () {60 vars in 1141 bytes} [Fri Oct 14 12:48:57 2022] POST /identity/v3/services => generated 242 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 12:48:57.789003 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e56dbb-1897-48d8-9e52-d3431ae13b60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:57.789543 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e56dbb-1897-48d8-9e52-d3431ae13b60 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:57.789829 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e56dbb-1897-48d8-9e52-d3431ae13b60 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:57.790102 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e56dbb-1897-48d8-9e52-d3431ae13b60 None admin] PATH_INFO: `/v3/services` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:57.790766 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e56dbb-1897-48d8-9e52-d3431ae13b60 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:57.791072 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e56dbb-1897-48d8-9e52-d3431ae13b60 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:57.792702 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e56dbb-1897-48d8-9e52-d3431ae13b60 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:57.799644 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 384/751] 10.222.0.17 () {56 vars in 1122 bytes} [Fri Oct 14 12:48:57 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:57.805271 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d89e597-0f80-455c-bb45-89f2d2ecde75 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:57.889266 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:57.939653 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d89e597-0f80-455c-bb45-89f2d2ecde75 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:57.976598 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aae963c-fa54-4d92-9ef1-a64b87e637ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:57.977244 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aae963c-fa54-4d92-9ef1-a64b87e637ea None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:57.977479 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aae963c-fa54-4d92-9ef1-a64b87e637ea None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:57.977733 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aae963c-fa54-4d92-9ef1-a64b87e637ea None admin] PATH_INFO: `/v3/services` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:57.978392 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aae963c-fa54-4d92-9ef1-a64b87e637ea None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:57.978692 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aae963c-fa54-4d92-9ef1-a64b87e637ea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:57.980064 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aae963c-fa54-4d92-9ef1-a64b87e637ea None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:57.986968 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 368/752] 10.222.0.17 () {56 vars in 1122 bytes} [Fri Oct 14 12:48:57 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:57.992132 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e56dbb-1897-48d8-9e52-d3431ae13b60 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:58.009675 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:58.115954 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e56dbb-1897-48d8-9e52-d3431ae13b60 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:58.153112 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f421f5-998b-47ed-a876-cd9bc18f48f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:58.153730 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f421f5-998b-47ed-a876-cd9bc18f48f9 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:58.154008 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f421f5-998b-47ed-a876-cd9bc18f48f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:58.154318 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f421f5-998b-47ed-a876-cd9bc18f48f9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:58.155027 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f421f5-998b-47ed-a876-cd9bc18f48f9 None admin] RBAC: Adding query filter params (interface=admin, service_id=f5226a523a0f4b77ba77c35514cc055e, region_id=RegionOne) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:48:58.155338 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f421f5-998b-47ed-a876-cd9bc18f48f9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:58.156741 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f421f5-998b-47ed-a876-cd9bc18f48f9 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:58.163622 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 385/753] 10.222.0.17 () {56 vars in 1249 bytes} [Fri Oct 14 12:48:57 2022] GET /identity/v3/endpoints?service_id=f5226a523a0f4b77ba77c35514cc055e&interface=admin®ion_id=RegionOne => generated 193 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:48:58.169064 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aae963c-fa54-4d92-9ef1-a64b87e637ea None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:58.280444 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aae963c-fa54-4d92-9ef1-a64b87e637ea None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:58.308832 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:58.326814 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20201213-f937-44ba-8bd7-0dc9f1f11ab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:58.327809 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20201213-f937-44ba-8bd7-0dc9f1f11ab1 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:58.328294 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20201213-f937-44ba-8bd7-0dc9f1f11ab1 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:58.328794 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20201213-f937-44ba-8bd7-0dc9f1f11ab1 None admin] PATH_INFO: `/v3/services` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:58.330223 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20201213-f937-44ba-8bd7-0dc9f1f11ab1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:58.331827 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20201213-f937-44ba-8bd7-0dc9f1f11ab1 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:58.341066 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 369/754] 10.222.0.17 () {56 vars in 1087 bytes} [Fri Oct 14 12:48:58 2022] GET /identity/v3/services => generated 1957 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 12:48:59.405977 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b0f7b7-fa2b-49a9-9115-6d1d5990844e None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:59.406554 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b0f7b7-fa2b-49a9-9115-6d1d5990844e None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:59.406554 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b0f7b7-fa2b-49a9-9115-6d1d5990844e None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:59.408185 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 386/755] 10.222.0.17 () {54 vars in 927 bytes} [Fri Oct 14 12:48:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:48:59.413824 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a602515-b22a-4739-a68d-b83f62e520b3 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:59.414296 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a602515-b22a-4739-a68d-b83f62e520b3 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:59.414388 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a602515-b22a-4739-a68d-b83f62e520b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:59.432711 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-2a602515-b22a-4739-a68d-b83f62e520b3 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:48:59.433910 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-2a602515-b22a-4739-a68d-b83f62e520b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:48:59.504527 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 370/756] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Oct 14 12:48:59 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 14 12:48:59.760225 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97a02ee-0085-4894-a87d-34f5517f1b2c None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:59.760904 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97a02ee-0085-4894-a87d-34f5517f1b2c None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:59.761401 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97a02ee-0085-4894-a87d-34f5517f1b2c None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:59.763234 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 387/757] 10.222.0.17 () {54 vars in 927 bytes} [Fri Oct 14 12:48:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:48:59.768616 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964c074c-5b16-4e77-bbb9-b4f2eb9667b4 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:59.768904 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964c074c-5b16-4e77-bbb9-b4f2eb9667b4 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:59.769180 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964c074c-5b16-4e77-bbb9-b4f2eb9667b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:59.773867 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97a02ee-0085-4894-a87d-34f5517f1b2c None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:48:59.791187 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-964c074c-5b16-4e77-bbb9-b4f2eb9667b4 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:48:59.792908 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-964c074c-5b16-4e77-bbb9-b4f2eb9667b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:48:59.867009 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:48:59.881218 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 371/758] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Oct 14 12:48:59 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 14 12:48:59.892507 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97a02ee-0085-4894-a87d-34f5517f1b2c None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:48:59.932507 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f10fbda-7451-49d4-b82d-3a21332d1ea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:48:59.933123 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f10fbda-7451-49d4-b82d-3a21332d1ea0 None admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:48:59.933397 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f10fbda-7451-49d4-b82d-3a21332d1ea0 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:48:59.933664 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f10fbda-7451-49d4-b82d-3a21332d1ea0 None admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:48:59.934354 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f10fbda-7451-49d4-b82d-3a21332d1ea0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:48:59.935839 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f10fbda-7451-49d4-b82d-3a21332d1ea0 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:48:59.953146 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.sql.core [None req-3f10fbda-7451-49d4-b82d-3a21332d1ea0 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 14 12:48:59.953146 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 14 12:48:59.953146 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [parameters: {'user_id': 'd84a6e6932864d56910c4e3a7614a994', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 14 12:48:59.953146 dv-cinder-820994-7-smb devstack@keystone.service[81438]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81438) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 14 12:48:59.961348 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-3f10fbda-7451-49d4-b82d-3a21332d1ea0 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 14 12:48:59.961348 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:59.961348 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 14 12:48:59.961348 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 14 12:48:59.961348 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 14 12:48:59.961348 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 14 12:48:59.961348 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 14 12:48:59.961348 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application result = self._query(query) Oct 14 12:48:59.961348 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 14 12:48:59.961348 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application conn.query(q) Oct 14 12:48:59.961348 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 14 12:48:59.961348 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 14 12:48:59.961348 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 14 12:48:59.961348 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application result.read() Oct 14 12:48:59.961348 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 14 12:48:59.962338 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 14 12:48:59.962338 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 14 12:48:59.962338 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 14 12:48:59.962338 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 14 12:48:59.962338 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 14 12:48:59.962338 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 14 12:48:59.962338 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 14 12:48:59.962338 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 14 12:48:59.962338 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 14 12:48:59.962338 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 14 12:48:59.962338 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 14 12:48:59.962338 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:59.962338 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 14 12:48:59.962338 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 14 12:48:59.962338 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Oct 14 12:48:59.962338 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Oct 14 12:48:59.962338 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 14 12:48:59.962338 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application next(self.gen) Oct 14 12:48:59.963345 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 14 12:48:59.963345 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application yield resource Oct 14 12:48:59.963345 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 14 12:48:59.963345 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application next(self.gen) Oct 14 12:48:59.963345 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 14 12:48:59.963345 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application self.session.rollback() Oct 14 12:48:59.963345 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 14 12:48:59.963345 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application self.force_reraise() Oct 14 12:48:59.963345 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 14 12:48:59.963345 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise self.value Oct 14 12:48:59.963345 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 14 12:48:59.963345 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 14 12:48:59.963345 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 14 12:48:59.963345 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application session.commit() Oct 14 12:48:59.963345 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 14 12:48:59.963345 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 14 12:48:59.963345 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 14 12:48:59.964237 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application self._prepare_impl() Oct 14 12:48:59.964237 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 14 12:48:59.964237 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application self.session.flush() Oct 14 12:48:59.964237 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 14 12:48:59.964237 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application self._flush(objects) Oct 14 12:48:59.964237 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 14 12:48:59.964237 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 14 12:48:59.964237 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 14 12:48:59.964237 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application compat.raise_( Oct 14 12:48:59.964237 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 14 12:48:59.964237 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception Oct 14 12:48:59.964237 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 14 12:48:59.964237 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application flush_context.execute() Oct 14 12:48:59.964237 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 14 12:48:59.964237 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rec.execute(self) Oct 14 12:48:59.964237 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 14 12:48:59.964237 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 14 12:48:59.965139 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 14 12:48:59.965139 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 14 12:48:59.965139 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 14 12:48:59.965139 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application result = connection._execute_20( Oct 14 12:48:59.965139 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 14 12:48:59.965139 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 14 12:48:59.965139 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 14 12:48:59.965139 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 14 12:48:59.965139 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 14 12:48:59.965139 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 14 12:48:59.965139 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 14 12:48:59.965139 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 14 12:48:59.965139 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 14 12:48:59.965139 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 14 12:48:59.965139 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 14 12:48:59.965139 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception Oct 14 12:48:59.965992 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 14 12:48:59.965992 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 14 12:48:59.965992 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 14 12:48:59.965992 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 14 12:48:59.965992 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 14 12:48:59.965992 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application result = self._query(query) Oct 14 12:48:59.965992 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 14 12:48:59.965992 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application conn.query(q) Oct 14 12:48:59.965992 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 14 12:48:59.965992 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 14 12:48:59.965992 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 14 12:48:59.965992 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application result.read() Oct 14 12:48:59.965992 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 14 12:48:59.965992 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 14 12:48:59.965992 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 14 12:48:59.965992 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 14 12:48:59.966834 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 14 12:48:59.966834 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 14 12:48:59.966834 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 14 12:48:59.966834 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 14 12:48:59.966834 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 14 12:48:59.966834 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 14 12:48:59.966834 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [parameters: {'user_id': 'd84a6e6932864d56910c4e3a7614a994', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 14 12:48:59.966834 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 14 12:48:59.966834 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 14 12:48:59.966834 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 14 12:48:59.966834 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 14 12:48:59.966834 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:48:59.966834 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:48:59.966834 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:48:59.966834 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:48:59.967641 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:48:59.967641 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:48:59.967641 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:48:59.967641 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:48:59.967641 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:48:59.967641 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:48:59.967641 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:48:59.967641 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Oct 14 12:48:59.967641 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Oct 14 12:48:59.967641 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:48:59.967641 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:48:59.967641 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 14 12:48:59.967641 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 12:48:59.967641 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 14 12:48:59.967641 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 12:48:59.967641 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Oct 14 12:48:59.967641 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Oct 14 12:48:59.968627 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Oct 14 12:48:59.968627 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Oct 14 12:48:59.968627 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 14 12:48:59.968627 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 14 12:48:59.968627 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 14 12:48:59.968627 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 14 12:48:59.968627 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 388/759] 10.222.0.17 () {60 vars in 1131 bytes} [Fri Oct 14 12:48:59 2022] POST /identity/v3/users => generated 160 bytes in 189 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Oct 14 12:48:59.975041 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964c074c-5b16-4e77-bbb9-b4f2eb9667b4 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:49:00.028008 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:49:00.063394 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c768ac-8a48-4446-8e09-90e581511b52 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:49:00.064009 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c768ac-8a48-4446-8e09-90e581511b52 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:49:00.064539 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c768ac-8a48-4446-8e09-90e581511b52 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:49:00.073435 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 389/760] 10.222.0.17 () {54 vars in 927 bytes} [Fri Oct 14 12:49:00 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:49:00.075288 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d428ba5a-03a8-4348-ae6a-af0f267ff997 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:49:00.075806 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d428ba5a-03a8-4348-ae6a-af0f267ff997 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:49:00.076401 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d428ba5a-03a8-4348-ae6a-af0f267ff997 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:49:00.092361 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964c074c-5b16-4e77-bbb9-b4f2eb9667b4 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:49:00.097865 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-d428ba5a-03a8-4348-ae6a-af0f267ff997 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:49:00.100467 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-d428ba5a-03a8-4348-ae6a-af0f267ff997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:49:00.180978 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 390/761] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Oct 14 12:49:00 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 14 12:49:00.181862 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d428ba5a-03a8-4348-ae6a-af0f267ff997 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:49:00.262045 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:49:00.262977 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5cb013-ccc6-4930-836b-7dd426e17da9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:49:00.263616 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5cb013-ccc6-4930-836b-7dd426e17da9 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:49:00.263897 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5cb013-ccc6-4930-836b-7dd426e17da9 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:49:00.264168 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5cb013-ccc6-4930-836b-7dd426e17da9 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:49:00.279170 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5cb013-ccc6-4930-836b-7dd426e17da9 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:49:00.281737 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5cb013-ccc6-4930-836b-7dd426e17da9 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:49:00.299364 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-bd5cb013-ccc6-4930-836b-7dd426e17da9 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 14 12:49:00.299364 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:49:00.299364 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:49:00.299364 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:49:00.299364 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:49:00.299364 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:49:00.299364 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:49:00.299364 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:49:00.299364 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:49:00.299364 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:49:00.299364 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:49:00.299364 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:49:00.299364 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 14 12:49:00.299364 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 14 12:49:00.299364 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 14 12:49:00.299364 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 14 12:49:00.300346 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:49:00.300346 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:49:00.300346 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 14 12:49:00.300346 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 12:49:00.300346 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 14 12:49:00.300346 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 12:49:00.300346 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:49:00.300346 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:49:00.300346 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:49:00.300346 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:49:00.300346 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:49:00.300346 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 14 12:49:00.300346 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:49:00.300346 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:49:00.300346 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:49:00.300346 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:49:00.300346 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:49:00.300346 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:49:00.301340 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:49:00.301340 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:49:00.301340 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 14 12:49:00.301340 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 14 12:49:00.301340 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 14 12:49:00.301340 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 14 12:49:00.301340 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 14 12:49:00.301340 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 14 12:49:00.301340 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 14 12:49:00.301340 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 14 12:49:00.304134 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 372/762] 10.222.0.17 () {56 vars in 1099 bytes} [Fri Oct 14 12:48:59 2022] GET /identity/v3/users/cinder => generated 84 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:49:00.309897 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d428ba5a-03a8-4348-ae6a-af0f267ff997 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:49:00.310054 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5cb013-ccc6-4930-836b-7dd426e17da9 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:49:00.345799 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995bef28-d852-490c-b5ab-17d0dc2756a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:49:00.347189 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995bef28-d852-490c-b5ab-17d0dc2756a0 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:49:00.347717 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995bef28-d852-490c-b5ab-17d0dc2756a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:49:00.348144 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995bef28-d852-490c-b5ab-17d0dc2756a0 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:49:00.348984 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995bef28-d852-490c-b5ab-17d0dc2756a0 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:49:00.350811 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995bef28-d852-490c-b5ab-17d0dc2756a0 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:49:00.361940 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-995bef28-d852-490c-b5ab-17d0dc2756a0 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 14 12:49:00.361940 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:49:00.361940 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 14 12:49:00.361940 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 14 12:49:00.361940 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 14 12:49:00.361940 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 14 12:49:00.361940 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 14 12:49:00.361940 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 12:49:00.361940 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 14 12:49:00.361940 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 14 12:49:00.361940 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 14 12:49:00.361940 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 14 12:49:00.361940 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:49:00.361940 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:49:00.361940 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:49:00.361940 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:49:00.361940 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:49:00.363313 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:49:00.363313 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:49:00.363313 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:49:00.363313 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:49:00.363313 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:49:00.363313 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:49:00.363313 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 14 12:49:00.363313 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 14 12:49:00.363313 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 14 12:49:00.363313 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 14 12:49:00.363313 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:49:00.363313 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:49:00.363313 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:49:00.363313 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:49:00.363313 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:49:00.363313 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:49:00.364393 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:49:00.364393 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 14 12:49:00.364393 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:49:00.364393 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:49:00.364393 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:49:00.364393 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:49:00.364393 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:49:00.364393 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:49:00.364393 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:49:00.364393 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:49:00.364393 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 14 12:49:00.364393 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 12:49:00.364393 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 14 12:49:00.364393 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 14 12:49:00.367152 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 391/763] 10.222.0.17 () {56 vars in 1111 bytes} [Fri Oct 14 12:49:00 2022] GET /identity/v3/services/compute => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:49:00.378791 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995bef28-d852-490c-b5ab-17d0dc2756a0 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:49:00.420248 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5cb013-ccc6-4930-836b-7dd426e17da9 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:49:00.432110 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:49:00.461751 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fa02fb-0881-4d06-bf82-94695d8694c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:49:00.461992 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fa02fb-0881-4d06-bf82-94695d8694c5 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:49:00.466147 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fa02fb-0881-4d06-bf82-94695d8694c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:49:00.466147 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fa02fb-0881-4d06-bf82-94695d8694c5 None admin] PATH_INFO: `/v3/users` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:49:00.466147 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fa02fb-0881-4d06-bf82-94695d8694c5 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:49:00.466147 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fa02fb-0881-4d06-bf82-94695d8694c5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:49:00.466147 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fa02fb-0881-4d06-bf82-94695d8694c5 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:49:00.497677 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995bef28-d852-490c-b5ab-17d0dc2756a0 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:49:00.519870 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 373/764] 10.222.0.17 () {56 vars in 1101 bytes} [Fri Oct 14 12:49:00 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 12:49:00.521099 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fa02fb-0881-4d06-bf82-94695d8694c5 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:49:00.549459 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25ab3f3-2dc6-453f-86e2-2fc0c8e64eb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:49:00.549985 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25ab3f3-2dc6-453f-86e2-2fc0c8e64eb1 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:49:00.550299 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25ab3f3-2dc6-453f-86e2-2fc0c8e64eb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:49:00.550575 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25ab3f3-2dc6-453f-86e2-2fc0c8e64eb1 None admin] PATH_INFO: `/v3/services` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:49:00.551250 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25ab3f3-2dc6-453f-86e2-2fc0c8e64eb1 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:49:00.551559 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25ab3f3-2dc6-453f-86e2-2fc0c8e64eb1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:49:00.553230 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25ab3f3-2dc6-453f-86e2-2fc0c8e64eb1 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:49:00.555069 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:49:00.566612 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 392/765] 10.222.0.17 () {56 vars in 1112 bytes} [Fri Oct 14 12:49:00 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 12:49:00.567729 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25ab3f3-2dc6-453f-86e2-2fc0c8e64eb1 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:49:00.661184 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fa02fb-0881-4d06-bf82-94695d8694c5 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:49:00.696195 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25ab3f3-2dc6-453f-86e2-2fc0c8e64eb1 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:49:00.702034 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89cdc02-a4f3-4cd2-83e9-5b5705145190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:49:00.702713 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89cdc02-a4f3-4cd2-83e9-5b5705145190 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:49:00.703046 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89cdc02-a4f3-4cd2-83e9-5b5705145190 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:49:00.703511 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89cdc02-a4f3-4cd2-83e9-5b5705145190 None admin] PATH_INFO: `/v3/services/image` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:49:00.704609 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89cdc02-a4f3-4cd2-83e9-5b5705145190 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:49:00.706720 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89cdc02-a4f3-4cd2-83e9-5b5705145190 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:49:00.717385 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-c89cdc02-a4f3-4cd2-83e9-5b5705145190 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 14 12:49:00.717385 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:49:00.717385 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 14 12:49:00.717385 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 14 12:49:00.717385 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 14 12:49:00.717385 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 14 12:49:00.717385 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 14 12:49:00.717385 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 12:49:00.717385 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 14 12:49:00.717385 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 14 12:49:00.717385 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 14 12:49:00.717385 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 14 12:49:00.717385 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:49:00.717385 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:49:00.717385 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:49:00.717385 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:49:00.717385 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:49:00.718521 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:49:00.718521 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:49:00.718521 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:49:00.718521 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:49:00.718521 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:49:00.718521 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:49:00.718521 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 14 12:49:00.718521 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 14 12:49:00.718521 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 14 12:49:00.718521 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 14 12:49:00.718521 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:49:00.718521 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:49:00.718521 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:49:00.718521 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:49:00.718521 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:49:00.718521 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:49:00.719718 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:49:00.719718 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 14 12:49:00.719718 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:49:00.719718 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:49:00.719718 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:49:00.719718 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:49:00.719718 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:49:00.719718 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:49:00.719718 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:49:00.719718 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:49:00.719718 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 14 12:49:00.719718 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 12:49:00.719718 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 14 12:49:00.719718 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 14 12:49:00.719718 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 374/766] 10.222.0.17 () {56 vars in 1105 bytes} [Fri Oct 14 12:49:00 2022] GET /identity/v3/services/image => generated 86 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:49:00.721423 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f42ae8-d6c2-490f-aa24-9424c3fe7209 None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:49:00.721423 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f42ae8-d6c2-490f-aa24-9424c3fe7209 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:49:00.721423 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f42ae8-d6c2-490f-aa24-9424c3fe7209 None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:49:00.722790 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 375/767] 10.222.0.17 () {54 vars in 927 bytes} [Fri Oct 14 12:49:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:49:00.728834 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445af215-baf3-435e-a1ef-305df10c6c6d None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:49:00.729125 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445af215-baf3-435e-a1ef-305df10c6c6d None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:49:00.729396 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445af215-baf3-435e-a1ef-305df10c6c6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:49:00.744083 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a27549b-007c-41b2-b077-416f388a4035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:49:00.745006 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a27549b-007c-41b2-b077-416f388a4035 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:49:00.745477 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a27549b-007c-41b2-b077-416f388a4035 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:49:00.745755 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a27549b-007c-41b2-b077-416f388a4035 None admin] PATH_INFO: `/v3/services` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:49:00.746444 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a27549b-007c-41b2-b077-416f388a4035 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:49:00.746751 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a27549b-007c-41b2-b077-416f388a4035 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:49:00.748165 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a27549b-007c-41b2-b077-416f388a4035 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:49:00.749702 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-445af215-baf3-435e-a1ef-305df10c6c6d None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:49:00.750946 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-445af215-baf3-435e-a1ef-305df10c6c6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:49:00.755076 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 393/768] 10.222.0.17 () {56 vars in 1112 bytes} [Fri Oct 14 12:49:00 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:49:00.755902 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a27549b-007c-41b2-b077-416f388a4035 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:49:00.782686 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:49:00.832823 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:49:00.833016 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 376/769] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Oct 14 12:49:00 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 14 12:49:00.834039 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445af215-baf3-435e-a1ef-305df10c6c6d None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:49:00.874437 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a27549b-007c-41b2-b077-416f388a4035 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:49:00.913693 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677778b2-7096-4f9b-b6b8-0b0d4f89e2b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:49:00.914740 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677778b2-7096-4f9b-b6b8-0b0d4f89e2b5 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:49:00.915241 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677778b2-7096-4f9b-b6b8-0b0d4f89e2b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:49:00.915815 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677778b2-7096-4f9b-b6b8-0b0d4f89e2b5 None admin] PATH_INFO: `/v3/services` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:49:00.916450 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677778b2-7096-4f9b-b6b8-0b0d4f89e2b5 None admin] RBAC: Adding query filter params (name=image) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:49:00.916761 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677778b2-7096-4f9b-b6b8-0b0d4f89e2b5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:49:00.918198 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677778b2-7096-4f9b-b6b8-0b0d4f89e2b5 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:49:00.928185 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 394/770] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Oct 14 12:49:00 2022] GET /identity/v3/services?name=image => generated 122 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:49:00.929482 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677778b2-7096-4f9b-b6b8-0b0d4f89e2b5 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:49:00.958304 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445af215-baf3-435e-a1ef-305df10c6c6d None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:49:00.995799 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d87c3e5-8c82-4f57-894f-2e6583405c56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:49:00.996410 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d87c3e5-8c82-4f57-894f-2e6583405c56 None admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:49:00.996689 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d87c3e5-8c82-4f57-894f-2e6583405c56 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:49:00.996961 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d87c3e5-8c82-4f57-894f-2e6583405c56 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:49:00.997635 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d87c3e5-8c82-4f57-894f-2e6583405c56 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:49:00.999167 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d87c3e5-8c82-4f57-894f-2e6583405c56 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:49:01.020948 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 377/771] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Oct 14 12:49:00 2022] POST /identity/v3/endpoints => generated 334 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 12:49:01.056930 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677778b2-7096-4f9b-b6b8-0b0d4f89e2b5 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:49:01.092187 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:49:01.112434 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b627c22-5ed8-4b90-a6bc-64fe79cb7157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:49:01.113112 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b627c22-5ed8-4b90-a6bc-64fe79cb7157 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:49:01.113400 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b627c22-5ed8-4b90-a6bc-64fe79cb7157 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:49:01.113672 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b627c22-5ed8-4b90-a6bc-64fe79cb7157 None admin] PATH_INFO: `/v3/services` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:49:01.114354 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b627c22-5ed8-4b90-a6bc-64fe79cb7157 None admin] RBAC: Adding query filter params (type=image) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:49:01.114661 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b627c22-5ed8-4b90-a6bc-64fe79cb7157 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:49:01.116104 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b627c22-5ed8-4b90-a6bc-64fe79cb7157 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:49:01.116983 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d87c3e5-8c82-4f57-894f-2e6583405c56 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:49:01.125836 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 395/772] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Oct 14 12:49:00 2022] GET /identity/v3/services?type=image => generated 350 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 12:49:01.129028 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b627c22-5ed8-4b90-a6bc-64fe79cb7157 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:49:01.138507 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:49:01.240288 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d87c3e5-8c82-4f57-894f-2e6583405c56 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:49:01.258221 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b627c22-5ed8-4b90-a6bc-64fe79cb7157 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:49:01.288296 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee4b7df-aa97-464e-912a-0b11f6ecdf69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:49:01.288937 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee4b7df-aa97-464e-912a-0b11f6ecdf69 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:49:01.289373 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee4b7df-aa97-464e-912a-0b11f6ecdf69 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:49:01.289658 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee4b7df-aa97-464e-912a-0b11f6ecdf69 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:49:01.290641 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee4b7df-aa97-464e-912a-0b11f6ecdf69 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:49:01.292284 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee4b7df-aa97-464e-912a-0b11f6ecdf69 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:49:01.300518 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87af621-3e5d-4d23-aa6b-4f4a458ccb71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:49:01.301121 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87af621-3e5d-4d23-aa6b-4f4a458ccb71 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:49:01.301400 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87af621-3e5d-4d23-aa6b-4f4a458ccb71 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:49:01.301670 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87af621-3e5d-4d23-aa6b-4f4a458ccb71 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:49:01.302026 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-2ee4b7df-aa97-464e-912a-0b11f6ecdf69 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 14 12:49:01.302026 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:49:01.302026 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 14 12:49:01.302026 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 14 12:49:01.302026 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 14 12:49:01.302026 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 14 12:49:01.302026 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 14 12:49:01.302026 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 12:49:01.302026 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 14 12:49:01.302026 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 14 12:49:01.302026 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 14 12:49:01.302026 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 14 12:49:01.302026 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:49:01.302026 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:49:01.302026 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:49:01.302026 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:49:01.302026 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:49:01.303233 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:49:01.303233 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:49:01.303233 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:49:01.303233 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:49:01.303233 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:49:01.303233 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:49:01.303233 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 14 12:49:01.303233 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 14 12:49:01.303233 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 14 12:49:01.303233 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 14 12:49:01.303233 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:49:01.303233 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:49:01.303233 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:49:01.303233 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:49:01.303233 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:49:01.303233 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:49:01.304242 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:49:01.304242 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 14 12:49:01.304242 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:49:01.304242 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:49:01.304242 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:49:01.304242 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:49:01.304242 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:49:01.304242 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:49:01.304242 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:49:01.304242 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:49:01.304242 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 14 12:49:01.304242 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 12:49:01.304242 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 14 12:49:01.304242 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 14 12:49:01.305167 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87af621-3e5d-4d23-aa6b-4f4a458ccb71 None admin] RBAC: Adding query filter params (interface=public, service_id=68abac7f332c4484a30720c978b763a9, region_id=RegionOne) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:49:01.305167 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87af621-3e5d-4d23-aa6b-4f4a458ccb71 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:49:01.305335 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 378/773] 10.222.0.17 () {56 vars in 1126 bytes} [Fri Oct 14 12:49:01 2022] GET /identity/v3/services/object-store => generated 93 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 14 12:49:01.305424 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87af621-3e5d-4d23-aa6b-4f4a458ccb71 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:49:01.309358 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 396/774] 10.222.0.17 () {56 vars in 1251 bytes} [Fri Oct 14 12:49:01 2022] GET /identity/v3/endpoints?service_id=68abac7f332c4484a30720c978b763a9&interface=public®ion_id=RegionOne => generated 194 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:49:01.310963 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee4b7df-aa97-464e-912a-0b11f6ecdf69 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:49:01.315807 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87af621-3e5d-4d23-aa6b-4f4a458ccb71 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:49:01.374693 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:49:01.401756 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:49:01.423024 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee4b7df-aa97-464e-912a-0b11f6ecdf69 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:49:01.427226 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87af621-3e5d-4d23-aa6b-4f4a458ccb71 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:49:01.459478 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb10b4b5-0e11-4b67-8665-2468aa216fb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:49:01.460051 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb10b4b5-0e11-4b67-8665-2468aa216fb3 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:49:01.460346 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb10b4b5-0e11-4b67-8665-2468aa216fb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:49:01.460617 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb10b4b5-0e11-4b67-8665-2468aa216fb3 None admin] PATH_INFO: `/v3/services` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:49:01.461248 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb10b4b5-0e11-4b67-8665-2468aa216fb3 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:49:01.461555 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb10b4b5-0e11-4b67-8665-2468aa216fb3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:49:01.462989 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb10b4b5-0e11-4b67-8665-2468aa216fb3 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:49:01.463121 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e83ba76-494a-4f1a-83ac-67ec3ccbbe10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:49:01.463620 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e83ba76-494a-4f1a-83ac-67ec3ccbbe10 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:49:01.463901 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e83ba76-494a-4f1a-83ac-67ec3ccbbe10 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:49:01.464190 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e83ba76-494a-4f1a-83ac-67ec3ccbbe10 None admin] PATH_INFO: `/v3/services` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:49:01.464769 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e83ba76-494a-4f1a-83ac-67ec3ccbbe10 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:49:01.466136 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e83ba76-494a-4f1a-83ac-67ec3ccbbe10 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:49:01.473951 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 379/775] 10.222.0.17 () {56 vars in 1122 bytes} [Fri Oct 14 12:49:01 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 12:49:01.474847 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb10b4b5-0e11-4b67-8665-2468aa216fb3 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:49:01.478200 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 397/776] 10.222.0.17 () {56 vars in 1087 bytes} [Fri Oct 14 12:49:01 2022] GET /identity/v3/services => generated 1957 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 14 12:49:01.587031 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb10b4b5-0e11-4b67-8665-2468aa216fb3 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:49:01.640071 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bbe760-8bdb-4fb2-af75-d4e26f9786ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:49:01.640607 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bbe760-8bdb-4fb2-af75-d4e26f9786ae None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:49:01.640967 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bbe760-8bdb-4fb2-af75-d4e26f9786ae None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:49:01.641246 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bbe760-8bdb-4fb2-af75-d4e26f9786ae None admin] PATH_INFO: `/v3/services` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:49:01.641911 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bbe760-8bdb-4fb2-af75-d4e26f9786ae None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:49:01.642256 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bbe760-8bdb-4fb2-af75-d4e26f9786ae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:49:01.643677 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bbe760-8bdb-4fb2-af75-d4e26f9786ae None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:49:01.649465 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 380/777] 10.222.0.17 () {56 vars in 1122 bytes} [Fri Oct 14 12:49:01 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 12:49:01.655274 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e83ba76-494a-4f1a-83ac-67ec3ccbbe10 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:49:01.808906 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e83ba76-494a-4f1a-83ac-67ec3ccbbe10 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:49:01.825770 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:49:01.848753 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922f1e18-9c77-4f79-be41-4efabf0c7462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:49:01.849454 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922f1e18-9c77-4f79-be41-4efabf0c7462 None admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:49:01.849701 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922f1e18-9c77-4f79-be41-4efabf0c7462 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:49:01.849962 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922f1e18-9c77-4f79-be41-4efabf0c7462 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:49:01.850684 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922f1e18-9c77-4f79-be41-4efabf0c7462 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:49:01.852222 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922f1e18-9c77-4f79-be41-4efabf0c7462 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:49:01.878172 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 398/778] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Oct 14 12:49:01 2022] POST /identity/v3/endpoints => generated 325 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 12:49:03.291828 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeb28ba-07cb-4db4-8399-bf56b8102813 None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:49:03.292374 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeb28ba-07cb-4db4-8399-bf56b8102813 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:49:03.292374 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeb28ba-07cb-4db4-8399-bf56b8102813 None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:49:03.293687 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 381/779] 10.222.0.17 () {54 vars in 927 bytes} [Fri Oct 14 12:49:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:49:03.299121 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a132c1-1f6f-44ff-84ca-949691a43f8b None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:49:03.299510 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a132c1-1f6f-44ff-84ca-949691a43f8b None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:49:03.299682 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a132c1-1f6f-44ff-84ca-949691a43f8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:49:03.318100 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-59a132c1-1f6f-44ff-84ca-949691a43f8b None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:49:03.319316 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-59a132c1-1f6f-44ff-84ca-949691a43f8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:49:03.406618 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 399/780] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Oct 14 12:49:03 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 14 12:49:03.686329 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aeb28ba-07cb-4db4-8399-bf56b8102813 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:49:03.700875 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:49:03.707300 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd818dd5-ac9f-40de-af47-2fadbb02f481 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:49:03.707583 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd818dd5-ac9f-40de-af47-2fadbb02f481 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:49:03.707853 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd818dd5-ac9f-40de-af47-2fadbb02f481 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:49:03.709208 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 400/781] 10.222.0.17 () {54 vars in 927 bytes} [Fri Oct 14 12:49:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:49:03.714753 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd18262-54e7-4ee8-abc2-bbd72f8dc0a9 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:49:03.715029 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd18262-54e7-4ee8-abc2-bbd72f8dc0a9 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:49:03.715306 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd18262-54e7-4ee8-abc2-bbd72f8dc0a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:49:03.734074 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-cbd18262-54e7-4ee8-abc2-bbd72f8dc0a9 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:49:03.735303 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-cbd18262-54e7-4ee8-abc2-bbd72f8dc0a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:49:03.805897 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aeb28ba-07cb-4db4-8399-bf56b8102813 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:49:03.810352 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 401/782] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Oct 14 12:49:03 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 14 12:49:03.845328 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d34fbe-b63f-46a7-89ff-17e873830440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:49:03.845967 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d34fbe-b63f-46a7-89ff-17e873830440 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:49:03.846266 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d34fbe-b63f-46a7-89ff-17e873830440 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:49:03.846535 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d34fbe-b63f-46a7-89ff-17e873830440 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:49:03.857324 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d34fbe-b63f-46a7-89ff-17e873830440 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 12:49:03.862442 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-15d34fbe-b63f-46a7-89ff-17e873830440 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 14 12:49:03.862442 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:49:03.862442 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:49:03.862442 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:49:03.862442 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:49:03.862442 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:49:03.862442 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:49:03.862442 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:49:03.862442 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:49:03.862442 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:49:03.862442 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:49:03.862442 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:49:03.862442 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 12:49:03.862442 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 12:49:03.862442 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 12:49:03.862442 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 12:49:03.863383 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 12:49:03.863383 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 12:49:03.863383 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 12:49:03.863383 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 12:49:03.863383 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:49:03.863383 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:49:03.863383 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:49:03.863383 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:49:03.863383 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:49:03.863383 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:49:03.863383 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:49:03.863383 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 14 12:49:03.863383 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:49:03.863383 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:49:03.863383 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:49:03.863383 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:49:03.864240 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:49:03.864240 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:49:03.864240 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:49:03.864240 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:49:03.864240 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 12:49:03.864240 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 12:49:03.864240 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 12:49:03.864240 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 12:49:03.864240 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 12:49:03.864240 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 12:49:03.864240 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 14 12:49:03.864240 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 14 12:49:03.864240 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 382/783] 10.222.0.17 () {56 vars in 1120 bytes} [Fri Oct 14 12:49:03 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:49:03.869729 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd18262-54e7-4ee8-abc2-bbd72f8dc0a9 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:49:03.902592 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:49:03.978672 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd18262-54e7-4ee8-abc2-bbd72f8dc0a9 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:49:04.017937 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea1fa79-a3fc-4734-89db-330edb124257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:49:04.018559 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea1fa79-a3fc-4734-89db-330edb124257 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:49:04.018834 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea1fa79-a3fc-4734-89db-330edb124257 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:49:04.019105 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea1fa79-a3fc-4734-89db-330edb124257 None admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:49:04.019766 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea1fa79-a3fc-4734-89db-330edb124257 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:49:04.020064 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea1fa79-a3fc-4734-89db-330edb124257 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:49:04.021435 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea1fa79-a3fc-4734-89db-330edb124257 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:49:04.034409 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 402/784] 10.222.0.17 () {56 vars in 1115 bytes} [Fri Oct 14 12:49:03 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:49:04.035938 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d34fbe-b63f-46a7-89ff-17e873830440 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:49:04.083318 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea1fa79-a3fc-4734-89db-330edb124257 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:49:04.120527 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:49:04.152299 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d34fbe-b63f-46a7-89ff-17e873830440 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:49:04.181292 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:49:04.187265 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dba2950-a0c4-4ea9-b887-a039ce39b810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:49:04.187903 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dba2950-a0c4-4ea9-b887-a039ce39b810 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:49:04.188180 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dba2950-a0c4-4ea9-b887-a039ce39b810 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:49:04.188477 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dba2950-a0c4-4ea9-b887-a039ce39b810 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:49:04.191363 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea1fa79-a3fc-4734-89db-330edb124257 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:49:04.199521 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dba2950-a0c4-4ea9-b887-a039ce39b810 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:49:04.201088 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dba2950-a0c4-4ea9-b887-a039ce39b810 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:49:04.216263 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-2dba2950-a0c4-4ea9-b887-a039ce39b810 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:49:04.216263 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:49:04.216263 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:49:04.216263 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:49:04.216263 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:49:04.216263 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:49:04.216263 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:49:04.216263 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:49:04.216263 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:49:04.216263 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:49:04.216263 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:49:04.216263 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:49:04.216263 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 12:49:04.216263 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 12:49:04.216263 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 12:49:04.216263 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 12:49:04.217265 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:49:04.217265 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:49:04.217265 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:49:04.217265 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:49:04.217265 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:49:04.217265 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:49:04.217265 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:49:04.217265 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 14 12:49:04.217265 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:49:04.217265 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:49:04.217265 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:49:04.217265 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:49:04.217265 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:49:04.217265 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:49:04.217265 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:49:04.217265 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:49:04.217265 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 12:49:04.218679 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 12:49:04.218679 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:49:04.218679 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 14 12:49:04.218679 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 383/785] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Oct 14 12:49:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:49:04.218679 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66003597-e74b-4bbb-9c8b-969364893b32 None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:49:04.218975 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66003597-e74b-4bbb-9c8b-969364893b32 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:49:04.219171 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66003597-e74b-4bbb-9c8b-969364893b32 None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:49:04.220383 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 384/786] 10.222.0.17 () {54 vars in 927 bytes} [Fri Oct 14 12:49:04 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:49:04.224931 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66003597-e74b-4bbb-9c8b-969364893b32 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:49:04.227808 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd71171-166d-4bc4-9cb2-e991ee5dc00f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:49:04.228444 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd71171-166d-4bc4-9cb2-e991ee5dc00f None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:49:04.228775 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd71171-166d-4bc4-9cb2-e991ee5dc00f None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:49:04.228997 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd71171-166d-4bc4-9cb2-e991ee5dc00f None admin] PATH_INFO: `/v3/services/image` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:49:04.229584 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd71171-166d-4bc4-9cb2-e991ee5dc00f None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:49:04.231035 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd71171-166d-4bc4-9cb2-e991ee5dc00f None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:49:04.241217 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-ffd71171-166d-4bc4-9cb2-e991ee5dc00f None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 14 12:49:04.241217 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:49:04.241217 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 14 12:49:04.241217 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 14 12:49:04.241217 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 14 12:49:04.241217 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 14 12:49:04.241217 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 14 12:49:04.241217 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 12:49:04.241217 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 14 12:49:04.241217 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 14 12:49:04.241217 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 14 12:49:04.241217 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 14 12:49:04.241217 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:49:04.241217 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:49:04.241217 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:49:04.241217 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:49:04.241217 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:49:04.242436 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:49:04.242436 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:49:04.242436 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:49:04.242436 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:49:04.242436 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:49:04.242436 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:49:04.242436 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 14 12:49:04.242436 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 14 12:49:04.242436 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 14 12:49:04.242436 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 14 12:49:04.242436 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:49:04.242436 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:49:04.242436 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:49:04.242436 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:49:04.242436 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:49:04.242436 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:49:04.243280 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:49:04.243280 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 14 12:49:04.243280 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:49:04.243280 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:49:04.243280 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:49:04.243280 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:49:04.243280 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:49:04.243280 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:49:04.243280 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:49:04.243280 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:49:04.243280 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 14 12:49:04.243280 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 12:49:04.243280 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 14 12:49:04.243280 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 14 12:49:04.243280 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 403/787] 10.222.0.17 () {56 vars in 1105 bytes} [Fri Oct 14 12:49:04 2022] GET /identity/v3/services/image => generated 86 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 14 12:49:04.248450 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2e4f6b-318e-47d9-bf00-71c438dbbc94 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:49:04.248740 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2e4f6b-318e-47d9-bf00-71c438dbbc94 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:49:04.249021 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2e4f6b-318e-47d9-bf00-71c438dbbc94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:49:04.267848 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-0e2e4f6b-318e-47d9-bf00-71c438dbbc94 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:49:04.269052 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-0e2e4f6b-318e-47d9-bf00-71c438dbbc94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:49:04.330331 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66003597-e74b-4bbb-9c8b-969364893b32 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:49:04.339269 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 404/788] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Oct 14 12:49:04 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 14 12:49:04.340132 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2e4f6b-318e-47d9-bf00-71c438dbbc94 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:49:04.355515 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:49:04.370981 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616a1e5a-1b52-46d6-8504-4b52e598fbe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:49:04.371589 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616a1e5a-1b52-46d6-8504-4b52e598fbe6 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:49:04.371862 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616a1e5a-1b52-46d6-8504-4b52e598fbe6 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:49:04.372126 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616a1e5a-1b52-46d6-8504-4b52e598fbe6 None admin] PATH_INFO: `/v3/domains` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:49:04.372765 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616a1e5a-1b52-46d6-8504-4b52e598fbe6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:49:04.373064 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616a1e5a-1b52-46d6-8504-4b52e598fbe6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:49:04.374638 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616a1e5a-1b52-46d6-8504-4b52e598fbe6 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:49:04.394239 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 385/789] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Oct 14 12:49:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 12:49:04.395333 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616a1e5a-1b52-46d6-8504-4b52e598fbe6 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:49:04.443877 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:49:04.460071 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2e4f6b-318e-47d9-bf00-71c438dbbc94 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:49:04.501478 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f245f3d-6a11-4254-ab57-b89714d0ad1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:49:04.502024 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f245f3d-6a11-4254-ab57-b89714d0ad1c None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:49:04.502322 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f245f3d-6a11-4254-ab57-b89714d0ad1c None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:49:04.502597 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f245f3d-6a11-4254-ab57-b89714d0ad1c None admin] PATH_INFO: `/v3/services` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:49:04.503232 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f245f3d-6a11-4254-ab57-b89714d0ad1c None admin] RBAC: Adding query filter params (name=image) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:49:04.503536 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f245f3d-6a11-4254-ab57-b89714d0ad1c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:49:04.504914 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f245f3d-6a11-4254-ab57-b89714d0ad1c None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:49:04.507547 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616a1e5a-1b52-46d6-8504-4b52e598fbe6 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:49:04.511351 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 405/790] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Oct 14 12:49:04 2022] GET /identity/v3/services?name=image => generated 122 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:49:04.515725 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f245f3d-6a11-4254-ab57-b89714d0ad1c None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:49:04.546756 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127de1be-7f96-44b9-9734-53ca0f591d33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:49:04.547495 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127de1be-7f96-44b9-9734-53ca0f591d33 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:49:04.547777 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127de1be-7f96-44b9-9734-53ca0f591d33 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:49:04.548086 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127de1be-7f96-44b9-9734-53ca0f591d33 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:49:04.555649 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127de1be-7f96-44b9-9734-53ca0f591d33 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:49:04.557086 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127de1be-7f96-44b9-9734-53ca0f591d33 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:49:04.568874 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-127de1be-7f96-44b9-9734-53ca0f591d33 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 14 12:49:04.568874 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:49:04.568874 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:49:04.568874 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:49:04.568874 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:49:04.568874 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:49:04.568874 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:49:04.568874 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:49:04.568874 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:49:04.568874 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:49:04.568874 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:49:04.568874 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:49:04.568874 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 14 12:49:04.568874 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 14 12:49:04.568874 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 14 12:49:04.568874 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 14 12:49:04.569839 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:49:04.569839 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:49:04.569839 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 14 12:49:04.569839 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 12:49:04.569839 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 14 12:49:04.569839 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 12:49:04.569839 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:49:04.569839 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:49:04.569839 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:49:04.569839 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:49:04.569839 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:49:04.569839 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 14 12:49:04.569839 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:49:04.569839 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:49:04.569839 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:49:04.569839 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:49:04.569839 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:49:04.569839 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:49:04.571253 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:49:04.571253 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:49:04.571253 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 14 12:49:04.571253 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 14 12:49:04.571253 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 14 12:49:04.571253 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 14 12:49:04.571253 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 14 12:49:04.571253 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 14 12:49:04.571253 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 14 12:49:04.571253 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 14 12:49:04.571253 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 386/791] 10.222.0.17 () {56 vars in 1093 bytes} [Fri Oct 14 12:49:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:49:04.575540 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127de1be-7f96-44b9-9734-53ca0f591d33 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:49:04.628328 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f245f3d-6a11-4254-ab57-b89714d0ad1c None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:49:04.629447 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:49:04.663839 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f32de5-96ef-4afd-b5e4-da68847745d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:49:04.664453 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f32de5-96ef-4afd-b5e4-da68847745d9 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:49:04.664735 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f32de5-96ef-4afd-b5e4-da68847745d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:49:04.665010 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f32de5-96ef-4afd-b5e4-da68847745d9 None admin] PATH_INFO: `/v3/services` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:49:04.665643 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f32de5-96ef-4afd-b5e4-da68847745d9 None admin] RBAC: Adding query filter params (type=image) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:49:04.665949 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f32de5-96ef-4afd-b5e4-da68847745d9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:49:04.667368 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f32de5-96ef-4afd-b5e4-da68847745d9 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:49:04.672531 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 406/792] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Oct 14 12:49:04 2022] GET /identity/v3/services?type=image => generated 350 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 12:49:04.673897 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f32de5-96ef-4afd-b5e4-da68847745d9 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:49:04.690312 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:49:04.701764 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127de1be-7f96-44b9-9734-53ca0f591d33 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:49:04.753009 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c3fabe-5699-43d4-aad2-6c1f938fe4fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:49:04.753529 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c3fabe-5699-43d4-aad2-6c1f938fe4fa None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:49:04.753845 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c3fabe-5699-43d4-aad2-6c1f938fe4fa None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:49:04.754141 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c3fabe-5699-43d4-aad2-6c1f938fe4fa None admin] PATH_INFO: `/v3/users` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:49:04.754871 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c3fabe-5699-43d4-aad2-6c1f938fe4fa None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:49:04.755178 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c3fabe-5699-43d4-aad2-6c1f938fe4fa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:49:04.756607 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c3fabe-5699-43d4-aad2-6c1f938fe4fa None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:49:04.774511 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 387/793] 10.222.0.17 () {56 vars in 1133 bytes} [Fri Oct 14 12:49:04 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 12:49:04.775403 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c3fabe-5699-43d4-aad2-6c1f938fe4fa None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:49:04.782264 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f32de5-96ef-4afd-b5e4-da68847745d9 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:49:04.816412 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a754e59c-a149-45c1-991e-25631a1a0761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:49:04.817054 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a754e59c-a149-45c1-991e-25631a1a0761 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:49:04.817331 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a754e59c-a149-45c1-991e-25631a1a0761 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:49:04.817603 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a754e59c-a149-45c1-991e-25631a1a0761 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:49:04.818776 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a754e59c-a149-45c1-991e-25631a1a0761 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:49:04.820237 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a754e59c-a149-45c1-991e-25631a1a0761 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:49:04.821983 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 407/794] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Oct 14 12:49:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:49:04.822814 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a754e59c-a149-45c1-991e-25631a1a0761 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:49:04.876983 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:49:04.880014 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c3fabe-5699-43d4-aad2-6c1f938fe4fa None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:49:04.910622 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:49:04.919490 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531b86bc-c220-4c86-8de1-2bf86f21f622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:49:04.920137 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531b86bc-c220-4c86-8de1-2bf86f21f622 None admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:49:04.920419 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531b86bc-c220-4c86-8de1-2bf86f21f622 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:49:04.920687 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531b86bc-c220-4c86-8de1-2bf86f21f622 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:49:04.921579 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531b86bc-c220-4c86-8de1-2bf86f21f622 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:49:04.922763 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531b86bc-c220-4c86-8de1-2bf86f21f622 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:49:04.929901 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a754e59c-a149-45c1-991e-25631a1a0761 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:49:04.943516 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 388/795] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Oct 14 12:49:04 2022] POST /identity/v3/endpoints => generated 327 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 12:49:04.944319 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531b86bc-c220-4c86-8de1-2bf86f21f622 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:49:04.985202 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93666e7-dafd-4126-83d2-f9cb9a65bb3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:49:04.986514 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93666e7-dafd-4126-83d2-f9cb9a65bb3f None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:49:04.986980 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93666e7-dafd-4126-83d2-f9cb9a65bb3f None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:49:04.987261 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93666e7-dafd-4126-83d2-f9cb9a65bb3f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:49:04.999953 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93666e7-dafd-4126-83d2-f9cb9a65bb3f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:49:05.001710 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93666e7-dafd-4126-83d2-f9cb9a65bb3f None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:49:05.018810 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-d93666e7-dafd-4126-83d2-f9cb9a65bb3f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:49:05.018810 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:49:05.018810 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:49:05.018810 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:49:05.018810 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:49:05.018810 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:49:05.018810 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:49:05.018810 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:49:05.018810 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:49:05.018810 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:49:05.018810 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:49:05.018810 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:49:05.018810 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 12:49:05.018810 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 12:49:05.018810 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 12:49:05.018810 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 12:49:05.019983 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:49:05.019983 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:49:05.019983 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:49:05.019983 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:49:05.019983 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:49:05.019983 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:49:05.019983 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:49:05.019983 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 14 12:49:05.019983 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:49:05.019983 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:49:05.019983 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:49:05.019983 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:49:05.019983 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:49:05.019983 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:49:05.019983 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:49:05.019983 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:49:05.019983 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 12:49:05.020880 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 12:49:05.020880 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:49:05.020880 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 14 12:49:05.020880 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 408/796] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Oct 14 12:49:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:49:05.025924 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93666e7-dafd-4126-83d2-f9cb9a65bb3f None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:49:05.073772 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531b86bc-c220-4c86-8de1-2bf86f21f622 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:49:05.123116 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e08ed4-fd8a-41cc-a444-20a8f3a06343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:49:05.123750 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e08ed4-fd8a-41cc-a444-20a8f3a06343 None admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:49:05.124032 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e08ed4-fd8a-41cc-a444-20a8f3a06343 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:49:05.124306 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e08ed4-fd8a-41cc-a444-20a8f3a06343 None admin] PATH_INFO: `/v3/projects` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:49:05.125016 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e08ed4-fd8a-41cc-a444-20a8f3a06343 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:49:05.127500 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e08ed4-fd8a-41cc-a444-20a8f3a06343 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:49:05.165632 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 389/797] 10.222.0.17 () {60 vars in 1141 bytes} [Fri Oct 14 12:49:04 2022] POST /identity/v3/projects => generated 311 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 12:49:05.270431 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93666e7-dafd-4126-83d2-f9cb9a65bb3f None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:49:05.304186 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:49:05.311892 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de19d5ea-5291-4585-ab93-1b50dce2af36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:49:05.312822 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de19d5ea-5291-4585-ab93-1b50dce2af36 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:49:05.313296 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de19d5ea-5291-4585-ab93-1b50dce2af36 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:49:05.313793 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de19d5ea-5291-4585-ab93-1b50dce2af36 None admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:49:05.314646 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de19d5ea-5291-4585-ab93-1b50dce2af36 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:49:05.315124 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de19d5ea-5291-4585-ab93-1b50dce2af36 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:49:05.316744 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de19d5ea-5291-4585-ab93-1b50dce2af36 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:49:05.329889 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 409/798] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Oct 14 12:49:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 12:49:05.335397 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e08ed4-fd8a-41cc-a444-20a8f3a06343 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:49:05.347060 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:49:05.443694 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e08ed4-fd8a-41cc-a444-20a8f3a06343 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:49:05.479785 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67110e40-0871-4aab-9fcf-cad6a681fcca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:49:05.480420 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67110e40-0871-4aab-9fcf-cad6a681fcca None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:49:05.480702 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67110e40-0871-4aab-9fcf-cad6a681fcca None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:49:05.480976 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67110e40-0871-4aab-9fcf-cad6a681fcca None admin] PATH_INFO: `/v3/projects/service` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:49:05.488534 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67110e40-0871-4aab-9fcf-cad6a681fcca None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:49:05.490058 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67110e40-0871-4aab-9fcf-cad6a681fcca None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:49:05.501574 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-67110e40-0871-4aab-9fcf-cad6a681fcca None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 12:49:05.501574 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:49:05.501574 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:49:05.501574 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:49:05.501574 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:49:05.501574 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:49:05.501574 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:49:05.501574 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:49:05.501574 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:49:05.501574 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:49:05.501574 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:49:05.501574 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:49:05.501574 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 14 12:49:05.501574 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 14 12:49:05.501574 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 14 12:49:05.502818 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 14 12:49:05.502818 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:49:05.502818 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:49:05.502818 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:49:05.502818 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:49:05.502818 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:49:05.502818 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:49:05.502818 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:49:05.502818 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 14 12:49:05.502818 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:49:05.502818 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:49:05.502818 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:49:05.502818 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:49:05.502818 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:49:05.502818 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:49:05.502818 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:49:05.502818 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:49:05.504548 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 14 12:49:05.504548 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 14 12:49:05.504548 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 14 12:49:05.504548 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 14 12:49:05.504548 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 14 12:49:05.504548 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 14 12:49:05.504548 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 12:49:05.504548 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 14 12:49:05.504548 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 390/799] 10.222.0.17 () {56 vars in 1111 bytes} [Fri Oct 14 12:49:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:49:05.508715 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de19d5ea-5291-4585-ab93-1b50dce2af36 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:49:05.618444 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de19d5ea-5291-4585-ab93-1b50dce2af36 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:49:05.659400 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87e340d-948a-492e-a163-daf821da8e23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:49:05.660007 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87e340d-948a-492e-a163-daf821da8e23 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:49:05.660284 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87e340d-948a-492e-a163-daf821da8e23 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:49:05.660617 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87e340d-948a-492e-a163-daf821da8e23 None admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:49:05.661314 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87e340d-948a-492e-a163-daf821da8e23 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:49:05.661620 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87e340d-948a-492e-a163-daf821da8e23 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:49:05.663090 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87e340d-948a-492e-a163-daf821da8e23 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:49:05.675498 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 410/800] 10.222.0.17 () {56 vars in 1148 bytes} [Fri Oct 14 12:49:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:49:05.681252 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67110e40-0871-4aab-9fcf-cad6a681fcca None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:49:05.754557 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:49:05.790707 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67110e40-0871-4aab-9fcf-cad6a681fcca None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:49:05.827578 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f9b2a7-1375-475c-9fc6-33ee84532617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:49:05.827578 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f9b2a7-1375-475c-9fc6-33ee84532617 None admin] REQUEST_METHOD: `PUT` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:49:05.827885 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f9b2a7-1375-475c-9fc6-33ee84532617 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:49:05.828770 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f9b2a7-1375-475c-9fc6-33ee84532617 None admin] PATH_INFO: `/v3/projects/2486e73d493b40e18d9d988744993854/users/931f4e32c8764514b5efed31b0785be7/roles/5dbcc3f2e7dd43dba994ee44cb11535e` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:49:05.830728 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f9b2a7-1375-475c-9fc6-33ee84532617 None admin] RBAC: Authorizing `identity:create_grant(project_id=2486e73d493b40e18d9d988744993854, user_id=931f4e32c8764514b5efed31b0785be7, role_id=5dbcc3f2e7dd43dba994ee44cb11535e)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:49:05.832224 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f9b2a7-1375-475c-9fc6-33ee84532617 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:49:05.849006 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 391/801] 10.222.0.17 () {58 vars in 1439 bytes} [Fri Oct 14 12:49:05 2022] PUT /identity/v3/projects/2486e73d493b40e18d9d988744993854/users/931f4e32c8764514b5efed31b0785be7/roles/5dbcc3f2e7dd43dba994ee44cb11535e => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 12:49:07.312051 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f8cfef-8a06-4b16-a19c-23b3fbdd72e6 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:49:07.312580 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f8cfef-8a06-4b16-a19c-23b3fbdd72e6 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:49:07.312657 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f8cfef-8a06-4b16-a19c-23b3fbdd72e6 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:49:07.314881 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 411/802] 10.222.0.17 () {54 vars in 927 bytes} [Fri Oct 14 12:49:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:49:07.320745 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc00879-ad64-4dc9-aa15-f2ea26ce5f81 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:49:07.321205 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc00879-ad64-4dc9-aa15-f2ea26ce5f81 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:49:07.321280 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc00879-ad64-4dc9-aa15-f2ea26ce5f81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:49:07.340693 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-6cc00879-ad64-4dc9-aa15-f2ea26ce5f81 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:49:07.341956 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-6cc00879-ad64-4dc9-aa15-f2ea26ce5f81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:49:07.403595 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890d020b-5edd-4d2f-aa22-6784adf4be4a None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:49:07.403822 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890d020b-5edd-4d2f-aa22-6784adf4be4a None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:49:07.404136 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890d020b-5edd-4d2f-aa22-6784adf4be4a None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:49:07.405763 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 412/803] 10.222.0.17 () {54 vars in 927 bytes} [Fri Oct 14 12:49:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 14 12:49:07.412908 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7d88a0-667c-4311-b4ba-f7a9caf1bf11 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:49:07.413243 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7d88a0-667c-4311-b4ba-f7a9caf1bf11 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:49:07.413560 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7d88a0-667c-4311-b4ba-f7a9caf1bf11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:49:07.427347 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 392/804] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Oct 14 12:49:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 14 12:49:07.433711 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-8f7d88a0-667c-4311-b4ba-f7a9caf1bf11 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:49:07.434991 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-8f7d88a0-667c-4311-b4ba-f7a9caf1bf11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:49:07.488868 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:49:07.514159 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 413/805] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Oct 14 12:49:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 14 12:49:07.704895 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc00879-ad64-4dc9-aa15-f2ea26ce5f81 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:49:07.779407 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:49:07.792576 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7d88a0-667c-4311-b4ba-f7a9caf1bf11 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:49:07.848031 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc00879-ad64-4dc9-aa15-f2ea26ce5f81 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:49:07.895958 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5ee1cd-1a29-4728-b45a-7d8051904c59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:49:07.896859 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5ee1cd-1a29-4728-b45a-7d8051904c59 None admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:49:07.897203 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5ee1cd-1a29-4728-b45a-7d8051904c59 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:49:07.897479 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5ee1cd-1a29-4728-b45a-7d8051904c59 None admin] PATH_INFO: `/v3/domains` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:49:07.898194 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5ee1cd-1a29-4728-b45a-7d8051904c59 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:49:07.899594 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5ee1cd-1a29-4728-b45a-7d8051904c59 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:49:07.909674 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.sql.core [None req-ac5ee1cd-1a29-4728-b45a-7d8051904c59 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 14 12:49:07.909674 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 14 12:49:07.909674 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [parameters: {'id': '0ced13b59a1347068a4efdf9f90ac013', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 14 12:49:07.909674 dv-cinder-820994-7-smb devstack@keystone.service[81439]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81439) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 14 12:49:07.916776 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-ac5ee1cd-1a29-4728-b45a-7d8051904c59 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 14 12:49:07.916776 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:49:07.916776 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 14 12:49:07.916776 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 14 12:49:07.916776 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 14 12:49:07.916776 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 14 12:49:07.916776 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 14 12:49:07.916776 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application result = self._query(query) Oct 14 12:49:07.916776 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 14 12:49:07.916776 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application conn.query(q) Oct 14 12:49:07.916776 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 14 12:49:07.916776 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 14 12:49:07.916776 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 14 12:49:07.916776 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application result.read() Oct 14 12:49:07.917691 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 14 12:49:07.917691 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 14 12:49:07.917691 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 14 12:49:07.917691 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 14 12:49:07.917691 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 14 12:49:07.917691 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 14 12:49:07.917691 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 14 12:49:07.917691 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 14 12:49:07.917691 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 14 12:49:07.917691 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 14 12:49:07.917691 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 14 12:49:07.917691 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 14 12:49:07.917691 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:49:07.917691 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 14 12:49:07.917691 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 14 12:49:07.917691 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 14 12:49:07.917691 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 14 12:49:07.917691 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 14 12:49:07.918802 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application next(self.gen) Oct 14 12:49:07.918802 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 14 12:49:07.918802 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application yield resource Oct 14 12:49:07.918802 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 14 12:49:07.918802 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application next(self.gen) Oct 14 12:49:07.918802 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 14 12:49:07.918802 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application self.session.rollback() Oct 14 12:49:07.918802 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 14 12:49:07.918802 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application self.force_reraise() Oct 14 12:49:07.918802 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 14 12:49:07.918802 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise self.value Oct 14 12:49:07.918802 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 14 12:49:07.918802 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 14 12:49:07.918802 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 14 12:49:07.918802 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application session.commit() Oct 14 12:49:07.918802 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 14 12:49:07.918802 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 14 12:49:07.919659 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 14 12:49:07.919659 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application self._prepare_impl() Oct 14 12:49:07.919659 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 14 12:49:07.919659 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application self.session.flush() Oct 14 12:49:07.919659 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 14 12:49:07.919659 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application self._flush(objects) Oct 14 12:49:07.919659 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 14 12:49:07.919659 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 14 12:49:07.919659 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 14 12:49:07.919659 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application compat.raise_( Oct 14 12:49:07.919659 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 14 12:49:07.919659 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception Oct 14 12:49:07.919659 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 14 12:49:07.919659 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application flush_context.execute() Oct 14 12:49:07.919659 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 14 12:49:07.919659 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rec.execute(self) Oct 14 12:49:07.919659 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 14 12:49:07.921160 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 14 12:49:07.921160 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 14 12:49:07.921160 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 14 12:49:07.921160 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 14 12:49:07.921160 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 14 12:49:07.921160 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 14 12:49:07.921160 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 14 12:49:07.921160 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 14 12:49:07.921160 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 14 12:49:07.921160 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 14 12:49:07.921160 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 14 12:49:07.921160 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 14 12:49:07.921160 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 14 12:49:07.921160 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 14 12:49:07.921160 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 14 12:49:07.921928 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 14 12:49:07.921928 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception Oct 14 12:49:07.921928 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 14 12:49:07.921928 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 14 12:49:07.921928 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 14 12:49:07.921928 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 14 12:49:07.921928 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 14 12:49:07.921928 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application result = self._query(query) Oct 14 12:49:07.921928 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 14 12:49:07.921928 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application conn.query(q) Oct 14 12:49:07.921928 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 14 12:49:07.921928 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 14 12:49:07.921928 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 14 12:49:07.921928 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application result.read() Oct 14 12:49:07.921928 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 14 12:49:07.921928 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 14 12:49:07.921928 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 14 12:49:07.924216 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 14 12:49:07.924216 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 14 12:49:07.924216 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 14 12:49:07.924216 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 14 12:49:07.924216 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 14 12:49:07.924216 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 14 12:49:07.924216 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 14 12:49:07.924216 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [parameters: {'id': '0ced13b59a1347068a4efdf9f90ac013', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 14 12:49:07.924216 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 14 12:49:07.924216 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 14 12:49:07.924216 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 14 12:49:07.924216 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 14 12:49:07.924216 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:49:07.924216 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 14 12:49:07.924216 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 14 12:49:07.927744 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 14 12:49:07.927744 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 14 12:49:07.927744 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name Default. Oct 14 12:49:07.927744 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 14 12:49:07.927744 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 14 12:49:07.927744 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 14 12:49:07.927744 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:49:07.927744 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:49:07.927744 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:49:07.927744 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:49:07.927744 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:49:07.927744 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:49:07.927744 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:49:07.927744 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:49:07.927744 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:49:07.927744 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:49:07.927744 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:49:07.931556 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Oct 14 12:49:07.931556 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Oct 14 12:49:07.931556 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:49:07.931556 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:49:07.931556 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Oct 14 12:49:07.931556 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Oct 14 12:49:07.931556 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:49:07.931556 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:49:07.931556 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 14 12:49:07.931556 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 14 12:49:07.931556 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 14 12:49:07.931556 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 14 12:49:07.931556 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 393/806] 10.222.0.17 () {60 vars in 1137 bytes} [Fri Oct 14 12:49:07 2022] POST /identity/v3/domains => generated 190 bytes in 214 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Oct 14 12:49:07.935637 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7d88a0-667c-4311-b4ba-f7a9caf1bf11 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:49:07.935810 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5ee1cd-1a29-4728-b45a-7d8051904c59 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:49:07.971271 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c336dd-7f68-4716-80e8-2694b93a79fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:49:07.972242 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c336dd-7f68-4716-80e8-2694b93a79fe None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:49:07.972552 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c336dd-7f68-4716-80e8-2694b93a79fe None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:49:07.972823 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c336dd-7f68-4716-80e8-2694b93a79fe None admin] PATH_INFO: `/v3/domains/default` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:49:07.974036 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c336dd-7f68-4716-80e8-2694b93a79fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:49:07.975557 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c336dd-7f68-4716-80e8-2694b93a79fe None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:49:07.977161 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 414/807] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Oct 14 12:49:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:49:07.982969 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c336dd-7f68-4716-80e8-2694b93a79fe None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:49:08.038464 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:49:08.047444 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5ee1cd-1a29-4728-b45a-7d8051904c59 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:49:08.073176 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:49:08.086154 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828e396d-1a41-46fd-aa76-e7380b491366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:49:08.086154 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828e396d-1a41-46fd-aa76-e7380b491366 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:49:08.086154 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828e396d-1a41-46fd-aa76-e7380b491366 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:49:08.086154 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828e396d-1a41-46fd-aa76-e7380b491366 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:49:08.094456 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c336dd-7f68-4716-80e8-2694b93a79fe None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:49:08.097466 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828e396d-1a41-46fd-aa76-e7380b491366 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:49:08.099200 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828e396d-1a41-46fd-aa76-e7380b491366 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:49:08.113842 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-828e396d-1a41-46fd-aa76-e7380b491366 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:49:08.113842 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:49:08.113842 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:49:08.113842 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:49:08.113842 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:49:08.113842 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:49:08.113842 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:49:08.113842 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:49:08.113842 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:49:08.113842 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:49:08.113842 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:49:08.113842 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:49:08.113842 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 12:49:08.113842 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 12:49:08.113842 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 12:49:08.113842 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 12:49:08.114839 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:49:08.114839 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:49:08.114839 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:49:08.114839 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:49:08.114839 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:49:08.114839 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:49:08.114839 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:49:08.114839 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 14 12:49:08.114839 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:49:08.114839 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:49:08.114839 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:49:08.114839 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:49:08.114839 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:49:08.114839 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:49:08.114839 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:49:08.114839 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:49:08.114839 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 12:49:08.115723 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 12:49:08.115723 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:49:08.115723 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 14 12:49:08.115723 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 394/808] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Oct 14 12:49:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:49:08.116234 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5054ea-c997-4082-9fbd-a6f01a616b17 None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:49:08.116439 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5054ea-c997-4082-9fbd-a6f01a616b17 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:49:08.116709 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5054ea-c997-4082-9fbd-a6f01a616b17 None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:49:08.118162 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 395/809] 10.222.0.17 () {54 vars in 927 bytes} [Fri Oct 14 12:49:08 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:49:08.120885 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5054ea-c997-4082-9fbd-a6f01a616b17 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:49:08.133080 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f26b177-c43b-4e75-becd-f9a795aab1f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:49:08.133687 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f26b177-c43b-4e75-becd-f9a795aab1f0 None admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:49:08.133964 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f26b177-c43b-4e75-becd-f9a795aab1f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:49:08.134266 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f26b177-c43b-4e75-becd-f9a795aab1f0 None admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:49:08.134923 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f26b177-c43b-4e75-becd-f9a795aab1f0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:49:08.136347 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f26b177-c43b-4e75-becd-f9a795aab1f0 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:49:08.162160 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 415/810] 10.222.0.17 () {60 vars in 1132 bytes} [Fri Oct 14 12:49:07 2022] POST /identity/v3/users => generated 285 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 12:49:08.162160 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11598cca-0546-4fec-b9a0-5d2b13bccb73 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:49:08.162160 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11598cca-0546-4fec-b9a0-5d2b13bccb73 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:49:08.162160 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11598cca-0546-4fec-b9a0-5d2b13bccb73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:49:08.179317 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-11598cca-0546-4fec-b9a0-5d2b13bccb73 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:49:08.180551 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-11598cca-0546-4fec-b9a0-5d2b13bccb73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:49:08.254465 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5054ea-c997-4082-9fbd-a6f01a616b17 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:49:08.277986 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 416/811] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Oct 14 12:49:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 14 12:49:08.295735 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c926fe7-41cc-44b2-adce-ae7d925d21bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:49:08.296416 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c926fe7-41cc-44b2-adce-ae7d925d21bb None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:49:08.296690 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c926fe7-41cc-44b2-adce-ae7d925d21bb None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:49:08.296957 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c926fe7-41cc-44b2-adce-ae7d925d21bb None admin] PATH_INFO: `/v3/domains` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:49:08.297766 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c926fe7-41cc-44b2-adce-ae7d925d21bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:49:08.298097 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c926fe7-41cc-44b2-adce-ae7d925d21bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:49:08.299843 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c926fe7-41cc-44b2-adce-ae7d925d21bb None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:49:08.313987 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 396/812] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Oct 14 12:49:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 12:49:08.605003 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11598cca-0546-4fec-b9a0-5d2b13bccb73 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:49:08.643182 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:49:08.710649 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11598cca-0546-4fec-b9a0-5d2b13bccb73 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:49:08.746531 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe1a88c-bd08-4681-9228-b44b20b16efc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:49:08.747160 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe1a88c-bd08-4681-9228-b44b20b16efc None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:49:08.747436 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe1a88c-bd08-4681-9228-b44b20b16efc None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:49:08.747706 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe1a88c-bd08-4681-9228-b44b20b16efc None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:49:08.758674 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe1a88c-bd08-4681-9228-b44b20b16efc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 12:49:08.763514 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-5fe1a88c-bd08-4681-9228-b44b20b16efc None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 14 12:49:08.763514 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:49:08.763514 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:49:08.763514 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:49:08.763514 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:49:08.763514 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:49:08.763514 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:49:08.763514 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:49:08.763514 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:49:08.763514 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:49:08.763514 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:49:08.763514 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:49:08.763514 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 12:49:08.763514 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 12:49:08.763514 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 12:49:08.763514 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 12:49:08.764630 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 12:49:08.764630 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 12:49:08.764630 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 12:49:08.764630 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 12:49:08.764630 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:49:08.764630 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:49:08.764630 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:49:08.764630 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:49:08.764630 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:49:08.764630 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:49:08.764630 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:49:08.764630 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 14 12:49:08.764630 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:49:08.764630 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:49:08.764630 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:49:08.764630 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:49:08.765917 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:49:08.765917 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:49:08.765917 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:49:08.765917 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:49:08.765917 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 12:49:08.765917 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 12:49:08.765917 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 12:49:08.765917 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 12:49:08.765917 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 12:49:08.765917 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 12:49:08.765917 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 14 12:49:08.765917 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 14 12:49:08.765917 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 417/813] 10.222.0.17 () {56 vars in 1120 bytes} [Fri Oct 14 12:49:08 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:49:08.771389 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c926fe7-41cc-44b2-adce-ae7d925d21bb None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:49:08.806872 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:49:08.874614 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c926fe7-41cc-44b2-adce-ae7d925d21bb None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:49:08.907959 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd82f0b-e59d-4e8b-85bf-3a168ef34788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:49:08.908560 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd82f0b-e59d-4e8b-85bf-3a168ef34788 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:49:08.908838 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd82f0b-e59d-4e8b-85bf-3a168ef34788 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:49:08.909108 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd82f0b-e59d-4e8b-85bf-3a168ef34788 None admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:49:08.909768 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd82f0b-e59d-4e8b-85bf-3a168ef34788 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:49:08.910076 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd82f0b-e59d-4e8b-85bf-3a168ef34788 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:49:08.911478 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd82f0b-e59d-4e8b-85bf-3a168ef34788 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:49:08.919903 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 397/814] 10.222.0.17 () {56 vars in 1115 bytes} [Fri Oct 14 12:49:08 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:49:08.927310 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe1a88c-bd08-4681-9228-b44b20b16efc None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:49:09.022507 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:49:09.030148 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe1a88c-bd08-4681-9228-b44b20b16efc None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:49:09.065304 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3d437f-7331-4ae4-ac2a-f4ffa937a776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:49:09.065950 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3d437f-7331-4ae4-ac2a-f4ffa937a776 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:49:09.066261 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3d437f-7331-4ae4-ac2a-f4ffa937a776 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:49:09.066564 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3d437f-7331-4ae4-ac2a-f4ffa937a776 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:49:09.076714 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3d437f-7331-4ae4-ac2a-f4ffa937a776 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:49:09.078251 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3d437f-7331-4ae4-ac2a-f4ffa937a776 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:49:09.095425 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-fc3d437f-7331-4ae4-ac2a-f4ffa937a776 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:49:09.095425 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:49:09.095425 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:49:09.095425 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:49:09.095425 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:49:09.095425 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:49:09.095425 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:49:09.095425 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:49:09.095425 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:49:09.095425 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:49:09.095425 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:49:09.095425 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:49:09.095425 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 12:49:09.095425 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 12:49:09.095425 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 12:49:09.095425 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 12:49:09.096483 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:49:09.096483 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:49:09.096483 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:49:09.096483 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:49:09.096483 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:49:09.096483 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:49:09.096483 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:49:09.096483 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 14 12:49:09.096483 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:49:09.096483 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:49:09.096483 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:49:09.096483 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:49:09.096483 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:49:09.096483 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:49:09.096483 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:49:09.096483 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:49:09.096483 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 12:49:09.102217 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 12:49:09.102217 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:49:09.102217 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 14 12:49:09.102217 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 418/815] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Oct 14 12:49:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:49:09.102956 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd82f0b-e59d-4e8b-85bf-3a168ef34788 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:49:09.196815 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:49:09.202957 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd82f0b-e59d-4e8b-85bf-3a168ef34788 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:49:09.236904 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ace21e-7c8f-438b-9d4e-69b5273b2e93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:49:09.237496 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ace21e-7c8f-438b-9d4e-69b5273b2e93 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:49:09.237770 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ace21e-7c8f-438b-9d4e-69b5273b2e93 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:49:09.238037 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ace21e-7c8f-438b-9d4e-69b5273b2e93 None admin] PATH_INFO: `/v3/domains` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:49:09.238688 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ace21e-7c8f-438b-9d4e-69b5273b2e93 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:49:09.238985 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ace21e-7c8f-438b-9d4e-69b5273b2e93 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:49:09.240346 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ace21e-7c8f-438b-9d4e-69b5273b2e93 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:49:09.251796 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 398/816] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Oct 14 12:49:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:49:09.257509 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3d437f-7331-4ae4-ac2a-f4ffa937a776 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:49:09.362463 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3d437f-7331-4ae4-ac2a-f4ffa937a776 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:49:09.396280 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50e724c-1d5d-45eb-af54-24e6ed7001aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:49:09.397077 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50e724c-1d5d-45eb-af54-24e6ed7001aa None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:49:09.397762 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50e724c-1d5d-45eb-af54-24e6ed7001aa None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:49:09.397762 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50e724c-1d5d-45eb-af54-24e6ed7001aa None admin] PATH_INFO: `/v3/users/nova` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:49:09.405783 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50e724c-1d5d-45eb-af54-24e6ed7001aa None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:49:09.407779 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50e724c-1d5d-45eb-af54-24e6ed7001aa None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:49:09.419856 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-f50e724c-1d5d-45eb-af54-24e6ed7001aa None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 14 12:49:09.419856 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:49:09.419856 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:49:09.419856 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:49:09.419856 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:49:09.419856 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:49:09.419856 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:49:09.419856 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:49:09.419856 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:49:09.419856 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:49:09.419856 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:49:09.419856 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:49:09.419856 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 14 12:49:09.419856 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 14 12:49:09.419856 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 14 12:49:09.419856 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 14 12:49:09.421743 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:49:09.421743 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:49:09.421743 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 14 12:49:09.421743 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 12:49:09.421743 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 14 12:49:09.421743 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 12:49:09.421743 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:49:09.421743 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:49:09.421743 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:49:09.421743 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:49:09.421743 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:49:09.421743 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 14 12:49:09.421743 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:49:09.421743 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:49:09.421743 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:49:09.421743 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:49:09.421743 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:49:09.421743 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:49:09.423677 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:49:09.423677 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:49:09.423677 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 14 12:49:09.423677 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 14 12:49:09.423677 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 14 12:49:09.423677 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 14 12:49:09.423677 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 14 12:49:09.423677 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 14 12:49:09.423677 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 14 12:49:09.423677 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 14 12:49:09.423677 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 419/817] 10.222.0.17 () {56 vars in 1093 bytes} [Fri Oct 14 12:49:09 2022] GET /identity/v3/users/nova => generated 82 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:49:09.429096 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ace21e-7c8f-438b-9d4e-69b5273b2e93 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:49:09.531510 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ace21e-7c8f-438b-9d4e-69b5273b2e93 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:49:09.566293 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cb9b19-d8fa-4161-ba98-efddc844364c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:49:09.566902 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cb9b19-d8fa-4161-ba98-efddc844364c None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:49:09.567184 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cb9b19-d8fa-4161-ba98-efddc844364c None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:49:09.567461 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cb9b19-d8fa-4161-ba98-efddc844364c None admin] PATH_INFO: `/v3/users` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:49:09.568220 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cb9b19-d8fa-4161-ba98-efddc844364c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:49:09.568530 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cb9b19-d8fa-4161-ba98-efddc844364c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:49:09.569992 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cb9b19-d8fa-4161-ba98-efddc844364c None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:49:09.588774 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 399/818] 10.222.0.17 () {56 vars in 1133 bytes} [Fri Oct 14 12:49:09 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:49:09.594628 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50e724c-1d5d-45eb-af54-24e6ed7001aa None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:49:09.603941 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:49:09.695067 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50e724c-1d5d-45eb-af54-24e6ed7001aa None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:49:09.736885 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a43ad7-1373-4796-bc55-6d578a579921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:49:09.737894 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a43ad7-1373-4796-bc55-6d578a579921 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:49:09.738425 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a43ad7-1373-4796-bc55-6d578a579921 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:49:09.738890 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a43ad7-1373-4796-bc55-6d578a579921 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:49:09.818086 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a43ad7-1373-4796-bc55-6d578a579921 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:49:09.820296 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a43ad7-1373-4796-bc55-6d578a579921 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:49:09.832356 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:49:09.932934 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 420/819] 10.222.0.17 () {58 vars in 1282 bytes} [Fri Oct 14 12:49:09 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 14 12:49:09.939369 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cb9b19-d8fa-4161-ba98-efddc844364c None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:49:09.957315 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:49:10.052079 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cb9b19-d8fa-4161-ba98-efddc844364c None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:49:10.086686 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43794ca6-eb17-4846-b2ff-b8e681804740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:49:10.087324 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43794ca6-eb17-4846-b2ff-b8e681804740 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:49:10.087604 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43794ca6-eb17-4846-b2ff-b8e681804740 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:49:10.087878 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43794ca6-eb17-4846-b2ff-b8e681804740 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:49:10.101136 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43794ca6-eb17-4846-b2ff-b8e681804740 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:49:10.102632 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43794ca6-eb17-4846-b2ff-b8e681804740 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:49:10.118048 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-43794ca6-eb17-4846-b2ff-b8e681804740 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:49:10.118048 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:49:10.118048 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:49:10.118048 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:49:10.118048 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:49:10.118048 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:49:10.118048 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:49:10.118048 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:49:10.118048 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:49:10.118048 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:49:10.118048 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:49:10.118048 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:49:10.118048 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 12:49:10.118048 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 12:49:10.118048 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 12:49:10.118048 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 12:49:10.119093 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:49:10.119093 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:49:10.119093 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:49:10.119093 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:49:10.119093 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:49:10.119093 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:49:10.119093 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:49:10.119093 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 14 12:49:10.119093 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:49:10.119093 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:49:10.119093 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:49:10.119093 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:49:10.119093 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:49:10.119093 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:49:10.119093 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:49:10.119093 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:49:10.119093 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 12:49:10.120373 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 12:49:10.120373 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:49:10.120373 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 14 12:49:10.120373 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 400/820] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Oct 14 12:49:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:49:10.124928 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a43ad7-1373-4796-bc55-6d578a579921 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:49:10.228832 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a43ad7-1373-4796-bc55-6d578a579921 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:49:10.236847 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:49:10.263054 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68fb64a-082e-44b9-a13f-497a271f578e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:49:10.263654 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68fb64a-082e-44b9-a13f-497a271f578e None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:49:10.263936 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68fb64a-082e-44b9-a13f-497a271f578e None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:49:10.264198 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68fb64a-082e-44b9-a13f-497a271f578e None admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:49:10.264913 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68fb64a-082e-44b9-a13f-497a271f578e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:49:10.265132 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68fb64a-082e-44b9-a13f-497a271f578e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:49:10.267057 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68fb64a-082e-44b9-a13f-497a271f578e None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:49:10.278932 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 421/821] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Oct 14 12:49:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:49:10.284985 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43794ca6-eb17-4846-b2ff-b8e681804740 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:49:10.359457 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:49:10.395341 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43794ca6-eb17-4846-b2ff-b8e681804740 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:49:10.423989 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f1b96a-886d-47b8-a088-f476b1207418 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:49:10.424266 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f1b96a-886d-47b8-a088-f476b1207418 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:49:10.424541 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f1b96a-886d-47b8-a088-f476b1207418 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:49:10.425873 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 422/822] 10.222.0.17 () {54 vars in 927 bytes} [Fri Oct 14 12:49:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:49:10.431167 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e58378-e623-4974-85ca-a4eedf26ee67 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:49:10.431455 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e58378-e623-4974-85ca-a4eedf26ee67 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:49:10.431727 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e58378-e623-4974-85ca-a4eedf26ee67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:49:10.432516 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004bbafc-2333-479e-8f6a-0a090c5c1312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:49:10.433137 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004bbafc-2333-479e-8f6a-0a090c5c1312 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:49:10.433415 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004bbafc-2333-479e-8f6a-0a090c5c1312 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:49:10.433682 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004bbafc-2333-479e-8f6a-0a090c5c1312 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:49:10.441057 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004bbafc-2333-479e-8f6a-0a090c5c1312 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:49:10.442536 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004bbafc-2333-479e-8f6a-0a090c5c1312 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:49:10.450799 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-c4e58378-e623-4974-85ca-a4eedf26ee67 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:49:10.451996 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-c4e58378-e623-4974-85ca-a4eedf26ee67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:49:10.453615 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-004bbafc-2333-479e-8f6a-0a090c5c1312 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 12:49:10.453615 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:49:10.453615 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:49:10.453615 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:49:10.453615 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:49:10.453615 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:49:10.453615 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:49:10.453615 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:49:10.453615 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:49:10.453615 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:49:10.453615 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:49:10.453615 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:49:10.453615 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 14 12:49:10.453615 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 14 12:49:10.453615 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 14 12:49:10.456520 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 14 12:49:10.456520 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:49:10.456520 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:49:10.456520 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:49:10.456520 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:49:10.456520 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:49:10.456520 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:49:10.456520 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:49:10.456520 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 14 12:49:10.456520 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:49:10.456520 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:49:10.456520 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:49:10.456520 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:49:10.456520 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:49:10.456520 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:49:10.456520 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:49:10.456520 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:49:10.457741 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 14 12:49:10.457741 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 14 12:49:10.457741 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 14 12:49:10.457741 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 14 12:49:10.457741 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 14 12:49:10.457741 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 14 12:49:10.457741 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 12:49:10.457741 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 14 12:49:10.457741 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 401/823] 10.222.0.17 () {56 vars in 1111 bytes} [Fri Oct 14 12:49:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:49:10.461256 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004bbafc-2333-479e-8f6a-0a090c5c1312 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:49:10.527306 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 423/824] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Oct 14 12:49:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 14 12:49:10.575133 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004bbafc-2333-479e-8f6a-0a090c5c1312 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:49:10.601898 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:49:10.612333 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b661db8-56dc-431e-91e6-565b3a9e40d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:49:10.612870 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b661db8-56dc-431e-91e6-565b3a9e40d7 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:49:10.613150 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b661db8-56dc-431e-91e6-565b3a9e40d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:49:10.613424 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b661db8-56dc-431e-91e6-565b3a9e40d7 None admin] PATH_INFO: `/v3/projects` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:49:10.614162 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b661db8-56dc-431e-91e6-565b3a9e40d7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:49:10.614474 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b661db8-56dc-431e-91e6-565b3a9e40d7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:49:10.616094 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b661db8-56dc-431e-91e6-565b3a9e40d7 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:49:10.629353 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 402/825] 10.222.0.17 () {56 vars in 1148 bytes} [Fri Oct 14 12:49:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 12:49:10.635978 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e58378-e623-4974-85ca-a4eedf26ee67 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:49:10.741647 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:49:10.749664 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e58378-e623-4974-85ca-a4eedf26ee67 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:49:10.786481 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66912dec-2de1-4243-8862-14e34c5b3af6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:49:10.787083 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66912dec-2de1-4243-8862-14e34c5b3af6 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:49:10.787360 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66912dec-2de1-4243-8862-14e34c5b3af6 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:49:10.787630 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66912dec-2de1-4243-8862-14e34c5b3af6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:49:10.788376 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66912dec-2de1-4243-8862-14e34c5b3af6 None admin] RBAC: Adding query filter params (role.id=5dbcc3f2e7dd43dba994ee44cb11535e, scope.project.id=2486e73d493b40e18d9d988744993854, user.id=931f4e32c8764514b5efed31b0785be7) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:49:10.788724 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66912dec-2de1-4243-8862-14e34c5b3af6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:49:10.790330 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66912dec-2de1-4243-8862-14e34c5b3af6 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:49:10.796968 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 424/826] 10.222.0.17 () {56 vars in 1374 bytes} [Fri Oct 14 12:49:10 2022] GET /identity/v3/role_assignments?user.id=931f4e32c8764514b5efed31b0785be7&scope.project.id=2486e73d493b40e18d9d988744993854&role.id=5dbcc3f2e7dd43dba994ee44cb11535e => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:49:10.801415 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b661db8-56dc-431e-91e6-565b3a9e40d7 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:49:10.913727 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b661db8-56dc-431e-91e6-565b3a9e40d7 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:49:10.951838 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a029c23-4083-4a9a-bd94-82df5f19373a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:49:10.952934 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a029c23-4083-4a9a-bd94-82df5f19373a None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:49:10.952934 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a029c23-4083-4a9a-bd94-82df5f19373a None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:49:10.953099 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a029c23-4083-4a9a-bd94-82df5f19373a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:49:10.964696 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a029c23-4083-4a9a-bd94-82df5f19373a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 12:49:10.969971 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-8a029c23-4083-4a9a-bd94-82df5f19373a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 14 12:49:10.969971 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:49:10.969971 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:49:10.969971 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:49:10.969971 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:49:10.969971 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:49:10.969971 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:49:10.969971 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:49:10.969971 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:49:10.969971 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:49:10.969971 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:49:10.969971 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:49:10.969971 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 12:49:10.969971 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 12:49:10.969971 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 12:49:10.969971 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 12:49:10.971365 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 12:49:10.971365 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 12:49:10.971365 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 12:49:10.971365 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 12:49:10.971365 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:49:10.971365 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:49:10.971365 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:49:10.971365 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:49:10.971365 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:49:10.971365 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:49:10.971365 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:49:10.971365 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 14 12:49:10.971365 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:49:10.971365 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:49:10.971365 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:49:10.971365 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:49:10.972321 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:49:10.972321 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:49:10.972321 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:49:10.972321 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:49:10.972321 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 12:49:10.972321 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 12:49:10.972321 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 12:49:10.972321 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 12:49:10.972321 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 12:49:10.972321 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 12:49:10.972321 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 14 12:49:10.972321 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 14 12:49:10.972321 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 403/827] 10.222.0.17 () {56 vars in 1096 bytes} [Fri Oct 14 12:49:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:49:10.977225 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66912dec-2de1-4243-8862-14e34c5b3af6 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:49:11.101227 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66912dec-2de1-4243-8862-14e34c5b3af6 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:49:11.143037 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c09445-5001-4df4-9023-fde0c9cbde72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:49:11.143780 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c09445-5001-4df4-9023-fde0c9cbde72 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:49:11.144137 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c09445-5001-4df4-9023-fde0c9cbde72 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:49:11.144547 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c09445-5001-4df4-9023-fde0c9cbde72 None admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:49:11.145314 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c09445-5001-4df4-9023-fde0c9cbde72 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:49:11.145764 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c09445-5001-4df4-9023-fde0c9cbde72 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:49:11.147816 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c09445-5001-4df4-9023-fde0c9cbde72 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:49:11.161043 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 425/828] 10.222.0.17 () {56 vars in 1099 bytes} [Fri Oct 14 12:49:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:49:11.169152 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a029c23-4083-4a9a-bd94-82df5f19373a None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:49:11.225065 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:49:11.282921 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a029c23-4083-4a9a-bd94-82df5f19373a None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:49:11.321103 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfa943c-2287-4a02-85ed-407953709060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:49:11.321803 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfa943c-2287-4a02-85ed-407953709060 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:49:11.322084 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfa943c-2287-4a02-85ed-407953709060 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:49:11.322401 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfa943c-2287-4a02-85ed-407953709060 None admin] PATH_INFO: `/v3/users/05aec3c53d1e4b29bf9e082489d91a91` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:49:11.337597 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfa943c-2287-4a02-85ed-407953709060 None admin] RBAC: Authorizing `identity:get_user(user_id=05aec3c53d1e4b29bf9e082489d91a91)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:49:11.339268 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfa943c-2287-4a02-85ed-407953709060 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:49:11.340770 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 404/829] 10.222.0.17 () {56 vars in 1177 bytes} [Fri Oct 14 12:49:11 2022] GET /identity/v3/users/05aec3c53d1e4b29bf9e082489d91a91 => generated 285 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:49:11.349192 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c09445-5001-4df4-9023-fde0c9cbde72 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:49:11.379671 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:49:11.461948 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c09445-5001-4df4-9023-fde0c9cbde72 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:49:11.497527 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9207201-889f-4c2d-bac1-f32e8e210ae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:49:11.498191 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9207201-889f-4c2d-bac1-f32e8e210ae5 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:49:11.498460 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9207201-889f-4c2d-bac1-f32e8e210ae5 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:49:11.498732 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9207201-889f-4c2d-bac1-f32e8e210ae5 None admin] PATH_INFO: `/v3/projects/a12e194886f54fcb9782824ac5bf470d` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:49:11.499872 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9207201-889f-4c2d-bac1-f32e8e210ae5 None admin] RBAC: Authorizing `identity:get_project(project_id=a12e194886f54fcb9782824ac5bf470d)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:49:11.501533 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9207201-889f-4c2d-bac1-f32e8e210ae5 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:49:11.503205 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 426/830] 10.222.0.17 () {56 vars in 1186 bytes} [Fri Oct 14 12:49:11 2022] GET /identity/v3/projects/a12e194886f54fcb9782824ac5bf470d => generated 311 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:49:11.509279 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfa943c-2287-4a02-85ed-407953709060 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:49:11.629710 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfa943c-2287-4a02-85ed-407953709060 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:49:11.632870 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:49:11.671811 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c6045c-e2eb-4ade-8408-07b7c750e064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:49:11.672478 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c6045c-e2eb-4ade-8408-07b7c750e064 None admin] REQUEST_METHOD: `PUT` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:49:11.672945 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c6045c-e2eb-4ade-8408-07b7c750e064 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:49:11.673310 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c6045c-e2eb-4ade-8408-07b7c750e064 None admin] PATH_INFO: `/v3/projects/a12e194886f54fcb9782824ac5bf470d/users/05aec3c53d1e4b29bf9e082489d91a91/roles/7f6e29e390bc41f7a9af17659a2e95d1` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:49:11.675426 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c6045c-e2eb-4ade-8408-07b7c750e064 None admin] RBAC: Authorizing `identity:create_grant(project_id=a12e194886f54fcb9782824ac5bf470d, user_id=05aec3c53d1e4b29bf9e082489d91a91, role_id=7f6e29e390bc41f7a9af17659a2e95d1)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:49:11.676855 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c6045c-e2eb-4ade-8408-07b7c750e064 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:49:11.692999 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 405/831] 10.222.0.17 () {58 vars in 1439 bytes} [Fri Oct 14 12:49:11 2022] PUT /identity/v3/projects/a12e194886f54fcb9782824ac5bf470d/users/05aec3c53d1e4b29bf9e082489d91a91/roles/7f6e29e390bc41f7a9af17659a2e95d1 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 12:49:13.850762 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c95bb5-d560-40ed-bcfb-00efd5943a5b None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:49:13.851336 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c95bb5-d560-40ed-bcfb-00efd5943a5b None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:49:13.851336 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c95bb5-d560-40ed-bcfb-00efd5943a5b None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:49:13.852625 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 427/832] 10.222.0.17 () {54 vars in 927 bytes} [Fri Oct 14 12:49:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:49:13.857888 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5b7bd4-6bbb-42a5-af00-e8380cb3c02b None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:49:13.858559 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5b7bd4-6bbb-42a5-af00-e8380cb3c02b None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:49:13.858715 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5b7bd4-6bbb-42a5-af00-e8380cb3c02b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:49:13.877674 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-6f5b7bd4-6bbb-42a5-af00-e8380cb3c02b None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:49:13.878895 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-6f5b7bd4-6bbb-42a5-af00-e8380cb3c02b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:49:13.944645 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 406/833] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Oct 14 12:49:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 14 12:49:14.215174 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c95bb5-d560-40ed-bcfb-00efd5943a5b None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:49:14.304022 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:49:14.314963 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c95bb5-d560-40ed-bcfb-00efd5943a5b None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:49:14.347754 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f4972c-a32b-4c90-9ca4-740867b381de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:49:14.348360 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f4972c-a32b-4c90-9ca4-740867b381de None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:49:14.348636 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f4972c-a32b-4c90-9ca4-740867b381de None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:49:14.348908 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f4972c-a32b-4c90-9ca4-740867b381de None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:49:14.358849 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f4972c-a32b-4c90-9ca4-740867b381de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 12:49:14.364215 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-d8f4972c-a32b-4c90-9ca4-740867b381de None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 14 12:49:14.364215 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:49:14.364215 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:49:14.364215 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:49:14.364215 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:49:14.364215 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:49:14.364215 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:49:14.364215 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:49:14.364215 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:49:14.364215 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:49:14.364215 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:49:14.364215 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:49:14.364215 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 12:49:14.364215 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 12:49:14.364215 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 12:49:14.364215 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 12:49:14.365317 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 12:49:14.365317 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 12:49:14.365317 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 12:49:14.365317 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 12:49:14.365317 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:49:14.365317 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:49:14.365317 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:49:14.365317 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:49:14.365317 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:49:14.365317 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:49:14.365317 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:49:14.365317 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 14 12:49:14.365317 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:49:14.365317 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:49:14.365317 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:49:14.365317 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:49:14.366382 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:49:14.366382 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:49:14.366382 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:49:14.366382 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:49:14.366382 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 12:49:14.366382 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 12:49:14.366382 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 12:49:14.366382 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 12:49:14.366382 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 12:49:14.366382 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 12:49:14.366382 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 14 12:49:14.366382 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 14 12:49:14.366382 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 428/834] 10.222.0.17 () {56 vars in 1096 bytes} [Fri Oct 14 12:49:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:49:14.371306 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5b7bd4-6bbb-42a5-af00-e8380cb3c02b None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:49:14.459374 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:49:14.467222 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5b7bd4-6bbb-42a5-af00-e8380cb3c02b None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:49:14.499958 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b34f42-c451-487c-b23e-73d1c4e55b87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:49:14.500580 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b34f42-c451-487c-b23e-73d1c4e55b87 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:49:14.500858 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b34f42-c451-487c-b23e-73d1c4e55b87 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:49:14.501296 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b34f42-c451-487c-b23e-73d1c4e55b87 None admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:49:14.501946 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b34f42-c451-487c-b23e-73d1c4e55b87 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:49:14.502276 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b34f42-c451-487c-b23e-73d1c4e55b87 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:49:14.503627 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b34f42-c451-487c-b23e-73d1c4e55b87 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:49:14.511245 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 407/835] 10.222.0.17 () {56 vars in 1099 bytes} [Fri Oct 14 12:49:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:49:14.517671 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f4972c-a32b-4c90-9ca4-740867b381de None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:49:14.615947 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f4972c-a32b-4c90-9ca4-740867b381de None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:49:14.649675 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77287c98-8dfc-46fc-8f75-23cbbb1cb864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:49:14.650317 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77287c98-8dfc-46fc-8f75-23cbbb1cb864 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:49:14.650598 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77287c98-8dfc-46fc-8f75-23cbbb1cb864 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:49:14.650869 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77287c98-8dfc-46fc-8f75-23cbbb1cb864 None admin] PATH_INFO: `/v3/users/05aec3c53d1e4b29bf9e082489d91a91` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:49:14.651967 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77287c98-8dfc-46fc-8f75-23cbbb1cb864 None admin] RBAC: Authorizing `identity:get_user(user_id=05aec3c53d1e4b29bf9e082489d91a91)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:49:14.653399 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77287c98-8dfc-46fc-8f75-23cbbb1cb864 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:49:14.654986 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 429/836] 10.222.0.17 () {56 vars in 1177 bytes} [Fri Oct 14 12:49:14 2022] GET /identity/v3/users/05aec3c53d1e4b29bf9e082489d91a91 => generated 285 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:49:14.661564 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b34f42-c451-487c-b23e-73d1c4e55b87 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:49:14.757537 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b34f42-c451-487c-b23e-73d1c4e55b87 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:49:14.795290 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d574bf67-d1a5-4b26-8ff1-7cc2009fd6b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:49:14.795892 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d574bf67-d1a5-4b26-8ff1-7cc2009fd6b3 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:49:14.796167 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d574bf67-d1a5-4b26-8ff1-7cc2009fd6b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:49:14.796436 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d574bf67-d1a5-4b26-8ff1-7cc2009fd6b3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:49:14.824896 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:49:14.875237 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d574bf67-d1a5-4b26-8ff1-7cc2009fd6b3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:49:14.877450 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d574bf67-d1a5-4b26-8ff1-7cc2009fd6b3 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:49:14.980735 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 408/837] 10.222.0.17 () {58 vars in 1282 bytes} [Fri Oct 14 12:49:14 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 14 12:49:14.987248 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77287c98-8dfc-46fc-8f75-23cbbb1cb864 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:49:15.007977 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:49:15.091703 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77287c98-8dfc-46fc-8f75-23cbbb1cb864 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:49:15.126740 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7931df8-5ac2-4aea-b7de-47016bb2fbae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:49:15.127444 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7931df8-5ac2-4aea-b7de-47016bb2fbae None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:49:15.127719 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7931df8-5ac2-4aea-b7de-47016bb2fbae None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:49:15.127985 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7931df8-5ac2-4aea-b7de-47016bb2fbae None admin] PATH_INFO: `/v3/projects/a12e194886f54fcb9782824ac5bf470d` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:49:15.129107 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7931df8-5ac2-4aea-b7de-47016bb2fbae None admin] RBAC: Authorizing `identity:get_project(project_id=a12e194886f54fcb9782824ac5bf470d)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:49:15.130581 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7931df8-5ac2-4aea-b7de-47016bb2fbae None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:49:15.132196 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 430/838] 10.222.0.17 () {56 vars in 1186 bytes} [Fri Oct 14 12:49:14 2022] GET /identity/v3/projects/a12e194886f54fcb9782824ac5bf470d => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 12:49:15.138377 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d574bf67-d1a5-4b26-8ff1-7cc2009fd6b3 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:49:15.194434 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:49:15.239024 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d574bf67-d1a5-4b26-8ff1-7cc2009fd6b3 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:49:15.273265 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978fc249-4d3f-4b5e-80da-8a5c5829be8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:49:15.273781 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978fc249-4d3f-4b5e-80da-8a5c5829be8c None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:49:15.274059 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978fc249-4d3f-4b5e-80da-8a5c5829be8c None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:49:15.274361 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978fc249-4d3f-4b5e-80da-8a5c5829be8c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:49:15.275073 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978fc249-4d3f-4b5e-80da-8a5c5829be8c None admin] RBAC: Adding query filter params (role.id=7f6e29e390bc41f7a9af17659a2e95d1, scope.project.id=a12e194886f54fcb9782824ac5bf470d, user.id=05aec3c53d1e4b29bf9e082489d91a91) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:49:15.275404 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978fc249-4d3f-4b5e-80da-8a5c5829be8c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:49:15.276825 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978fc249-4d3f-4b5e-80da-8a5c5829be8c None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:49:15.283043 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 409/839] 10.222.0.17 () {56 vars in 1374 bytes} [Fri Oct 14 12:49:15 2022] GET /identity/v3/role_assignments?user.id=05aec3c53d1e4b29bf9e082489d91a91&scope.project.id=a12e194886f54fcb9782824ac5bf470d&role.id=7f6e29e390bc41f7a9af17659a2e95d1 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:49:17.470448 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57b504b-9dc3-41bb-b376-9d6d688ac33c None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:49:17.470952 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57b504b-9dc3-41bb-b376-9d6d688ac33c None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:49:17.470952 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57b504b-9dc3-41bb-b376-9d6d688ac33c None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:49:17.472246 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 431/840] 10.222.0.17 () {54 vars in 927 bytes} [Fri Oct 14 12:49:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:49:17.478084 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fbc6bd-2e10-4abc-a7ac-865341034932 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:49:17.478541 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fbc6bd-2e10-4abc-a7ac-865341034932 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:49:17.478657 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fbc6bd-2e10-4abc-a7ac-865341034932 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:49:17.497284 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-d7fbc6bd-2e10-4abc-a7ac-865341034932 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:49:17.498528 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-d7fbc6bd-2e10-4abc-a7ac-865341034932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:49:17.564302 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 410/841] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Oct 14 12:49:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 14 12:49:17.843474 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57b504b-9dc3-41bb-b376-9d6d688ac33c None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:49:17.930931 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:49:17.950737 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57b504b-9dc3-41bb-b376-9d6d688ac33c None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:49:17.984650 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e27cd67-4cec-4250-bbbe-5d1f15cbdeac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:49:17.985315 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e27cd67-4cec-4250-bbbe-5d1f15cbdeac None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:49:17.985592 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e27cd67-4cec-4250-bbbe-5d1f15cbdeac None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:49:17.985859 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e27cd67-4cec-4250-bbbe-5d1f15cbdeac None admin] PATH_INFO: `/v3/domains/default` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:49:17.986987 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e27cd67-4cec-4250-bbbe-5d1f15cbdeac None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:49:17.988424 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e27cd67-4cec-4250-bbbe-5d1f15cbdeac None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:49:17.989985 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 432/842] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Oct 14 12:49:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:49:17.995957 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fbc6bd-2e10-4abc-a7ac-865341034932 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:49:18.044858 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:49:18.094639 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fbc6bd-2e10-4abc-a7ac-865341034932 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:49:18.129134 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c57f168-dbae-4e3d-9359-9054412f122f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:49:18.129767 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c57f168-dbae-4e3d-9359-9054412f122f None admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:49:18.130022 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c57f168-dbae-4e3d-9359-9054412f122f None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:49:18.130330 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c57f168-dbae-4e3d-9359-9054412f122f None admin] PATH_INFO: `/v3/users` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:49:18.130993 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c57f168-dbae-4e3d-9359-9054412f122f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:49:18.132437 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c57f168-dbae-4e3d-9359-9054412f122f None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:49:18.154525 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 411/843] 10.222.0.17 () {60 vars in 1132 bytes} [Fri Oct 14 12:49:17 2022] POST /identity/v3/users => generated 286 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 12:49:20.392346 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3814bbcf-fd77-492f-b512-e6ca849820d7 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:49:20.392873 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3814bbcf-fd77-492f-b512-e6ca849820d7 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:49:20.392873 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3814bbcf-fd77-492f-b512-e6ca849820d7 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:49:20.394157 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 433/844] 10.222.0.17 () {54 vars in 927 bytes} [Fri Oct 14 12:49:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:49:20.399447 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d024836c-9bb4-4bb0-893f-b4c729211303 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:49:20.399857 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d024836c-9bb4-4bb0-893f-b4c729211303 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:49:20.400008 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d024836c-9bb4-4bb0-893f-b4c729211303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:49:20.418028 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-d024836c-9bb4-4bb0-893f-b4c729211303 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:49:20.419270 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-d024836c-9bb4-4bb0-893f-b4c729211303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:49:20.486701 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 412/845] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Oct 14 12:49:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 14 12:49:20.761356 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3814bbcf-fd77-492f-b512-e6ca849820d7 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:49:20.861875 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3814bbcf-fd77-492f-b512-e6ca849820d7 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:49:20.894573 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438c6aa1-71f5-48f0-a75d-6acf7a826e06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:49:20.895197 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438c6aa1-71f5-48f0-a75d-6acf7a826e06 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:49:20.895470 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438c6aa1-71f5-48f0-a75d-6acf7a826e06 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:49:20.895742 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438c6aa1-71f5-48f0-a75d-6acf7a826e06 None admin] PATH_INFO: `/v3/roles/251e12cde1564a10b367cc385e58b828` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:49:20.897117 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438c6aa1-71f5-48f0-a75d-6acf7a826e06 None admin] RBAC: Authorizing `identity:get_role(role_id=251e12cde1564a10b367cc385e58b828)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:49:20.898513 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438c6aa1-71f5-48f0-a75d-6acf7a826e06 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:49:20.900181 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 434/846] 10.222.0.17 () {56 vars in 1177 bytes} [Fri Oct 14 12:49:20 2022] GET /identity/v3/roles/251e12cde1564a10b367cc385e58b828 => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:49:20.906247 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d024836c-9bb4-4bb0-893f-b4c729211303 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:49:20.941295 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:49:21.007020 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d024836c-9bb4-4bb0-893f-b4c729211303 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:49:21.042938 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaafee9-2dee-4c4f-9cb7-244d156c12a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:49:21.043488 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaafee9-2dee-4c4f-9cb7-244d156c12a9 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:49:21.043767 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaafee9-2dee-4c4f-9cb7-244d156c12a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:49:21.044043 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaafee9-2dee-4c4f-9cb7-244d156c12a9 None admin] PATH_INFO: `/v3/users/bf3bc9954e664948a27198c18fba494a` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:49:21.058925 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaafee9-2dee-4c4f-9cb7-244d156c12a9 None admin] RBAC: Authorizing `identity:get_user(user_id=bf3bc9954e664948a27198c18fba494a)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:49:21.060404 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaafee9-2dee-4c4f-9cb7-244d156c12a9 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:49:21.062144 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 413/847] 10.222.0.17 () {56 vars in 1177 bytes} [Fri Oct 14 12:49:20 2022] GET /identity/v3/users/bf3bc9954e664948a27198c18fba494a => generated 286 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:49:21.068244 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438c6aa1-71f5-48f0-a75d-6acf7a826e06 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:49:21.093110 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:49:21.175214 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438c6aa1-71f5-48f0-a75d-6acf7a826e06 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:49:21.208475 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cd2b28-fd4a-4f67-891a-1393c8b2f9a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:49:21.209089 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cd2b28-fd4a-4f67-891a-1393c8b2f9a7 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:49:21.209367 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cd2b28-fd4a-4f67-891a-1393c8b2f9a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:49:21.209635 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cd2b28-fd4a-4f67-891a-1393c8b2f9a7 None admin] PATH_INFO: `/v3/projects/a12e194886f54fcb9782824ac5bf470d` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:49:21.210739 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cd2b28-fd4a-4f67-891a-1393c8b2f9a7 None admin] RBAC: Authorizing `identity:get_project(project_id=a12e194886f54fcb9782824ac5bf470d)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:49:21.212165 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cd2b28-fd4a-4f67-891a-1393c8b2f9a7 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:49:21.213759 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 435/848] 10.222.0.17 () {56 vars in 1186 bytes} [Fri Oct 14 12:49:21 2022] GET /identity/v3/projects/a12e194886f54fcb9782824ac5bf470d => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 12:49:21.220445 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaafee9-2dee-4c4f-9cb7-244d156c12a9 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:49:21.312985 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:49:21.319910 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaafee9-2dee-4c4f-9cb7-244d156c12a9 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:49:21.354261 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcdbe18-78a2-473a-8920-9ab4dc1dbf2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:49:21.354915 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcdbe18-78a2-473a-8920-9ab4dc1dbf2a None admin] REQUEST_METHOD: `PUT` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:49:21.355190 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcdbe18-78a2-473a-8920-9ab4dc1dbf2a None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:49:21.355461 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcdbe18-78a2-473a-8920-9ab4dc1dbf2a None admin] PATH_INFO: `/v3/projects/a12e194886f54fcb9782824ac5bf470d/users/bf3bc9954e664948a27198c18fba494a/roles/251e12cde1564a10b367cc385e58b828` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:49:21.357592 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcdbe18-78a2-473a-8920-9ab4dc1dbf2a None admin] RBAC: Authorizing `identity:create_grant(project_id=a12e194886f54fcb9782824ac5bf470d, user_id=bf3bc9954e664948a27198c18fba494a, role_id=251e12cde1564a10b367cc385e58b828)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:49:21.359308 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcdbe18-78a2-473a-8920-9ab4dc1dbf2a None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:49:21.373021 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 414/849] 10.222.0.17 () {58 vars in 1439 bytes} [Fri Oct 14 12:49:21 2022] PUT /identity/v3/projects/a12e194886f54fcb9782824ac5bf470d/users/bf3bc9954e664948a27198c18fba494a/roles/251e12cde1564a10b367cc385e58b828 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 12:49:23.508240 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3334430-452e-4422-a5b2-76fe0d73df49 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:49:23.508758 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3334430-452e-4422-a5b2-76fe0d73df49 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:49:23.508758 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3334430-452e-4422-a5b2-76fe0d73df49 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:49:23.510040 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 436/850] 10.222.0.17 () {54 vars in 927 bytes} [Fri Oct 14 12:49:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:49:23.515254 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6b77b9-6840-4a49-9857-b12343b6c0c5 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:49:23.515647 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6b77b9-6840-4a49-9857-b12343b6c0c5 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:49:23.516283 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6b77b9-6840-4a49-9857-b12343b6c0c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:49:23.534793 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-6f6b77b9-6840-4a49-9857-b12343b6c0c5 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:49:23.535996 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-6f6b77b9-6840-4a49-9857-b12343b6c0c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:49:23.603087 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 415/851] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Oct 14 12:49:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 14 12:49:23.880258 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3334430-452e-4422-a5b2-76fe0d73df49 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:49:23.979688 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:49:23.990588 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3334430-452e-4422-a5b2-76fe0d73df49 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:49:24.024737 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8d12e4-56cc-4fb2-a5d7-39e154ae13c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:49:24.025356 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8d12e4-56cc-4fb2-a5d7-39e154ae13c4 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:49:24.025643 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8d12e4-56cc-4fb2-a5d7-39e154ae13c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:49:24.025917 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8d12e4-56cc-4fb2-a5d7-39e154ae13c4 None admin] PATH_INFO: `/v3/roles/251e12cde1564a10b367cc385e58b828` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:49:24.027392 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8d12e4-56cc-4fb2-a5d7-39e154ae13c4 None admin] RBAC: Authorizing `identity:get_role(role_id=251e12cde1564a10b367cc385e58b828)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:49:24.028765 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8d12e4-56cc-4fb2-a5d7-39e154ae13c4 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:49:24.030077 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 437/852] 10.222.0.17 () {56 vars in 1177 bytes} [Fri Oct 14 12:49:23 2022] GET /identity/v3/roles/251e12cde1564a10b367cc385e58b828 => generated 223 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:49:24.035975 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6b77b9-6840-4a49-9857-b12343b6c0c5 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:49:24.118030 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:49:24.134508 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6b77b9-6840-4a49-9857-b12343b6c0c5 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:49:24.166647 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5662d81d-460d-4bdf-a947-51606a30cce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:49:24.167287 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5662d81d-460d-4bdf-a947-51606a30cce7 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:49:24.167559 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5662d81d-460d-4bdf-a947-51606a30cce7 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:49:24.167825 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5662d81d-460d-4bdf-a947-51606a30cce7 None admin] PATH_INFO: `/v3/users/bf3bc9954e664948a27198c18fba494a` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:49:24.168920 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5662d81d-460d-4bdf-a947-51606a30cce7 None admin] RBAC: Authorizing `identity:get_user(user_id=bf3bc9954e664948a27198c18fba494a)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:49:24.170367 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5662d81d-460d-4bdf-a947-51606a30cce7 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:49:24.171899 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 416/853] 10.222.0.17 () {56 vars in 1177 bytes} [Fri Oct 14 12:49:24 2022] GET /identity/v3/users/bf3bc9954e664948a27198c18fba494a => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:49:24.177936 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8d12e4-56cc-4fb2-a5d7-39e154ae13c4 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:49:24.277361 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8d12e4-56cc-4fb2-a5d7-39e154ae13c4 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:49:24.309575 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748ff6c1-877b-42f5-9dcd-b8bd3219b5dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:49:24.310198 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748ff6c1-877b-42f5-9dcd-b8bd3219b5dc None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:49:24.310478 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748ff6c1-877b-42f5-9dcd-b8bd3219b5dc None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:49:24.310749 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748ff6c1-877b-42f5-9dcd-b8bd3219b5dc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:49:24.336570 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:49:24.376819 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748ff6c1-877b-42f5-9dcd-b8bd3219b5dc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:49:24.378290 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748ff6c1-877b-42f5-9dcd-b8bd3219b5dc None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:49:24.471114 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 438/854] 10.222.0.17 () {58 vars in 1282 bytes} [Fri Oct 14 12:49:24 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 14 12:49:24.477078 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5662d81d-460d-4bdf-a947-51606a30cce7 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:49:24.573754 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5662d81d-460d-4bdf-a947-51606a30cce7 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:49:24.608699 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbf8f68-c583-4497-a8dd-17dbf47257e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:49:24.609370 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbf8f68-c583-4497-a8dd-17dbf47257e8 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:49:24.610364 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbf8f68-c583-4497-a8dd-17dbf47257e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:49:24.610669 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbf8f68-c583-4497-a8dd-17dbf47257e8 None admin] PATH_INFO: `/v3/projects/a12e194886f54fcb9782824ac5bf470d` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:49:24.611839 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbf8f68-c583-4497-a8dd-17dbf47257e8 None admin] RBAC: Authorizing `identity:get_project(project_id=a12e194886f54fcb9782824ac5bf470d)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:49:24.613309 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbf8f68-c583-4497-a8dd-17dbf47257e8 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:49:24.614998 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 417/855] 10.222.0.17 () {56 vars in 1186 bytes} [Fri Oct 14 12:49:24 2022] GET /identity/v3/projects/a12e194886f54fcb9782824ac5bf470d => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:49:24.621481 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748ff6c1-877b-42f5-9dcd-b8bd3219b5dc None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:49:24.682433 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:49:24.727892 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748ff6c1-877b-42f5-9dcd-b8bd3219b5dc None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:49:24.766047 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215e8431-ebf8-4369-8ca8-c0565044234e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:49:24.766976 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215e8431-ebf8-4369-8ca8-c0565044234e None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:49:24.767256 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215e8431-ebf8-4369-8ca8-c0565044234e None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:49:24.767533 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215e8431-ebf8-4369-8ca8-c0565044234e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:49:24.768262 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215e8431-ebf8-4369-8ca8-c0565044234e None admin] RBAC: Adding query filter params (role.id=251e12cde1564a10b367cc385e58b828, scope.project.id=a12e194886f54fcb9782824ac5bf470d, user.id=bf3bc9954e664948a27198c18fba494a) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:49:24.768568 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215e8431-ebf8-4369-8ca8-c0565044234e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:49:24.770010 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215e8431-ebf8-4369-8ca8-c0565044234e None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:49:24.776258 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 439/856] 10.222.0.17 () {56 vars in 1374 bytes} [Fri Oct 14 12:49:24 2022] GET /identity/v3/role_assignments?user.id=bf3bc9954e664948a27198c18fba494a&scope.project.id=a12e194886f54fcb9782824ac5bf470d&role.id=251e12cde1564a10b367cc385e58b828 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:49:26.961464 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19538bd3-7b7b-45b7-87b8-9603dddd7dda None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:49:26.962021 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19538bd3-7b7b-45b7-87b8-9603dddd7dda None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:49:26.962021 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19538bd3-7b7b-45b7-87b8-9603dddd7dda None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:49:26.963359 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 418/857] 10.222.0.17 () {54 vars in 927 bytes} [Fri Oct 14 12:49:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:49:26.968613 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1785270-982b-4205-b01a-5be983ec6e9b None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:49:26.969060 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1785270-982b-4205-b01a-5be983ec6e9b None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:49:26.969311 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1785270-982b-4205-b01a-5be983ec6e9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:49:26.987414 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-a1785270-982b-4205-b01a-5be983ec6e9b None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:49:26.988598 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-a1785270-982b-4205-b01a-5be983ec6e9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:49:27.053342 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 440/858] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Oct 14 12:49:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 14 12:49:27.326625 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19538bd3-7b7b-45b7-87b8-9603dddd7dda None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:49:27.349950 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:49:27.432786 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19538bd3-7b7b-45b7-87b8-9603dddd7dda None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:49:27.465861 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a624f1-82fb-4fbf-9895-9ea9c7ef60bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:49:27.466509 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a624f1-82fb-4fbf-9895-9ea9c7ef60bc None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:49:27.466784 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a624f1-82fb-4fbf-9895-9ea9c7ef60bc None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:49:27.467052 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a624f1-82fb-4fbf-9895-9ea9c7ef60bc None admin] PATH_INFO: `/v3/domains/default` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:49:27.468162 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a624f1-82fb-4fbf-9895-9ea9c7ef60bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:49:27.470399 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a624f1-82fb-4fbf-9895-9ea9c7ef60bc None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:49:27.471969 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 419/859] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Oct 14 12:49:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:49:27.477796 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1785270-982b-4205-b01a-5be983ec6e9b None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:49:27.529901 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:49:27.576251 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1785270-982b-4205-b01a-5be983ec6e9b None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:49:27.612680 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d49c3d1-b254-44ed-82c7-bab2cf38cafd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:49:27.613285 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d49c3d1-b254-44ed-82c7-bab2cf38cafd None admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:49:27.613559 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d49c3d1-b254-44ed-82c7-bab2cf38cafd None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:49:27.613825 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d49c3d1-b254-44ed-82c7-bab2cf38cafd None admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:49:27.614507 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d49c3d1-b254-44ed-82c7-bab2cf38cafd None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:49:27.615931 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d49c3d1-b254-44ed-82c7-bab2cf38cafd None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:49:27.642911 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 441/860] 10.222.0.17 () {60 vars in 1141 bytes} [Fri Oct 14 12:49:27 2022] POST /identity/v3/projects => generated 311 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 12:49:29.833439 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ad0073-92dd-4eeb-a652-dcee1ebe7c7c None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:49:29.834108 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ad0073-92dd-4eeb-a652-dcee1ebe7c7c None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:49:29.834108 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ad0073-92dd-4eeb-a652-dcee1ebe7c7c None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:49:29.835945 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 420/861] 10.222.0.17 () {54 vars in 927 bytes} [Fri Oct 14 12:49:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:49:29.842289 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7878c52-384e-43f3-a59f-fe27d5c4cf5c None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:49:29.842737 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7878c52-384e-43f3-a59f-fe27d5c4cf5c None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:49:29.842836 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7878c52-384e-43f3-a59f-fe27d5c4cf5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:49:29.862552 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-a7878c52-384e-43f3-a59f-fe27d5c4cf5c None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:49:29.863782 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-a7878c52-384e-43f3-a59f-fe27d5c4cf5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:49:29.929592 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 442/862] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Oct 14 12:49:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 14 12:49:30.204337 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ad0073-92dd-4eeb-a652-dcee1ebe7c7c None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:49:30.292305 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:49:30.305618 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ad0073-92dd-4eeb-a652-dcee1ebe7c7c None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:49:30.339611 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41afc6c-b092-4a84-9d8c-0d92d8b73d59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:49:30.340229 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41afc6c-b092-4a84-9d8c-0d92d8b73d59 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:49:30.340503 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41afc6c-b092-4a84-9d8c-0d92d8b73d59 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:49:30.340771 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41afc6c-b092-4a84-9d8c-0d92d8b73d59 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:49:30.341865 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41afc6c-b092-4a84-9d8c-0d92d8b73d59 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:49:30.343319 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41afc6c-b092-4a84-9d8c-0d92d8b73d59 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:49:30.345462 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 421/863] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Oct 14 12:49:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:49:30.351269 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7878c52-384e-43f3-a59f-fe27d5c4cf5c None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:49:30.383773 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:49:30.450094 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7878c52-384e-43f3-a59f-fe27d5c4cf5c None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:49:30.484378 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8873e83-c31a-4892-a0d3-e242d922ecea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:49:30.484971 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8873e83-c31a-4892-a0d3-e242d922ecea None admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:49:30.485246 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8873e83-c31a-4892-a0d3-e242d922ecea None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:49:30.485512 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8873e83-c31a-4892-a0d3-e242d922ecea None admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:49:30.486185 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8873e83-c31a-4892-a0d3-e242d922ecea None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:49:30.487617 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8873e83-c31a-4892-a0d3-e242d922ecea None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:49:30.509757 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 443/864] 10.222.0.17 () {60 vars in 1132 bytes} [Fri Oct 14 12:49:30 2022] POST /identity/v3/users => generated 286 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 12:49:32.697275 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4e752b-814d-40e7-8e31-ba7f4eab55d6 None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:49:32.697851 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4e752b-814d-40e7-8e31-ba7f4eab55d6 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:49:32.697851 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4e752b-814d-40e7-8e31-ba7f4eab55d6 None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:49:32.699163 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 422/865] 10.222.0.17 () {54 vars in 927 bytes} [Fri Oct 14 12:49:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:49:32.704728 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7323bbf7-3713-462d-abd8-1beb050b3ab9 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:49:32.705186 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7323bbf7-3713-462d-abd8-1beb050b3ab9 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:49:32.705286 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7323bbf7-3713-462d-abd8-1beb050b3ab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:49:32.723462 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-7323bbf7-3713-462d-abd8-1beb050b3ab9 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:49:32.724651 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-7323bbf7-3713-462d-abd8-1beb050b3ab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:49:32.792698 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 444/866] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Oct 14 12:49:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 14 12:49:33.064876 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4e752b-814d-40e7-8e31-ba7f4eab55d6 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:49:33.166229 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4e752b-814d-40e7-8e31-ba7f4eab55d6 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:49:33.200318 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dee25b-95bc-4118-bf1d-553e7f69316b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:49:33.200945 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dee25b-95bc-4118-bf1d-553e7f69316b None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:49:33.201215 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dee25b-95bc-4118-bf1d-553e7f69316b None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:49:33.201490 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dee25b-95bc-4118-bf1d-553e7f69316b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:49:33.212312 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dee25b-95bc-4118-bf1d-553e7f69316b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 12:49:33.217137 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-55dee25b-95bc-4118-bf1d-553e7f69316b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 14 12:49:33.217137 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:49:33.217137 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:49:33.217137 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:49:33.217137 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:49:33.217137 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:49:33.217137 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:49:33.217137 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:49:33.217137 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:49:33.217137 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:49:33.217137 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:49:33.217137 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:49:33.217137 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 12:49:33.217137 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 12:49:33.217137 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 12:49:33.217137 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 12:49:33.218382 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 12:49:33.218382 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 12:49:33.218382 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 12:49:33.218382 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 12:49:33.218382 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:49:33.218382 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:49:33.218382 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:49:33.218382 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:49:33.218382 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:49:33.218382 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:49:33.218382 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:49:33.218382 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 14 12:49:33.218382 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:49:33.218382 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:49:33.218382 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:49:33.218382 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:49:33.219596 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:49:33.219596 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:49:33.219596 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:49:33.219596 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:49:33.219596 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 12:49:33.219596 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 12:49:33.219596 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 12:49:33.219596 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 12:49:33.219596 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 12:49:33.219596 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 12:49:33.219596 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 14 12:49:33.219596 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 14 12:49:33.219596 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 423/867] 10.222.0.17 () {56 vars in 1096 bytes} [Fri Oct 14 12:49:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:49:33.224584 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7323bbf7-3713-462d-abd8-1beb050b3ab9 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:49:33.246696 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:49:33.325950 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7323bbf7-3713-462d-abd8-1beb050b3ab9 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:49:33.360908 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3d3921-fd95-49b4-ab3e-68d5bbb8b6ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:49:33.361511 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3d3921-fd95-49b4-ab3e-68d5bbb8b6ba None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:49:33.361786 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3d3921-fd95-49b4-ab3e-68d5bbb8b6ba None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:49:33.362055 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3d3921-fd95-49b4-ab3e-68d5bbb8b6ba None admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:49:33.362750 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3d3921-fd95-49b4-ab3e-68d5bbb8b6ba None admin] RBAC: Adding query filter params (name=admin) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:49:33.363053 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3d3921-fd95-49b4-ab3e-68d5bbb8b6ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:49:33.364429 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3d3921-fd95-49b4-ab3e-68d5bbb8b6ba None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:49:33.372819 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 445/868] 10.222.0.17 () {56 vars in 1099 bytes} [Fri Oct 14 12:49:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:49:33.379257 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dee25b-95bc-4118-bf1d-553e7f69316b None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:49:33.397798 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:49:33.483782 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dee25b-95bc-4118-bf1d-553e7f69316b None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:49:33.517997 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5b8925-5594-42f0-bdb7-28fa0d1fc4ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:49:33.518644 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5b8925-5594-42f0-bdb7-28fa0d1fc4ca None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:49:33.518920 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5b8925-5594-42f0-bdb7-28fa0d1fc4ca None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:49:33.519191 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5b8925-5594-42f0-bdb7-28fa0d1fc4ca None admin] PATH_INFO: `/v3/users/0c190557f7154447a6cd32f48dd1cc53` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:49:33.532449 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5b8925-5594-42f0-bdb7-28fa0d1fc4ca None admin] RBAC: Authorizing `identity:get_user(user_id=0c190557f7154447a6cd32f48dd1cc53)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:49:33.533903 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5b8925-5594-42f0-bdb7-28fa0d1fc4ca None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:49:33.535586 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 424/869] 10.222.0.17 () {56 vars in 1177 bytes} [Fri Oct 14 12:49:33 2022] GET /identity/v3/users/0c190557f7154447a6cd32f48dd1cc53 => generated 286 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:49:33.541464 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3d3921-fd95-49b4-ab3e-68d5bbb8b6ba None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:49:33.624776 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:49:33.642977 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3d3921-fd95-49b4-ab3e-68d5bbb8b6ba None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:49:33.677659 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c316020-f18d-47d0-bca6-ea61858e4190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:49:33.678321 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c316020-f18d-47d0-bca6-ea61858e4190 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:49:33.678604 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c316020-f18d-47d0-bca6-ea61858e4190 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:49:33.678878 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c316020-f18d-47d0-bca6-ea61858e4190 None admin] PATH_INFO: `/v3/projects/f84322486e3143d9aa1c00e6f3213469` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:49:33.680465 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c316020-f18d-47d0-bca6-ea61858e4190 None admin] RBAC: Authorizing `identity:get_project(project_id=f84322486e3143d9aa1c00e6f3213469)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:49:33.681915 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c316020-f18d-47d0-bca6-ea61858e4190 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:49:33.683590 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 446/870] 10.222.0.17 () {56 vars in 1186 bytes} [Fri Oct 14 12:49:33 2022] GET /identity/v3/projects/f84322486e3143d9aa1c00e6f3213469 => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:49:33.689889 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5b8925-5594-42f0-bdb7-28fa0d1fc4ca None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:49:33.764567 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:49:33.790010 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5b8925-5594-42f0-bdb7-28fa0d1fc4ca None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:49:33.830442 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d6352f-109c-4e2c-9691-4c9096fe7b7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:49:33.831096 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d6352f-109c-4e2c-9691-4c9096fe7b7d None admin] REQUEST_METHOD: `PUT` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:49:33.831374 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d6352f-109c-4e2c-9691-4c9096fe7b7d None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:49:33.831651 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d6352f-109c-4e2c-9691-4c9096fe7b7d None admin] PATH_INFO: `/v3/projects/f84322486e3143d9aa1c00e6f3213469/users/0c190557f7154447a6cd32f48dd1cc53/roles/7f6e29e390bc41f7a9af17659a2e95d1` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:49:33.833583 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d6352f-109c-4e2c-9691-4c9096fe7b7d None admin] RBAC: Authorizing `identity:create_grant(project_id=f84322486e3143d9aa1c00e6f3213469, user_id=0c190557f7154447a6cd32f48dd1cc53, role_id=7f6e29e390bc41f7a9af17659a2e95d1)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:49:33.835026 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d6352f-109c-4e2c-9691-4c9096fe7b7d None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:49:33.849049 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 425/871] 10.222.0.17 () {58 vars in 1439 bytes} [Fri Oct 14 12:49:33 2022] PUT /identity/v3/projects/f84322486e3143d9aa1c00e6f3213469/users/0c190557f7154447a6cd32f48dd1cc53/roles/7f6e29e390bc41f7a9af17659a2e95d1 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 12:49:36.011256 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32edcd78-cca9-4ce2-8404-cd94aeb8186b None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:49:36.011821 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32edcd78-cca9-4ce2-8404-cd94aeb8186b None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:49:36.011821 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32edcd78-cca9-4ce2-8404-cd94aeb8186b None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:49:36.013128 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 447/872] 10.222.0.17 () {54 vars in 927 bytes} [Fri Oct 14 12:49:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:49:36.018872 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e187cb4-dff3-4e0a-a4b0-db735b968bb4 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:49:36.019370 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e187cb4-dff3-4e0a-a4b0-db735b968bb4 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:49:36.019471 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e187cb4-dff3-4e0a-a4b0-db735b968bb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:49:36.038788 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-7e187cb4-dff3-4e0a-a4b0-db735b968bb4 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:49:36.040000 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-7e187cb4-dff3-4e0a-a4b0-db735b968bb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:49:36.111183 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 426/873] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Oct 14 12:49:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 14 12:49:36.378472 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32edcd78-cca9-4ce2-8404-cd94aeb8186b None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:49:36.481098 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32edcd78-cca9-4ce2-8404-cd94aeb8186b None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:49:36.516654 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10cdba4-f018-4497-93e2-f443cc3608b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:49:36.517284 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10cdba4-f018-4497-93e2-f443cc3608b6 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:49:36.517564 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10cdba4-f018-4497-93e2-f443cc3608b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:49:36.517837 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10cdba4-f018-4497-93e2-f443cc3608b6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:49:36.528301 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10cdba4-f018-4497-93e2-f443cc3608b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 12:49:36.533270 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-e10cdba4-f018-4497-93e2-f443cc3608b6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 14 12:49:36.533270 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:49:36.533270 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:49:36.533270 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:49:36.533270 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:49:36.533270 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:49:36.533270 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:49:36.533270 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:49:36.533270 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:49:36.533270 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:49:36.533270 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:49:36.533270 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:49:36.533270 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 12:49:36.533270 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 12:49:36.533270 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 12:49:36.533270 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 12:49:36.534398 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 12:49:36.534398 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 12:49:36.534398 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 12:49:36.534398 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 12:49:36.534398 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:49:36.534398 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:49:36.534398 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:49:36.534398 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:49:36.534398 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:49:36.534398 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:49:36.534398 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:49:36.534398 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 14 12:49:36.534398 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:49:36.534398 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:49:36.534398 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:49:36.534398 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:49:36.535317 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:49:36.535317 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:49:36.535317 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:49:36.535317 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:49:36.535317 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 12:49:36.535317 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 12:49:36.535317 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 12:49:36.535317 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 12:49:36.535317 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 12:49:36.535317 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 12:49:36.535317 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 14 12:49:36.535317 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 14 12:49:36.535317 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 448/874] 10.222.0.17 () {56 vars in 1096 bytes} [Fri Oct 14 12:49:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:49:36.540762 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e187cb4-dff3-4e0a-a4b0-db735b968bb4 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:49:36.603543 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:49:36.647198 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e187cb4-dff3-4e0a-a4b0-db735b968bb4 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:49:36.684421 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c01c41-2eb8-42b4-83fc-b1365bb9d09f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:49:36.685055 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c01c41-2eb8-42b4-83fc-b1365bb9d09f None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:49:36.685334 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c01c41-2eb8-42b4-83fc-b1365bb9d09f None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:49:36.685607 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c01c41-2eb8-42b4-83fc-b1365bb9d09f None admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:49:36.686293 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c01c41-2eb8-42b4-83fc-b1365bb9d09f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:49:36.686599 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c01c41-2eb8-42b4-83fc-b1365bb9d09f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:49:36.688016 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c01c41-2eb8-42b4-83fc-b1365bb9d09f None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:49:36.696180 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 427/875] 10.222.0.17 () {56 vars in 1099 bytes} [Fri Oct 14 12:49:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:49:36.702251 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10cdba4-f018-4497-93e2-f443cc3608b6 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:49:36.715909 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:49:36.811498 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10cdba4-f018-4497-93e2-f443cc3608b6 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:49:36.845809 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947041c1-8af8-42f2-9710-375ca6929372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:49:36.846447 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947041c1-8af8-42f2-9710-375ca6929372 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:49:36.846722 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947041c1-8af8-42f2-9710-375ca6929372 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:49:36.846987 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947041c1-8af8-42f2-9710-375ca6929372 None admin] PATH_INFO: `/v3/users/0c190557f7154447a6cd32f48dd1cc53` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:49:36.848084 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947041c1-8af8-42f2-9710-375ca6929372 None admin] RBAC: Authorizing `identity:get_user(user_id=0c190557f7154447a6cd32f48dd1cc53)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:49:36.849508 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947041c1-8af8-42f2-9710-375ca6929372 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:49:36.852154 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 449/876] 10.222.0.17 () {56 vars in 1177 bytes} [Fri Oct 14 12:49:36 2022] GET /identity/v3/users/0c190557f7154447a6cd32f48dd1cc53 => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:49:36.857022 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c01c41-2eb8-42b4-83fc-b1365bb9d09f None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:49:36.962280 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c01c41-2eb8-42b4-83fc-b1365bb9d09f None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:49:36.990083 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:49:36.999566 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442acd7c-cd0c-46ac-b63a-752d48c30c2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:49:37.000248 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442acd7c-cd0c-46ac-b63a-752d48c30c2f None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:49:37.000530 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442acd7c-cd0c-46ac-b63a-752d48c30c2f None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:49:37.000806 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442acd7c-cd0c-46ac-b63a-752d48c30c2f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:49:37.070269 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442acd7c-cd0c-46ac-b63a-752d48c30c2f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:49:37.071736 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442acd7c-cd0c-46ac-b63a-752d48c30c2f None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:49:37.170548 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 428/877] 10.222.0.17 () {58 vars in 1282 bytes} [Fri Oct 14 12:49:36 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 14 12:49:37.176584 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947041c1-8af8-42f2-9710-375ca6929372 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:49:37.255416 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:49:37.277382 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947041c1-8af8-42f2-9710-375ca6929372 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:49:37.311287 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48856088-0daa-424c-82c6-30a65087135b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:49:37.311917 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48856088-0daa-424c-82c6-30a65087135b None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:49:37.312719 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48856088-0daa-424c-82c6-30a65087135b None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:49:37.312994 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48856088-0daa-424c-82c6-30a65087135b None admin] PATH_INFO: `/v3/projects/f84322486e3143d9aa1c00e6f3213469` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:49:37.314239 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48856088-0daa-424c-82c6-30a65087135b None admin] RBAC: Authorizing `identity:get_project(project_id=f84322486e3143d9aa1c00e6f3213469)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:49:37.315685 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48856088-0daa-424c-82c6-30a65087135b None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:49:37.317315 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 450/878] 10.222.0.17 () {56 vars in 1186 bytes} [Fri Oct 14 12:49:37 2022] GET /identity/v3/projects/f84322486e3143d9aa1c00e6f3213469 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:49:37.323657 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442acd7c-cd0c-46ac-b63a-752d48c30c2f None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:49:37.351295 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:49:37.423797 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442acd7c-cd0c-46ac-b63a-752d48c30c2f None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:49:37.457896 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911d2620-0014-4aba-af39-c552f582e329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:49:37.458526 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911d2620-0014-4aba-af39-c552f582e329 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:49:37.458799 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911d2620-0014-4aba-af39-c552f582e329 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:49:37.459064 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911d2620-0014-4aba-af39-c552f582e329 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:49:37.459782 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911d2620-0014-4aba-af39-c552f582e329 None admin] RBAC: Adding query filter params (role.id=7f6e29e390bc41f7a9af17659a2e95d1, scope.project.id=f84322486e3143d9aa1c00e6f3213469, user.id=0c190557f7154447a6cd32f48dd1cc53) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:49:37.460087 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911d2620-0014-4aba-af39-c552f582e329 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:49:37.461517 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911d2620-0014-4aba-af39-c552f582e329 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:49:37.467362 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 429/879] 10.222.0.17 () {56 vars in 1374 bytes} [Fri Oct 14 12:49:37 2022] GET /identity/v3/role_assignments?user.id=0c190557f7154447a6cd32f48dd1cc53&scope.project.id=f84322486e3143d9aa1c00e6f3213469&role.id=7f6e29e390bc41f7a9af17659a2e95d1 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:49:39.666766 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc633517-10df-4cd3-9be2-4523e59dc9cd None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:49:39.667589 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc633517-10df-4cd3-9be2-4523e59dc9cd None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:49:39.667762 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc633517-10df-4cd3-9be2-4523e59dc9cd None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:49:39.669115 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 451/880] 10.222.0.17 () {54 vars in 927 bytes} [Fri Oct 14 12:49:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:49:39.674774 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f12d9d-5f5e-41a3-aa29-b791eef1b60a None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:49:39.675243 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f12d9d-5f5e-41a3-aa29-b791eef1b60a None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:49:39.675334 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f12d9d-5f5e-41a3-aa29-b791eef1b60a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:49:39.694415 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-46f12d9d-5f5e-41a3-aa29-b791eef1b60a None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:49:39.695619 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-46f12d9d-5f5e-41a3-aa29-b791eef1b60a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:49:39.764469 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 430/881] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Oct 14 12:49:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 14 12:49:40.051782 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc633517-10df-4cd3-9be2-4523e59dc9cd None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:49:40.160323 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc633517-10df-4cd3-9be2-4523e59dc9cd None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:49:40.194708 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8032a3-01ac-4757-a723-f3bbe4b9cddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:49:40.195303 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8032a3-01ac-4757-a723-f3bbe4b9cddd None admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:49:40.195578 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8032a3-01ac-4757-a723-f3bbe4b9cddd None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:49:40.195847 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8032a3-01ac-4757-a723-f3bbe4b9cddd None admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:49:40.196521 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8032a3-01ac-4757-a723-f3bbe4b9cddd None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:49:40.197892 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8032a3-01ac-4757-a723-f3bbe4b9cddd None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:49:40.214903 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 452/882] 10.222.0.17 () {60 vars in 1138 bytes} [Fri Oct 14 12:49:40 2022] POST /identity/v3/domains => generated 267 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 12:49:42.424779 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b67f7a1-dd42-4a93-ad20-3abe4e223713 None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:49:42.425308 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b67f7a1-dd42-4a93-ad20-3abe4e223713 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:49:42.425308 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b67f7a1-dd42-4a93-ad20-3abe4e223713 None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:49:42.428492 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 431/883] 10.222.0.17 () {54 vars in 927 bytes} [Fri Oct 14 12:49:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:49:42.434181 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e43fb34-5da6-4971-a1c7-1e780d981287 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:49:42.434646 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e43fb34-5da6-4971-a1c7-1e780d981287 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:49:42.434760 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e43fb34-5da6-4971-a1c7-1e780d981287 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:49:42.447699 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:49:42.455109 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-1e43fb34-5da6-4971-a1c7-1e780d981287 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:49:42.456499 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-1e43fb34-5da6-4971-a1c7-1e780d981287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:49:42.526016 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 453/884] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Oct 14 12:49:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 14 12:49:42.799278 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b67f7a1-dd42-4a93-ad20-3abe4e223713 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:49:42.821556 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:49:42.907387 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b67f7a1-dd42-4a93-ad20-3abe4e223713 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:49:42.943364 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432c5445-b1a1-4d0f-b00e-a92625d2e45c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:49:42.943998 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432c5445-b1a1-4d0f-b00e-a92625d2e45c None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:49:42.944277 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432c5445-b1a1-4d0f-b00e-a92625d2e45c None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:49:42.944551 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432c5445-b1a1-4d0f-b00e-a92625d2e45c None admin] PATH_INFO: `/v3/domains/819ac218d2ab447194636b0623447fa7` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:49:42.956143 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432c5445-b1a1-4d0f-b00e-a92625d2e45c None admin] RBAC: Authorizing `identity:get_domain(domain_id=819ac218d2ab447194636b0623447fa7)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:49:42.957613 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432c5445-b1a1-4d0f-b00e-a92625d2e45c None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:49:42.959322 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 432/885] 10.222.0.17 () {56 vars in 1183 bytes} [Fri Oct 14 12:49:42 2022] GET /identity/v3/domains/819ac218d2ab447194636b0623447fa7 => generated 267 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:49:42.965296 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e43fb34-5da6-4971-a1c7-1e780d981287 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:49:43.072747 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e43fb34-5da6-4971-a1c7-1e780d981287 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:49:43.113665 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8df052-9919-4bfb-8bd7-81cfbc07afb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:49:43.114406 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8df052-9919-4bfb-8bd7-81cfbc07afb9 None admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:49:43.114610 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8df052-9919-4bfb-8bd7-81cfbc07afb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:49:43.114882 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8df052-9919-4bfb-8bd7-81cfbc07afb9 None admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:49:43.115549 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8df052-9919-4bfb-8bd7-81cfbc07afb9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:49:43.116994 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8df052-9919-4bfb-8bd7-81cfbc07afb9 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:49:43.122819 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:49:43.150370 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 454/886] 10.222.0.17 () {60 vars in 1141 bytes} [Fri Oct 14 12:49:42 2022] POST /identity/v3/projects => generated 361 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 12:49:45.408154 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7965213d-6bd3-4ea9-8caa-9f92c4e63786 None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:49:45.408665 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7965213d-6bd3-4ea9-8caa-9f92c4e63786 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:49:45.408665 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7965213d-6bd3-4ea9-8caa-9f92c4e63786 None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:49:45.409934 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 433/887] 10.222.0.17 () {54 vars in 927 bytes} [Fri Oct 14 12:49:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:49:45.415540 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b07ca93-943d-4d90-aa8c-fc0b85bb0489 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:49:45.416043 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b07ca93-943d-4d90-aa8c-fc0b85bb0489 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:49:45.416138 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b07ca93-943d-4d90-aa8c-fc0b85bb0489 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:49:45.434491 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-1b07ca93-943d-4d90-aa8c-fc0b85bb0489 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:49:45.435688 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-1b07ca93-943d-4d90-aa8c-fc0b85bb0489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:49:45.504489 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 455/888] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Oct 14 12:49:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 14 12:49:45.775359 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7965213d-6bd3-4ea9-8caa-9f92c4e63786 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:49:45.857656 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:49:45.885576 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7965213d-6bd3-4ea9-8caa-9f92c4e63786 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:49:45.920902 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba944ae3-0c9c-47c4-83d8-dd4ae38cbe66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:49:45.921781 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba944ae3-0c9c-47c4-83d8-dd4ae38cbe66 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:49:45.922064 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba944ae3-0c9c-47c4-83d8-dd4ae38cbe66 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:49:45.922366 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba944ae3-0c9c-47c4-83d8-dd4ae38cbe66 None admin] PATH_INFO: `/v3/domains/819ac218d2ab447194636b0623447fa7` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:49:45.923498 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba944ae3-0c9c-47c4-83d8-dd4ae38cbe66 None admin] RBAC: Authorizing `identity:get_domain(domain_id=819ac218d2ab447194636b0623447fa7)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:49:45.924945 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba944ae3-0c9c-47c4-83d8-dd4ae38cbe66 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:49:45.926566 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 434/889] 10.222.0.17 () {56 vars in 1183 bytes} [Fri Oct 14 12:49:45 2022] GET /identity/v3/domains/819ac218d2ab447194636b0623447fa7 => generated 267 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:49:45.932599 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b07ca93-943d-4d90-aa8c-fc0b85bb0489 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:49:46.036077 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b07ca93-943d-4d90-aa8c-fc0b85bb0489 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:49:46.054443 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:49:46.074317 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1789f5f5-9565-4d77-83be-9ec6c48fcb07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:49:46.074930 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1789f5f5-9565-4d77-83be-9ec6c48fcb07 None admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:49:46.075208 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1789f5f5-9565-4d77-83be-9ec6c48fcb07 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:49:46.075479 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1789f5f5-9565-4d77-83be-9ec6c48fcb07 None admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:49:46.076134 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1789f5f5-9565-4d77-83be-9ec6c48fcb07 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:49:46.077637 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1789f5f5-9565-4d77-83be-9ec6c48fcb07 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:49:46.102710 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 456/890] 10.222.0.17 () {60 vars in 1132 bytes} [Fri Oct 14 12:49:45 2022] POST /identity/v3/users => generated 311 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 12:49:48.528468 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddb6a11-2d9d-4a30-b231-44fb63d4506d None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:49:48.528978 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddb6a11-2d9d-4a30-b231-44fb63d4506d None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:49:48.529394 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddb6a11-2d9d-4a30-b231-44fb63d4506d None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:49:48.532353 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 435/891] 10.222.0.17 () {54 vars in 927 bytes} [Fri Oct 14 12:49:48 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:49:48.538061 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1396be-def3-4479-9c43-940f87e29817 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:49:48.538576 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1396be-def3-4479-9c43-940f87e29817 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:49:48.538664 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1396be-def3-4479-9c43-940f87e29817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:49:48.557267 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-db1396be-def3-4479-9c43-940f87e29817 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:49:48.558525 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-db1396be-def3-4479-9c43-940f87e29817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:49:48.630634 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 457/892] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Oct 14 12:49:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 14 12:49:48.903100 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddb6a11-2d9d-4a30-b231-44fb63d4506d None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:49:49.008730 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddb6a11-2d9d-4a30-b231-44fb63d4506d None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:49:49.042640 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae80e06-7eec-4ece-94b8-28dffe0916b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:49:49.043258 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae80e06-7eec-4ece-94b8-28dffe0916b3 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:49:49.043534 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae80e06-7eec-4ece-94b8-28dffe0916b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:49:49.043801 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae80e06-7eec-4ece-94b8-28dffe0916b3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:49:49.054704 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae80e06-7eec-4ece-94b8-28dffe0916b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 12:49:49.059442 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-0ae80e06-7eec-4ece-94b8-28dffe0916b3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 14 12:49:49.059442 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:49:49.059442 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:49:49.059442 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:49:49.059442 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:49:49.059442 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:49:49.059442 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:49:49.059442 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:49:49.059442 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:49:49.059442 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:49:49.059442 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:49:49.059442 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:49:49.059442 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 12:49:49.059442 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 12:49:49.059442 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 12:49:49.059442 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 12:49:49.060534 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 12:49:49.060534 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 12:49:49.060534 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 12:49:49.060534 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 12:49:49.060534 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:49:49.060534 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:49:49.060534 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:49:49.060534 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:49:49.060534 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:49:49.060534 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:49:49.060534 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:49:49.060534 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 14 12:49:49.060534 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:49:49.060534 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:49:49.060534 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:49:49.060534 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:49:49.061619 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:49:49.061619 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:49:49.061619 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:49:49.061619 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:49:49.061619 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 12:49:49.061619 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 12:49:49.061619 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 12:49:49.061619 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 12:49:49.061619 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 12:49:49.061619 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 12:49:49.061619 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 14 12:49:49.061619 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 14 12:49:49.061619 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 436/893] 10.222.0.17 () {56 vars in 1096 bytes} [Fri Oct 14 12:49:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:49:49.067381 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1396be-def3-4479-9c43-940f87e29817 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:49:49.171535 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1396be-def3-4479-9c43-940f87e29817 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:49:49.174469 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:49:49.207740 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a58090-2dfb-48a5-bea2-9c61a2994c84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:49:49.208358 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a58090-2dfb-48a5-bea2-9c61a2994c84 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:49:49.208638 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a58090-2dfb-48a5-bea2-9c61a2994c84 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:49:49.208912 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a58090-2dfb-48a5-bea2-9c61a2994c84 None admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:49:49.209576 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a58090-2dfb-48a5-bea2-9c61a2994c84 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:49:49.209880 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a58090-2dfb-48a5-bea2-9c61a2994c84 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:49:49.211360 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a58090-2dfb-48a5-bea2-9c61a2994c84 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:49:49.220288 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 458/894] 10.222.0.17 () {56 vars in 1099 bytes} [Fri Oct 14 12:49:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:49:49.226259 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae80e06-7eec-4ece-94b8-28dffe0916b3 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:49:49.238697 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:49:49.328756 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae80e06-7eec-4ece-94b8-28dffe0916b3 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:49:49.363564 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf1d031-60c4-41f6-b1b9-5947b1d13686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:49:49.364188 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf1d031-60c4-41f6-b1b9-5947b1d13686 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:49:49.364463 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf1d031-60c4-41f6-b1b9-5947b1d13686 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:49:49.364734 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf1d031-60c4-41f6-b1b9-5947b1d13686 None admin] PATH_INFO: `/v3/users/0fbd12eb4a45435bb215c26d8558d6ca` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:49:49.378815 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf1d031-60c4-41f6-b1b9-5947b1d13686 None admin] RBAC: Authorizing `identity:get_user(user_id=0fbd12eb4a45435bb215c26d8558d6ca)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:49:49.380274 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf1d031-60c4-41f6-b1b9-5947b1d13686 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:49:49.381932 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 437/895] 10.222.0.17 () {56 vars in 1177 bytes} [Fri Oct 14 12:49:49 2022] GET /identity/v3/users/0fbd12eb4a45435bb215c26d8558d6ca => generated 311 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:49:49.387920 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a58090-2dfb-48a5-bea2-9c61a2994c84 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:49:49.490706 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a58090-2dfb-48a5-bea2-9c61a2994c84 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:49:49.524629 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b4dc1f-8af0-4953-a79e-a51afa9c15f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:49:49.525360 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b4dc1f-8af0-4953-a79e-a51afa9c15f2 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:49:49.525635 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b4dc1f-8af0-4953-a79e-a51afa9c15f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:49:49.525905 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b4dc1f-8af0-4953-a79e-a51afa9c15f2 None admin] PATH_INFO: `/v3/projects/333e9737ff7c45adb46a80c98038438b` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:49:49.527071 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b4dc1f-8af0-4953-a79e-a51afa9c15f2 None admin] RBAC: Authorizing `identity:get_project(project_id=333e9737ff7c45adb46a80c98038438b)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:49:49.528519 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b4dc1f-8af0-4953-a79e-a51afa9c15f2 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:49:49.530162 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 459/896] 10.222.0.17 () {56 vars in 1186 bytes} [Fri Oct 14 12:49:49 2022] GET /identity/v3/projects/333e9737ff7c45adb46a80c98038438b => generated 361 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:49:49.536628 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf1d031-60c4-41f6-b1b9-5947b1d13686 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:49:49.602487 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:49:49.638718 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf1d031-60c4-41f6-b1b9-5947b1d13686 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:49:49.673812 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75995a7d-ed53-4939-aaae-259e77c20c6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:49:49.674510 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75995a7d-ed53-4939-aaae-259e77c20c6b None admin] REQUEST_METHOD: `PUT` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:49:49.674793 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75995a7d-ed53-4939-aaae-259e77c20c6b None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:49:49.675067 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75995a7d-ed53-4939-aaae-259e77c20c6b None admin] PATH_INFO: `/v3/projects/333e9737ff7c45adb46a80c98038438b/users/0fbd12eb4a45435bb215c26d8558d6ca/roles/7f6e29e390bc41f7a9af17659a2e95d1` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:49:49.676990 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75995a7d-ed53-4939-aaae-259e77c20c6b None admin] RBAC: Authorizing `identity:create_grant(project_id=333e9737ff7c45adb46a80c98038438b, user_id=0fbd12eb4a45435bb215c26d8558d6ca, role_id=7f6e29e390bc41f7a9af17659a2e95d1)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:49:49.678469 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75995a7d-ed53-4939-aaae-259e77c20c6b None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:49:49.691156 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 438/897] 10.222.0.17 () {58 vars in 1439 bytes} [Fri Oct 14 12:49:49 2022] PUT /identity/v3/projects/333e9737ff7c45adb46a80c98038438b/users/0fbd12eb4a45435bb215c26d8558d6ca/roles/7f6e29e390bc41f7a9af17659a2e95d1 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 12:49:51.856700 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd5b083-4e40-41c4-9db7-a16d99a8d7c8 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:49:51.857505 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd5b083-4e40-41c4-9db7-a16d99a8d7c8 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:49:51.857505 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd5b083-4e40-41c4-9db7-a16d99a8d7c8 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:49:51.858913 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 460/898] 10.222.0.17 () {54 vars in 927 bytes} [Fri Oct 14 12:49:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:49:51.864477 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bd9832-44b6-4a69-9726-5c93a86d1747 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:49:51.864902 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bd9832-44b6-4a69-9726-5c93a86d1747 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:49:51.865033 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bd9832-44b6-4a69-9726-5c93a86d1747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:49:51.884156 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-f3bd9832-44b6-4a69-9726-5c93a86d1747 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:49:51.885368 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-f3bd9832-44b6-4a69-9726-5c93a86d1747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:49:51.957915 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 439/899] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Oct 14 12:49:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 14 12:49:52.225157 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd5b083-4e40-41c4-9db7-a16d99a8d7c8 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:49:52.261897 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:49:52.331727 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd5b083-4e40-41c4-9db7-a16d99a8d7c8 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:49:52.367608 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9bc960-6d46-465d-9c78-b8285a4855bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:49:52.368235 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9bc960-6d46-465d-9c78-b8285a4855bf None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:49:52.368514 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9bc960-6d46-465d-9c78-b8285a4855bf None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:49:52.368786 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9bc960-6d46-465d-9c78-b8285a4855bf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:49:52.379649 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9bc960-6d46-465d-9c78-b8285a4855bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 12:49:52.384535 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-3b9bc960-6d46-465d-9c78-b8285a4855bf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 14 12:49:52.384535 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:49:52.384535 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:49:52.384535 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:49:52.384535 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:49:52.384535 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:49:52.384535 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:49:52.384535 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:49:52.384535 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:49:52.384535 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:49:52.384535 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:49:52.384535 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:49:52.384535 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 12:49:52.384535 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 12:49:52.384535 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 12:49:52.384535 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 12:49:52.385653 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 12:49:52.385653 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 12:49:52.385653 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 12:49:52.385653 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 12:49:52.385653 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:49:52.385653 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:49:52.385653 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:49:52.385653 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:49:52.385653 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:49:52.385653 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:49:52.385653 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:49:52.385653 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 14 12:49:52.385653 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:49:52.385653 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:49:52.385653 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:49:52.385653 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:49:52.386732 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:49:52.386732 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:49:52.386732 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:49:52.386732 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:49:52.386732 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 12:49:52.386732 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 12:49:52.386732 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 12:49:52.386732 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 12:49:52.386732 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 12:49:52.386732 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 12:49:52.386732 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 14 12:49:52.386732 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 14 12:49:52.386732 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 461/900] 10.222.0.17 () {56 vars in 1096 bytes} [Fri Oct 14 12:49:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:49:52.392045 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bd9832-44b6-4a69-9726-5c93a86d1747 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:49:52.450582 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:49:52.495455 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bd9832-44b6-4a69-9726-5c93a86d1747 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:49:52.530936 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f367cf-b368-46e3-9557-7085069e6f6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:49:52.531546 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f367cf-b368-46e3-9557-7085069e6f6c None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:49:52.531822 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f367cf-b368-46e3-9557-7085069e6f6c None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:49:52.532091 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f367cf-b368-46e3-9557-7085069e6f6c None admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:49:52.532757 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f367cf-b368-46e3-9557-7085069e6f6c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:49:52.533058 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f367cf-b368-46e3-9557-7085069e6f6c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:49:52.534466 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f367cf-b368-46e3-9557-7085069e6f6c None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:49:52.542883 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 440/901] 10.222.0.17 () {56 vars in 1099 bytes} [Fri Oct 14 12:49:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:49:52.549698 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9bc960-6d46-465d-9c78-b8285a4855bf None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:49:52.647370 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:49:52.654349 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9bc960-6d46-465d-9c78-b8285a4855bf None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:49:52.690325 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de92809-a0ea-42d0-9037-2d55b994ac0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:49:52.690959 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de92809-a0ea-42d0-9037-2d55b994ac0f None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:49:52.691240 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de92809-a0ea-42d0-9037-2d55b994ac0f None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:49:52.691512 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de92809-a0ea-42d0-9037-2d55b994ac0f None admin] PATH_INFO: `/v3/users/0fbd12eb4a45435bb215c26d8558d6ca` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:49:52.692646 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de92809-a0ea-42d0-9037-2d55b994ac0f None admin] RBAC: Authorizing `identity:get_user(user_id=0fbd12eb4a45435bb215c26d8558d6ca)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:49:52.694086 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de92809-a0ea-42d0-9037-2d55b994ac0f None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:49:52.695705 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 462/902] 10.222.0.17 () {56 vars in 1177 bytes} [Fri Oct 14 12:49:52 2022] GET /identity/v3/users/0fbd12eb4a45435bb215c26d8558d6ca => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:49:52.701766 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f367cf-b368-46e3-9557-7085069e6f6c None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:49:52.802706 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f367cf-b368-46e3-9557-7085069e6f6c None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:49:52.819163 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:49:52.836805 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ca880f-a114-4da7-a525-31e659f080e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:49:52.837409 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ca880f-a114-4da7-a525-31e659f080e9 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:49:52.837683 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ca880f-a114-4da7-a525-31e659f080e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:49:52.837952 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ca880f-a114-4da7-a525-31e659f080e9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:49:52.905860 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ca880f-a114-4da7-a525-31e659f080e9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:49:52.907362 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ca880f-a114-4da7-a525-31e659f080e9 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:49:53.007845 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 441/903] 10.222.0.17 () {58 vars in 1282 bytes} [Fri Oct 14 12:49:52 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 14 12:49:53.015541 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de92809-a0ea-42d0-9037-2d55b994ac0f None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:49:53.118767 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de92809-a0ea-42d0-9037-2d55b994ac0f None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:49:53.154005 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4d2e27-fe1c-467b-83e1-24bfd404d28d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:49:53.154667 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4d2e27-fe1c-467b-83e1-24bfd404d28d None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:49:53.154947 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4d2e27-fe1c-467b-83e1-24bfd404d28d None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:49:53.155324 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4d2e27-fe1c-467b-83e1-24bfd404d28d None admin] PATH_INFO: `/v3/projects/333e9737ff7c45adb46a80c98038438b` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:49:53.156406 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4d2e27-fe1c-467b-83e1-24bfd404d28d None admin] RBAC: Authorizing `identity:get_project(project_id=333e9737ff7c45adb46a80c98038438b)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:49:53.157844 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4d2e27-fe1c-467b-83e1-24bfd404d28d None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:49:53.159513 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 463/904] 10.222.0.17 () {56 vars in 1186 bytes} [Fri Oct 14 12:49:53 2022] GET /identity/v3/projects/333e9737ff7c45adb46a80c98038438b => generated 361 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 12:49:53.165994 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ca880f-a114-4da7-a525-31e659f080e9 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:49:53.184174 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:49:53.269263 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ca880f-a114-4da7-a525-31e659f080e9 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:49:53.304194 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cbf54c-923b-4cf9-9b30-078348377211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:49:53.304787 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cbf54c-923b-4cf9-9b30-078348377211 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:49:53.305062 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cbf54c-923b-4cf9-9b30-078348377211 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:49:53.305329 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cbf54c-923b-4cf9-9b30-078348377211 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:49:53.306047 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cbf54c-923b-4cf9-9b30-078348377211 None admin] RBAC: Adding query filter params (role.id=7f6e29e390bc41f7a9af17659a2e95d1, scope.project.id=333e9737ff7c45adb46a80c98038438b, user.id=0fbd12eb4a45435bb215c26d8558d6ca) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:49:53.306375 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cbf54c-923b-4cf9-9b30-078348377211 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:49:53.307791 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cbf54c-923b-4cf9-9b30-078348377211 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:49:53.314786 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 442/905] 10.222.0.17 () {56 vars in 1374 bytes} [Fri Oct 14 12:49:53 2022] GET /identity/v3/role_assignments?user.id=0fbd12eb4a45435bb215c26d8558d6ca&scope.project.id=333e9737ff7c45adb46a80c98038438b&role.id=7f6e29e390bc41f7a9af17659a2e95d1 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:50:03.149477 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=85 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:50:03.310788 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=59 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:50:50.741133 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c87b39-5d95-457f-b1f1-f7f83aa14703 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:50:50.741726 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c87b39-5d95-457f-b1f1-f7f83aa14703 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:50:50.741726 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c87b39-5d95-457f-b1f1-f7f83aa14703 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:50:50.743451 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 464/906] 10.222.0.17 () {54 vars in 927 bytes} [Fri Oct 14 12:50:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:50:50.749437 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1e4f4f-dfce-414b-9eeb-19d5228c1d8d None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:50:50.749989 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1e4f4f-dfce-414b-9eeb-19d5228c1d8d None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:50:50.749989 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1e4f4f-dfce-414b-9eeb-19d5228c1d8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:50:50.774557 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-bf1e4f4f-dfce-414b-9eeb-19d5228c1d8d None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:50:50.778046 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-bf1e4f4f-dfce-414b-9eeb-19d5228c1d8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:50:50.878544 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 443/907] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Oct 14 12:50:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 14 12:50:51.173404 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c87b39-5d95-457f-b1f1-f7f83aa14703 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:50:51.311187 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c87b39-5d95-457f-b1f1-f7f83aa14703 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:50:51.357831 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd3fd1a-5c69-4dec-a146-07f547861f5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:50:51.358539 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd3fd1a-5c69-4dec-a146-07f547861f5a None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:50:51.358870 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd3fd1a-5c69-4dec-a146-07f547861f5a None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:50:51.359147 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd3fd1a-5c69-4dec-a146-07f547861f5a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:50:51.372025 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd3fd1a-5c69-4dec-a146-07f547861f5a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:50:51.373544 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd3fd1a-5c69-4dec-a146-07f547861f5a None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:50:51.392430 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-6bd3fd1a-5c69-4dec-a146-07f547861f5a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:50:51.392430 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:50:51.392430 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:50:51.392430 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:50:51.392430 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:50:51.392430 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:50:51.392430 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:50:51.392430 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:50:51.392430 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:50:51.392430 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:50:51.392430 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:50:51.392430 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:50:51.392430 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 12:50:51.392430 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 12:50:51.392430 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 12:50:51.392430 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 12:50:51.393614 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:50:51.393614 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:50:51.393614 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:50:51.393614 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:50:51.393614 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:50:51.393614 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:50:51.393614 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:50:51.393614 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 14 12:50:51.393614 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:50:51.393614 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:50:51.393614 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:50:51.393614 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:50:51.393614 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:50:51.393614 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:50:51.393614 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:50:51.393614 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:50:51.393614 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 12:50:51.394622 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 12:50:51.394622 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:50:51.394622 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 14 12:50:51.394622 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 465/908] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Oct 14 12:50:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:50:51.400067 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1e4f4f-dfce-414b-9eeb-19d5228c1d8d None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:50:51.530393 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1e4f4f-dfce-414b-9eeb-19d5228c1d8d None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:50:51.573376 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:50:51.587060 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76a0e93-0d1a-4892-8547-61aa03a35853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:50:51.587684 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76a0e93-0d1a-4892-8547-61aa03a35853 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:50:51.588068 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76a0e93-0d1a-4892-8547-61aa03a35853 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:50:51.588391 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76a0e93-0d1a-4892-8547-61aa03a35853 None admin] PATH_INFO: `/v3/domains` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:50:51.589047 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76a0e93-0d1a-4892-8547-61aa03a35853 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:50:51.589430 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76a0e93-0d1a-4892-8547-61aa03a35853 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:50:51.591357 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76a0e93-0d1a-4892-8547-61aa03a35853 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:50:51.609781 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 444/909] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Oct 14 12:50:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:50:51.610809 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd3fd1a-5c69-4dec-a146-07f547861f5a None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:50:51.689627 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:50:51.758257 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd3fd1a-5c69-4dec-a146-07f547861f5a None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:50:51.801210 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443ae054-1c57-49b3-8456-7878befb9e91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:50:51.801826 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443ae054-1c57-49b3-8456-7878befb9e91 None admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:50:51.802101 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443ae054-1c57-49b3-8456-7878befb9e91 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:50:51.802464 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443ae054-1c57-49b3-8456-7878befb9e91 None admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:50:51.803197 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443ae054-1c57-49b3-8456-7878befb9e91 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:50:51.804738 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443ae054-1c57-49b3-8456-7878befb9e91 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:50:51.830790 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 466/910] 10.222.0.17 () {60 vars in 1132 bytes} [Fri Oct 14 12:50:51 2022] POST /identity/v3/users => generated 251 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 12:50:54.353064 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b2d91b-0ccf-4103-a565-d6e0acb08207 None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:50:54.353655 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b2d91b-0ccf-4103-a565-d6e0acb08207 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:50:54.353655 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b2d91b-0ccf-4103-a565-d6e0acb08207 None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:50:54.355328 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 445/911] 10.222.0.17 () {54 vars in 927 bytes} [Fri Oct 14 12:50:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:50:54.362768 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a871ce23-e788-4e09-a278-a3922d959834 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:50:54.363334 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a871ce23-e788-4e09-a278-a3922d959834 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:50:54.363334 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a871ce23-e788-4e09-a278-a3922d959834 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:50:54.384260 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-a871ce23-e788-4e09-a278-a3922d959834 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:50:54.385619 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-a871ce23-e788-4e09-a278-a3922d959834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:50:54.476546 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 467/912] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Oct 14 12:50:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 14 12:50:54.763700 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b2d91b-0ccf-4103-a565-d6e0acb08207 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:50:54.905017 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b2d91b-0ccf-4103-a565-d6e0acb08207 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:50:54.955962 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cb82d3-782a-4450-b31f-98314563a53f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:50:54.957461 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cb82d3-782a-4450-b31f-98314563a53f None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:50:54.957461 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cb82d3-782a-4450-b31f-98314563a53f None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:50:54.957461 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cb82d3-782a-4450-b31f-98314563a53f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:50:54.969224 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cb82d3-782a-4450-b31f-98314563a53f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 12:50:54.974308 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-89cb82d3-782a-4450-b31f-98314563a53f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 14 12:50:54.974308 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:50:54.974308 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:50:54.974308 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:50:54.974308 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:50:54.974308 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:50:54.974308 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:50:54.974308 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:50:54.974308 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:50:54.974308 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:50:54.974308 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:50:54.974308 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:50:54.974308 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 12:50:54.974308 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 12:50:54.974308 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 12:50:54.974308 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 12:50:54.975251 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 12:50:54.975251 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 12:50:54.975251 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 12:50:54.975251 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 12:50:54.975251 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:50:54.975251 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:50:54.975251 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:50:54.975251 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:50:54.975251 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:50:54.975251 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:50:54.975251 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:50:54.975251 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 14 12:50:54.975251 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:50:54.975251 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:50:54.975251 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:50:54.975251 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:50:54.976118 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:50:54.976118 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:50:54.976118 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:50:54.976118 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:50:54.976118 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 12:50:54.976118 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 12:50:54.976118 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 12:50:54.976118 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 12:50:54.976118 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 12:50:54.976118 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 12:50:54.976118 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 14 12:50:54.976118 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 14 12:50:54.981446 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 446/913] 10.222.0.17 () {56 vars in 1102 bytes} [Fri Oct 14 12:50:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:50:54.986208 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a871ce23-e788-4e09-a278-a3922d959834 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:50:55.034347 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:50:55.119624 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a871ce23-e788-4e09-a278-a3922d959834 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:50:55.163191 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b698b06b-3a52-4b98-8212-0e9fa5f7fcee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:50:55.163479 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b698b06b-3a52-4b98-8212-0e9fa5f7fcee None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:50:55.163696 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b698b06b-3a52-4b98-8212-0e9fa5f7fcee None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:50:55.163968 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b698b06b-3a52-4b98-8212-0e9fa5f7fcee None admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:50:55.164693 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b698b06b-3a52-4b98-8212-0e9fa5f7fcee None admin] RBAC: Adding query filter params (name=service) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:50:55.164937 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b698b06b-3a52-4b98-8212-0e9fa5f7fcee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:50:55.166342 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b698b06b-3a52-4b98-8212-0e9fa5f7fcee None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:50:55.177605 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 468/914] 10.222.0.17 () {56 vars in 1103 bytes} [Fri Oct 14 12:50:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:50:55.183882 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cb82d3-782a-4450-b31f-98314563a53f None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:50:55.250869 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:50:55.313925 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cb82d3-782a-4450-b31f-98314563a53f None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:50:55.361963 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d6356e-f0e5-414e-97c7-cfc838b2af8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:50:55.363038 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d6356e-f0e5-414e-97c7-cfc838b2af8f None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:50:55.363038 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d6356e-f0e5-414e-97c7-cfc838b2af8f None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:50:55.363246 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d6356e-f0e5-414e-97c7-cfc838b2af8f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:50:55.375257 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d6356e-f0e5-414e-97c7-cfc838b2af8f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:50:55.376918 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d6356e-f0e5-414e-97c7-cfc838b2af8f None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:50:55.395726 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-21d6356e-f0e5-414e-97c7-cfc838b2af8f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:50:55.395726 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:50:55.395726 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:50:55.395726 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:50:55.395726 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:50:55.395726 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:50:55.395726 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:50:55.395726 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:50:55.395726 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:50:55.395726 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:50:55.395726 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:50:55.395726 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:50:55.395726 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 12:50:55.395726 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 12:50:55.395726 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 12:50:55.395726 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 12:50:55.396831 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:50:55.396831 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:50:55.396831 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:50:55.396831 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:50:55.396831 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:50:55.396831 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:50:55.396831 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:50:55.396831 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 14 12:50:55.396831 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:50:55.396831 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:50:55.396831 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:50:55.396831 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:50:55.396831 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:50:55.396831 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:50:55.396831 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:50:55.396831 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:50:55.396831 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 12:50:55.397910 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 12:50:55.397910 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:50:55.397910 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 14 12:50:55.397910 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 447/915] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Oct 14 12:50:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:50:55.404131 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b698b06b-3a52-4b98-8212-0e9fa5f7fcee None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:50:55.534705 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:50:55.538439 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b698b06b-3a52-4b98-8212-0e9fa5f7fcee None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:50:55.582794 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcffcee-6f51-4644-b35d-328a57c36712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:50:55.583536 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcffcee-6f51-4644-b35d-328a57c36712 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:50:55.591136 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcffcee-6f51-4644-b35d-328a57c36712 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:50:55.591136 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcffcee-6f51-4644-b35d-328a57c36712 None admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:50:55.591136 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcffcee-6f51-4644-b35d-328a57c36712 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:50:55.591136 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcffcee-6f51-4644-b35d-328a57c36712 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:50:55.591136 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcffcee-6f51-4644-b35d-328a57c36712 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:50:55.602919 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 469/916] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Oct 14 12:50:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:50:55.609572 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d6356e-f0e5-414e-97c7-cfc838b2af8f None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:50:55.741939 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d6356e-f0e5-414e-97c7-cfc838b2af8f None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:50:55.743755 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:50:55.786155 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ba8138-a0c4-483c-9c7c-55b2602fd6d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:50:55.786955 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ba8138-a0c4-483c-9c7c-55b2602fd6d8 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:50:55.787421 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ba8138-a0c4-483c-9c7c-55b2602fd6d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:50:55.787796 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ba8138-a0c4-483c-9c7c-55b2602fd6d8 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:50:55.799600 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ba8138-a0c4-483c-9c7c-55b2602fd6d8 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:50:55.801319 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ba8138-a0c4-483c-9c7c-55b2602fd6d8 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:50:55.818036 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-90ba8138-a0c4-483c-9c7c-55b2602fd6d8 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 14 12:50:55.818036 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:50:55.818036 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:50:55.818036 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:50:55.818036 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:50:55.818036 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:50:55.818036 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:50:55.818036 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:50:55.818036 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:50:55.818036 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:50:55.818036 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:50:55.818036 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:50:55.818036 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 14 12:50:55.818036 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 14 12:50:55.818036 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 14 12:50:55.818036 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 14 12:50:55.819291 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:50:55.819291 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:50:55.819291 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 14 12:50:55.819291 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 12:50:55.819291 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 14 12:50:55.819291 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 12:50:55.819291 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:50:55.819291 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:50:55.819291 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:50:55.819291 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:50:55.819291 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:50:55.819291 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 14 12:50:55.819291 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:50:55.819291 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:50:55.819291 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:50:55.819291 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:50:55.819291 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:50:55.819291 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:50:55.820436 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:50:55.820436 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:50:55.820436 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 14 12:50:55.820436 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 14 12:50:55.820436 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 14 12:50:55.820436 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 14 12:50:55.820436 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 14 12:50:55.820436 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 14 12:50:55.820436 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 14 12:50:55.820436 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 14 12:50:55.822469 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 448/917] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Oct 14 12:50:55 2022] GET /identity/v3/users/placement => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:50:55.831369 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcffcee-6f51-4644-b35d-328a57c36712 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:50:55.984140 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcffcee-6f51-4644-b35d-328a57c36712 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:50:56.028611 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775c9230-31d9-4848-925b-83d3c245df9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:50:56.029379 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775c9230-31d9-4848-925b-83d3c245df9f None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:50:56.029758 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775c9230-31d9-4848-925b-83d3c245df9f None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:50:56.030186 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775c9230-31d9-4848-925b-83d3c245df9f None admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:50:56.031006 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775c9230-31d9-4848-925b-83d3c245df9f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:50:56.031317 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775c9230-31d9-4848-925b-83d3c245df9f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:50:56.032771 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775c9230-31d9-4848-925b-83d3c245df9f None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:50:56.052506 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 470/918] 10.222.0.17 () {56 vars in 1143 bytes} [Fri Oct 14 12:50:55 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:50:56.059139 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ba8138-a0c4-483c-9c7c-55b2602fd6d8 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:50:56.189109 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ba8138-a0c4-483c-9c7c-55b2602fd6d8 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:50:56.229829 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3707f28-e22b-4e1d-a712-f610727f518c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:50:56.231595 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3707f28-e22b-4e1d-a712-f610727f518c None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:50:56.232097 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3707f28-e22b-4e1d-a712-f610727f518c None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:50:56.232782 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3707f28-e22b-4e1d-a712-f610727f518c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:50:56.247428 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3707f28-e22b-4e1d-a712-f610727f518c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:50:56.248923 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3707f28-e22b-4e1d-a712-f610727f518c None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:50:56.267042 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-b3707f28-e22b-4e1d-a712-f610727f518c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:50:56.267042 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:50:56.267042 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:50:56.267042 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:50:56.267042 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:50:56.267042 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:50:56.267042 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:50:56.267042 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:50:56.267042 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:50:56.267042 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:50:56.267042 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:50:56.267042 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:50:56.267042 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 12:50:56.267042 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 12:50:56.267042 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 12:50:56.267042 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 12:50:56.268281 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:50:56.268281 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:50:56.268281 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:50:56.268281 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:50:56.268281 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:50:56.268281 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:50:56.268281 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:50:56.268281 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 14 12:50:56.268281 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:50:56.268281 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:50:56.268281 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:50:56.268281 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:50:56.268281 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:50:56.268281 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:50:56.268281 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:50:56.268281 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:50:56.268281 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 12:50:56.269402 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 12:50:56.269402 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:50:56.269402 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 14 12:50:56.269966 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 449/919] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Oct 14 12:50:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:50:56.276594 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775c9230-31d9-4848-925b-83d3c245df9f None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:50:56.302894 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:50:56.412954 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775c9230-31d9-4848-925b-83d3c245df9f None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:50:56.451677 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ac330b-ceac-464c-a16b-4d934f8d9046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:50:56.452315 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ac330b-ceac-464c-a16b-4d934f8d9046 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:50:56.452588 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ac330b-ceac-464c-a16b-4d934f8d9046 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:50:56.452905 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ac330b-ceac-464c-a16b-4d934f8d9046 None admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:50:56.453554 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ac330b-ceac-464c-a16b-4d934f8d9046 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:50:56.453869 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ac330b-ceac-464c-a16b-4d934f8d9046 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:50:56.455291 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ac330b-ceac-464c-a16b-4d934f8d9046 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:50:56.474535 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 471/920] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Oct 14 12:50:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:50:56.476042 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3707f28-e22b-4e1d-a712-f610727f518c None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:50:56.495111 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:50:56.594096 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3707f28-e22b-4e1d-a712-f610727f518c None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:50:56.635966 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0c424b-6eb6-4558-8471-972414422da0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:50:56.637253 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0c424b-6eb6-4558-8471-972414422da0 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:50:56.637599 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0c424b-6eb6-4558-8471-972414422da0 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:50:56.638142 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0c424b-6eb6-4558-8471-972414422da0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:50:56.645844 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0c424b-6eb6-4558-8471-972414422da0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:50:56.647456 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0c424b-6eb6-4558-8471-972414422da0 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:50:56.660317 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-3b0c424b-6eb6-4558-8471-972414422da0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 12:50:56.660317 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:50:56.660317 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:50:56.660317 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:50:56.660317 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:50:56.660317 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:50:56.660317 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:50:56.660317 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:50:56.660317 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:50:56.660317 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:50:56.660317 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:50:56.660317 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:50:56.660317 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 14 12:50:56.660317 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 14 12:50:56.660317 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 14 12:50:56.661458 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 14 12:50:56.661458 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:50:56.661458 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:50:56.661458 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:50:56.661458 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:50:56.661458 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:50:56.661458 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:50:56.661458 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:50:56.661458 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 14 12:50:56.661458 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:50:56.661458 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:50:56.661458 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:50:56.661458 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:50:56.661458 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:50:56.661458 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:50:56.661458 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:50:56.661458 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:50:56.662435 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 14 12:50:56.662435 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 14 12:50:56.662435 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 14 12:50:56.662435 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 14 12:50:56.662435 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 14 12:50:56.662435 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 14 12:50:56.662435 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 12:50:56.662435 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 14 12:50:56.662435 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 450/921] 10.222.0.17 () {56 vars in 1111 bytes} [Fri Oct 14 12:50:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:50:56.668096 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ac330b-ceac-464c-a16b-4d934f8d9046 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:50:56.779566 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:50:56.817403 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ac330b-ceac-464c-a16b-4d934f8d9046 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:50:56.868698 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd44213a-3d6b-42b5-b3f4-4ae094ccf351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:50:56.869226 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd44213a-3d6b-42b5-b3f4-4ae094ccf351 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:50:56.869503 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd44213a-3d6b-42b5-b3f4-4ae094ccf351 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:50:56.869772 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd44213a-3d6b-42b5-b3f4-4ae094ccf351 None admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:50:56.871219 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd44213a-3d6b-42b5-b3f4-4ae094ccf351 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:50:56.871647 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd44213a-3d6b-42b5-b3f4-4ae094ccf351 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:50:56.873424 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd44213a-3d6b-42b5-b3f4-4ae094ccf351 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:50:56.889580 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 472/922] 10.222.0.17 () {56 vars in 1148 bytes} [Fri Oct 14 12:50:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:50:56.895910 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0c424b-6eb6-4558-8471-972414422da0 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:50:56.992509 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:50:57.020276 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0c424b-6eb6-4558-8471-972414422da0 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:50:57.057851 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b0fcd4-d09c-4d5a-ab81-104dddb1cf62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:50:57.059124 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b0fcd4-d09c-4d5a-ab81-104dddb1cf62 None admin] REQUEST_METHOD: `PUT` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:50:57.059666 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b0fcd4-d09c-4d5a-ab81-104dddb1cf62 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:50:57.059795 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b0fcd4-d09c-4d5a-ab81-104dddb1cf62 None admin] PATH_INFO: `/v3/projects/2486e73d493b40e18d9d988744993854/users/0a5e5c35ed8b4abc877ba8d8c490dacd/roles/2d0a16b1c5634daf99f2b7ac092d1ddd` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:50:57.078975 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b0fcd4-d09c-4d5a-ab81-104dddb1cf62 None admin] RBAC: Authorizing `identity:create_grant(project_id=2486e73d493b40e18d9d988744993854, user_id=0a5e5c35ed8b4abc877ba8d8c490dacd, role_id=2d0a16b1c5634daf99f2b7ac092d1ddd)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:50:57.080526 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b0fcd4-d09c-4d5a-ab81-104dddb1cf62 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:50:57.101627 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 451/923] 10.222.0.17 () {58 vars in 1439 bytes} [Fri Oct 14 12:50:56 2022] PUT /identity/v3/projects/2486e73d493b40e18d9d988744993854/users/0a5e5c35ed8b4abc877ba8d8c490dacd/roles/2d0a16b1c5634daf99f2b7ac092d1ddd => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 12:50:59.409351 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66312532-d69c-4744-a406-b44d443a80fb None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:50:59.409856 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66312532-d69c-4744-a406-b44d443a80fb None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:50:59.409856 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66312532-d69c-4744-a406-b44d443a80fb None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:50:59.411393 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 473/924] 10.222.0.17 () {54 vars in 927 bytes} [Fri Oct 14 12:50:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 14 12:50:59.417640 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b4b24d-a688-48c5-aea0-2179991cfe62 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:50:59.418098 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b4b24d-a688-48c5-aea0-2179991cfe62 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:50:59.418684 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b4b24d-a688-48c5-aea0-2179991cfe62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:50:59.438749 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-f6b4b24d-a688-48c5-aea0-2179991cfe62 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:50:59.439973 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-f6b4b24d-a688-48c5-aea0-2179991cfe62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:50:59.517315 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 452/925] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Oct 14 12:50:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 14 12:50:59.800620 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66312532-d69c-4744-a406-b44d443a80fb None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:50:59.937605 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66312532-d69c-4744-a406-b44d443a80fb None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:50:59.981429 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75c1293-ab81-41a2-9da0-44582ca755b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:50:59.982069 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75c1293-ab81-41a2-9da0-44582ca755b8 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:50:59.983270 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75c1293-ab81-41a2-9da0-44582ca755b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:50:59.983543 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75c1293-ab81-41a2-9da0-44582ca755b8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:50:59.997910 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:51:00.003040 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75c1293-ab81-41a2-9da0-44582ca755b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 12:51:00.009029 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-d75c1293-ab81-41a2-9da0-44582ca755b8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 14 12:51:00.009029 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:51:00.009029 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:51:00.009029 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:51:00.009029 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:51:00.009029 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:51:00.009029 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:51:00.009029 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:51:00.009029 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:51:00.009029 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:51:00.009029 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:51:00.009029 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:51:00.009029 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 12:51:00.009029 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 12:51:00.009029 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 12:51:00.009029 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 12:51:00.010491 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 12:51:00.010491 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 12:51:00.010491 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 12:51:00.010491 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 12:51:00.010491 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:51:00.010491 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:51:00.010491 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:51:00.010491 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:51:00.010491 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:51:00.010491 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:51:00.010491 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:51:00.010491 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 14 12:51:00.010491 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:51:00.010491 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:51:00.010491 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:51:00.010491 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:51:00.011624 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:51:00.011624 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:51:00.011624 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:51:00.011624 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:51:00.011624 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 12:51:00.011624 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 12:51:00.011624 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 12:51:00.011624 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 12:51:00.011624 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 12:51:00.011624 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 12:51:00.011624 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 14 12:51:00.011624 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 14 12:51:00.011624 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 474/926] 10.222.0.17 () {56 vars in 1102 bytes} [Fri Oct 14 12:50:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:51:00.016815 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b4b24d-a688-48c5-aea0-2179991cfe62 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:51:00.077661 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:51:00.133328 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b4b24d-a688-48c5-aea0-2179991cfe62 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:51:00.168798 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb9f865-fe2a-4b04-8705-0401008dec25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:51:00.169453 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb9f865-fe2a-4b04-8705-0401008dec25 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:51:00.169733 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb9f865-fe2a-4b04-8705-0401008dec25 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:51:00.170045 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb9f865-fe2a-4b04-8705-0401008dec25 None admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:51:00.170700 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb9f865-fe2a-4b04-8705-0401008dec25 None admin] RBAC: Adding query filter params (name=service) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:51:00.171003 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb9f865-fe2a-4b04-8705-0401008dec25 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:51:00.172384 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb9f865-fe2a-4b04-8705-0401008dec25 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:51:00.181126 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 453/927] 10.222.0.17 () {56 vars in 1103 bytes} [Fri Oct 14 12:51:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:51:00.187328 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75c1293-ab81-41a2-9da0-44582ca755b8 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:51:00.300503 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75c1293-ab81-41a2-9da0-44582ca755b8 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:51:00.340018 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6cf8d3-25c3-45f1-baf9-75d880cba64d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:51:00.340847 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6cf8d3-25c3-45f1-baf9-75d880cba64d None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:51:00.341040 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6cf8d3-25c3-45f1-baf9-75d880cba64d None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:51:00.341296 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6cf8d3-25c3-45f1-baf9-75d880cba64d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:51:00.352099 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6cf8d3-25c3-45f1-baf9-75d880cba64d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:51:00.355238 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6cf8d3-25c3-45f1-baf9-75d880cba64d None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:51:00.372123 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-be6cf8d3-25c3-45f1-baf9-75d880cba64d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:51:00.372123 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:51:00.372123 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:51:00.372123 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:51:00.372123 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:51:00.372123 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:51:00.372123 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:51:00.372123 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:51:00.372123 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:51:00.372123 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:51:00.372123 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:51:00.372123 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:51:00.372123 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 12:51:00.372123 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 12:51:00.372123 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 12:51:00.372123 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 12:51:00.374509 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:51:00.374509 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:51:00.374509 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:51:00.374509 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:51:00.374509 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:51:00.374509 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:51:00.374509 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:51:00.374509 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 14 12:51:00.374509 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:51:00.374509 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:51:00.374509 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:51:00.374509 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:51:00.374509 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:51:00.374509 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:51:00.374509 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:51:00.374509 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:51:00.374509 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 12:51:00.376144 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 12:51:00.376144 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:51:00.376144 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 14 12:51:00.376144 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 475/928] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Oct 14 12:51:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 14 12:51:00.379098 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb9f865-fe2a-4b04-8705-0401008dec25 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:51:00.491927 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb9f865-fe2a-4b04-8705-0401008dec25 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:51:00.511649 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:51:00.535663 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49624adf-a404-40f7-a2ca-457b5987d428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:51:00.536323 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49624adf-a404-40f7-a2ca-457b5987d428 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:51:00.536653 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49624adf-a404-40f7-a2ca-457b5987d428 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:51:00.536935 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49624adf-a404-40f7-a2ca-457b5987d428 None admin] PATH_INFO: `/v3/domains` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:51:00.537690 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49624adf-a404-40f7-a2ca-457b5987d428 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:51:00.538047 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49624adf-a404-40f7-a2ca-457b5987d428 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:51:00.539567 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49624adf-a404-40f7-a2ca-457b5987d428 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:51:00.552846 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 454/929] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Oct 14 12:51:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:51:00.559629 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6cf8d3-25c3-45f1-baf9-75d880cba64d None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:51:00.628460 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:51:00.684636 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6cf8d3-25c3-45f1-baf9-75d880cba64d None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:51:00.725246 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732c7690-6b19-4ee4-b424-afea6da86287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:51:00.725879 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732c7690-6b19-4ee4-b424-afea6da86287 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:51:00.726177 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732c7690-6b19-4ee4-b424-afea6da86287 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:51:00.726448 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732c7690-6b19-4ee4-b424-afea6da86287 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:51:00.735173 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732c7690-6b19-4ee4-b424-afea6da86287 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:51:00.736203 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732c7690-6b19-4ee4-b424-afea6da86287 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:51:00.749233 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-732c7690-6b19-4ee4-b424-afea6da86287 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 14 12:51:00.749233 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:51:00.749233 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:51:00.749233 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:51:00.749233 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:51:00.749233 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:51:00.749233 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:51:00.749233 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:51:00.749233 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:51:00.749233 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:51:00.749233 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:51:00.749233 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:51:00.749233 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 14 12:51:00.749233 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 14 12:51:00.749233 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 14 12:51:00.749233 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 14 12:51:00.750588 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:51:00.750588 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:51:00.750588 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 14 12:51:00.750588 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 12:51:00.750588 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 14 12:51:00.750588 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 12:51:00.750588 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:51:00.750588 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:51:00.750588 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:51:00.750588 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:51:00.750588 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:51:00.750588 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 14 12:51:00.750588 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:51:00.750588 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:51:00.750588 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:51:00.750588 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:51:00.750588 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:51:00.750588 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:51:00.752782 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:51:00.752782 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:51:00.752782 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 14 12:51:00.752782 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 14 12:51:00.752782 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 14 12:51:00.752782 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 14 12:51:00.752782 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 14 12:51:00.752782 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 14 12:51:00.752782 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 14 12:51:00.752782 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 14 12:51:00.752782 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 476/930] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Oct 14 12:51:00 2022] GET /identity/v3/users/placement => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:51:00.756871 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49624adf-a404-40f7-a2ca-457b5987d428 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:51:00.864094 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49624adf-a404-40f7-a2ca-457b5987d428 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:51:00.901745 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62cadb6-67b0-41c0-a013-d007bd43b316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:51:00.902327 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62cadb6-67b0-41c0-a013-d007bd43b316 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:51:00.902609 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62cadb6-67b0-41c0-a013-d007bd43b316 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:51:00.902883 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62cadb6-67b0-41c0-a013-d007bd43b316 None admin] PATH_INFO: `/v3/users` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:51:00.903648 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62cadb6-67b0-41c0-a013-d007bd43b316 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:51:00.903999 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62cadb6-67b0-41c0-a013-d007bd43b316 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:51:00.905601 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62cadb6-67b0-41c0-a013-d007bd43b316 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:51:00.925012 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 455/931] 10.222.0.17 () {56 vars in 1143 bytes} [Fri Oct 14 12:51:00 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 12:51:00.931333 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732c7690-6b19-4ee4-b424-afea6da86287 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:51:01.057502 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732c7690-6b19-4ee4-b424-afea6da86287 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:51:01.070782 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:51:01.103308 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24642727-6092-4521-ba0a-1fd18a1e7f6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:51:01.103936 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24642727-6092-4521-ba0a-1fd18a1e7f6f None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:51:01.104210 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24642727-6092-4521-ba0a-1fd18a1e7f6f None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:51:01.104484 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24642727-6092-4521-ba0a-1fd18a1e7f6f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:51:01.187166 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24642727-6092-4521-ba0a-1fd18a1e7f6f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:51:01.188805 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24642727-6092-4521-ba0a-1fd18a1e7f6f None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:51:01.302265 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 477/932] 10.222.0.17 () {58 vars in 1282 bytes} [Fri Oct 14 12:51:00 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 14 12:51:01.309079 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62cadb6-67b0-41c0-a013-d007bd43b316 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:51:01.351728 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:51:01.440529 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62cadb6-67b0-41c0-a013-d007bd43b316 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:51:01.479705 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d84ff2-1ef2-4110-a417-532852e0f86b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:51:01.480518 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d84ff2-1ef2-4110-a417-532852e0f86b None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:51:01.480798 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d84ff2-1ef2-4110-a417-532852e0f86b None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:51:01.481070 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d84ff2-1ef2-4110-a417-532852e0f86b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:51:01.492874 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d84ff2-1ef2-4110-a417-532852e0f86b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:51:01.494367 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d84ff2-1ef2-4110-a417-532852e0f86b None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:51:01.509757 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-81d84ff2-1ef2-4110-a417-532852e0f86b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:51:01.509757 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:51:01.509757 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:51:01.509757 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:51:01.509757 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:51:01.509757 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:51:01.509757 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:51:01.509757 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:51:01.509757 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:51:01.509757 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:51:01.509757 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:51:01.509757 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:51:01.509757 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 12:51:01.509757 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 12:51:01.509757 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 12:51:01.509757 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 12:51:01.511232 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:51:01.511232 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:51:01.511232 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:51:01.511232 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:51:01.511232 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:51:01.511232 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:51:01.511232 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:51:01.511232 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 14 12:51:01.511232 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:51:01.511232 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:51:01.511232 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:51:01.511232 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:51:01.511232 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:51:01.511232 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:51:01.511232 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:51:01.511232 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:51:01.511232 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 12:51:01.512294 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 12:51:01.512294 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:51:01.512294 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 14 12:51:01.512294 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 456/933] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Oct 14 12:51:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:51:01.518590 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24642727-6092-4521-ba0a-1fd18a1e7f6f None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:51:01.531813 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:51:01.642838 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24642727-6092-4521-ba0a-1fd18a1e7f6f None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:51:01.685389 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cccef7-4acb-42d5-ade8-c8beba8b21c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:51:01.686210 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cccef7-4acb-42d5-ade8-c8beba8b21c3 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:51:01.686441 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cccef7-4acb-42d5-ade8-c8beba8b21c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:51:01.686744 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cccef7-4acb-42d5-ade8-c8beba8b21c3 None admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:51:01.687388 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cccef7-4acb-42d5-ade8-c8beba8b21c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:51:01.687698 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cccef7-4acb-42d5-ade8-c8beba8b21c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:51:01.689280 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cccef7-4acb-42d5-ade8-c8beba8b21c3 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:51:01.703000 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 478/934] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Oct 14 12:51:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:51:01.709069 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d84ff2-1ef2-4110-a417-532852e0f86b None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:51:01.806153 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:51:01.824501 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d84ff2-1ef2-4110-a417-532852e0f86b None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:51:01.863995 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00389e1-08fd-4ab2-a0ae-43e3ee444bc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:51:01.864791 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00389e1-08fd-4ab2-a0ae-43e3ee444bc0 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:51:01.865071 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00389e1-08fd-4ab2-a0ae-43e3ee444bc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:51:01.865386 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00389e1-08fd-4ab2-a0ae-43e3ee444bc0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:51:01.874869 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00389e1-08fd-4ab2-a0ae-43e3ee444bc0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:51:01.877491 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00389e1-08fd-4ab2-a0ae-43e3ee444bc0 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:51:01.892169 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-a00389e1-08fd-4ab2-a0ae-43e3ee444bc0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 12:51:01.892169 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:51:01.892169 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:51:01.892169 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:51:01.892169 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:51:01.892169 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:51:01.892169 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:51:01.892169 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:51:01.892169 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:51:01.892169 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:51:01.892169 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:51:01.892169 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:51:01.892169 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 14 12:51:01.892169 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 14 12:51:01.892169 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 14 12:51:01.893240 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 14 12:51:01.893240 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:51:01.893240 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:51:01.893240 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:51:01.893240 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:51:01.893240 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:51:01.893240 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:51:01.893240 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:51:01.893240 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 14 12:51:01.893240 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:51:01.893240 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:51:01.893240 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:51:01.893240 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:51:01.893240 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:51:01.893240 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:51:01.893240 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:51:01.893240 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:51:01.894188 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 14 12:51:01.894188 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 14 12:51:01.894188 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 14 12:51:01.894188 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 14 12:51:01.894188 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 14 12:51:01.894188 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 14 12:51:01.894188 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 12:51:01.894188 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 14 12:51:01.894188 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 457/935] 10.222.0.17 () {56 vars in 1111 bytes} [Fri Oct 14 12:51:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:51:01.899595 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cccef7-4acb-42d5-ade8-c8beba8b21c3 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:51:01.980460 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:51:02.029613 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cccef7-4acb-42d5-ade8-c8beba8b21c3 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:51:02.072247 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2501a6-cbde-403b-b27b-0692bab3e057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:51:02.072862 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2501a6-cbde-403b-b27b-0692bab3e057 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:51:02.073143 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2501a6-cbde-403b-b27b-0692bab3e057 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:51:02.073413 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2501a6-cbde-403b-b27b-0692bab3e057 None admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:51:02.074659 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2501a6-cbde-403b-b27b-0692bab3e057 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:51:02.074968 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2501a6-cbde-403b-b27b-0692bab3e057 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:51:02.076440 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2501a6-cbde-403b-b27b-0692bab3e057 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:51:02.092240 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 479/936] 10.222.0.17 () {56 vars in 1148 bytes} [Fri Oct 14 12:51:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:51:02.099496 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00389e1-08fd-4ab2-a0ae-43e3ee444bc0 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:51:02.212855 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00389e1-08fd-4ab2-a0ae-43e3ee444bc0 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:51:02.251811 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07afef5a-bcc4-4f51-b95f-c11411ce3fec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:51:02.252342 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07afef5a-bcc4-4f51-b95f-c11411ce3fec None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:51:02.252621 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07afef5a-bcc4-4f51-b95f-c11411ce3fec None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:51:02.252891 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07afef5a-bcc4-4f51-b95f-c11411ce3fec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:51:02.253629 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07afef5a-bcc4-4f51-b95f-c11411ce3fec None admin] RBAC: Adding query filter params (role.id=2d0a16b1c5634daf99f2b7ac092d1ddd, scope.project.id=2486e73d493b40e18d9d988744993854, user.id=0a5e5c35ed8b4abc877ba8d8c490dacd) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:51:02.253935 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07afef5a-bcc4-4f51-b95f-c11411ce3fec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:51:02.255415 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07afef5a-bcc4-4f51-b95f-c11411ce3fec None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:51:02.262462 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 458/937] 10.222.0.17 () {56 vars in 1374 bytes} [Fri Oct 14 12:51:02 2022] GET /identity/v3/role_assignments?user.id=0a5e5c35ed8b4abc877ba8d8c490dacd&scope.project.id=2486e73d493b40e18d9d988744993854&role.id=2d0a16b1c5634daf99f2b7ac092d1ddd => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:51:04.593546 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d97f24-1022-44c4-898c-bbe5ff0a0955 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:51:04.594160 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d97f24-1022-44c4-898c-bbe5ff0a0955 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:51:04.594292 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d97f24-1022-44c4-898c-bbe5ff0a0955 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:51:04.595709 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 480/938] 10.222.0.17 () {54 vars in 927 bytes} [Fri Oct 14 12:51:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 14 12:51:04.601727 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1316a1-945c-4e8f-939e-d80c81059220 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:51:04.602284 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1316a1-945c-4e8f-939e-d80c81059220 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:51:04.602284 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1316a1-945c-4e8f-939e-d80c81059220 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:51:04.625585 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-4a1316a1-945c-4e8f-939e-d80c81059220 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:51:04.626863 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-4a1316a1-945c-4e8f-939e-d80c81059220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:51:04.630346 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:51:04.705776 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 459/939] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Oct 14 12:51:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 14 12:51:04.982870 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d97f24-1022-44c4-898c-bbe5ff0a0955 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:51:05.123625 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d97f24-1022-44c4-898c-bbe5ff0a0955 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:51:05.161000 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:51:05.168510 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69fd953-2282-449f-af67-74f1788e028d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:51:05.169302 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69fd953-2282-449f-af67-74f1788e028d None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:51:05.169578 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69fd953-2282-449f-af67-74f1788e028d None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:51:05.169880 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69fd953-2282-449f-af67-74f1788e028d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:51:05.182367 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69fd953-2282-449f-af67-74f1788e028d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 12:51:05.188385 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-f69fd953-2282-449f-af67-74f1788e028d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 14 12:51:05.188385 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:51:05.188385 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:51:05.188385 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:51:05.188385 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:51:05.188385 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:51:05.188385 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:51:05.188385 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:51:05.188385 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:51:05.188385 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:51:05.188385 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:51:05.188385 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:51:05.188385 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 12:51:05.188385 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 12:51:05.188385 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 12:51:05.188385 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 12:51:05.189523 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 12:51:05.189523 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 12:51:05.189523 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 12:51:05.189523 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 12:51:05.189523 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:51:05.189523 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:51:05.189523 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:51:05.189523 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:51:05.189523 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:51:05.189523 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:51:05.189523 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:51:05.189523 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 14 12:51:05.189523 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:51:05.189523 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:51:05.189523 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:51:05.189523 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:51:05.190463 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:51:05.190463 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:51:05.190463 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:51:05.190463 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:51:05.190463 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 12:51:05.190463 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 12:51:05.190463 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 12:51:05.190463 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 12:51:05.190463 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 12:51:05.190463 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 12:51:05.190463 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 14 12:51:05.190463 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 14 12:51:05.190463 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 481/940] 10.222.0.17 () {56 vars in 1096 bytes} [Fri Oct 14 12:51:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:51:05.195856 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1316a1-945c-4e8f-939e-d80c81059220 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:51:05.318535 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1316a1-945c-4e8f-939e-d80c81059220 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:51:05.360269 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180dcbe3-f59b-4914-bd96-1716dbc64efa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:51:05.360994 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180dcbe3-f59b-4914-bd96-1716dbc64efa None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:51:05.361423 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180dcbe3-f59b-4914-bd96-1716dbc64efa None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:51:05.361738 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180dcbe3-f59b-4914-bd96-1716dbc64efa None admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:51:05.362818 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180dcbe3-f59b-4914-bd96-1716dbc64efa None admin] RBAC: Adding query filter params (name=admin) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:51:05.363183 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180dcbe3-f59b-4914-bd96-1716dbc64efa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:51:05.364814 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180dcbe3-f59b-4914-bd96-1716dbc64efa None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:51:05.374706 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 460/941] 10.222.0.17 () {56 vars in 1099 bytes} [Fri Oct 14 12:51:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:51:05.380496 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69fd953-2282-449f-af67-74f1788e028d None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:51:05.503774 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69fd953-2282-449f-af67-74f1788e028d None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:51:05.547964 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf6d159-5b03-426e-8af5-ced056ea1c70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:51:05.547964 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf6d159-5b03-426e-8af5-ced056ea1c70 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:51:05.547964 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf6d159-5b03-426e-8af5-ced056ea1c70 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:51:05.547964 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf6d159-5b03-426e-8af5-ced056ea1c70 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:51:05.561070 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf6d159-5b03-426e-8af5-ced056ea1c70 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:51:05.561070 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf6d159-5b03-426e-8af5-ced056ea1c70 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:51:05.579237 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-0bf6d159-5b03-426e-8af5-ced056ea1c70 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:51:05.579237 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:51:05.579237 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:51:05.579237 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:51:05.579237 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:51:05.579237 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:51:05.579237 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:51:05.579237 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:51:05.579237 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:51:05.579237 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:51:05.579237 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:51:05.579237 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:51:05.579237 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 12:51:05.579237 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 12:51:05.579237 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 12:51:05.579237 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 12:51:05.580409 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:51:05.580409 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:51:05.580409 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:51:05.580409 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:51:05.580409 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:51:05.580409 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:51:05.580409 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:51:05.580409 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 14 12:51:05.580409 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:51:05.580409 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:51:05.580409 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:51:05.580409 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:51:05.580409 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:51:05.580409 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:51:05.580409 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:51:05.580409 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:51:05.580409 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 12:51:05.581645 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 12:51:05.581645 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:51:05.581645 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 14 12:51:05.581645 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 482/942] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Oct 14 12:51:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:51:05.587341 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180dcbe3-f59b-4914-bd96-1716dbc64efa None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:51:05.593072 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:51:05.712591 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180dcbe3-f59b-4914-bd96-1716dbc64efa None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:51:05.753342 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077d7fc4-f584-45b7-bb45-7e48195e5bde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:51:05.753342 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077d7fc4-f584-45b7-bb45-7e48195e5bde None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:51:05.753342 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077d7fc4-f584-45b7-bb45-7e48195e5bde None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:51:05.753342 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077d7fc4-f584-45b7-bb45-7e48195e5bde None admin] PATH_INFO: `/v3/domains` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:51:05.754101 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077d7fc4-f584-45b7-bb45-7e48195e5bde None admin] RBAC: Adding query filter params (name=Default) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:51:05.754101 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077d7fc4-f584-45b7-bb45-7e48195e5bde None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:51:05.755006 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077d7fc4-f584-45b7-bb45-7e48195e5bde None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:51:05.772019 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 461/943] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Oct 14 12:51:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:51:05.779404 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf6d159-5b03-426e-8af5-ced056ea1c70 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:51:05.831731 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:51:05.901510 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf6d159-5b03-426e-8af5-ced056ea1c70 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:51:05.949280 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ad7d72-277b-4f9f-a597-95f6c164109e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:51:05.950091 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ad7d72-277b-4f9f-a597-95f6c164109e None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:51:05.950437 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ad7d72-277b-4f9f-a597-95f6c164109e None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:51:05.950777 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ad7d72-277b-4f9f-a597-95f6c164109e None admin] PATH_INFO: `/v3/users/placement` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:51:05.959759 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ad7d72-277b-4f9f-a597-95f6c164109e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:51:05.961455 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ad7d72-277b-4f9f-a597-95f6c164109e None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:51:05.974570 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-57ad7d72-277b-4f9f-a597-95f6c164109e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 14 12:51:05.974570 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:51:05.974570 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:51:05.974570 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:51:05.974570 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:51:05.974570 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:51:05.974570 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:51:05.974570 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:51:05.974570 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:51:05.974570 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:51:05.974570 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:51:05.974570 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:51:05.974570 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 14 12:51:05.974570 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 14 12:51:05.974570 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 14 12:51:05.974570 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 14 12:51:05.976110 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:51:05.976110 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:51:05.976110 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 14 12:51:05.976110 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 12:51:05.976110 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 14 12:51:05.976110 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 12:51:05.976110 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:51:05.976110 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:51:05.976110 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:51:05.976110 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:51:05.976110 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:51:05.976110 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 14 12:51:05.976110 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:51:05.976110 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:51:05.976110 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:51:05.976110 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:51:05.976110 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:51:05.976110 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:51:05.977815 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:51:05.977815 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:51:05.977815 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 14 12:51:05.977815 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 14 12:51:05.977815 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 14 12:51:05.977815 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 14 12:51:05.977815 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 14 12:51:05.977815 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 14 12:51:05.977815 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 14 12:51:05.977815 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 14 12:51:05.977815 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 483/944] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Oct 14 12:51:05 2022] GET /identity/v3/users/placement => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:51:05.983625 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077d7fc4-f584-45b7-bb45-7e48195e5bde None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:51:06.062331 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:51:06.113774 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077d7fc4-f584-45b7-bb45-7e48195e5bde None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:51:06.154570 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3398f731-d8ad-4dcb-9857-b61260d5c78c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:51:06.155174 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3398f731-d8ad-4dcb-9857-b61260d5c78c None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:51:06.155451 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3398f731-d8ad-4dcb-9857-b61260d5c78c None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:51:06.155720 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3398f731-d8ad-4dcb-9857-b61260d5c78c None admin] PATH_INFO: `/v3/users` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:51:06.156452 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3398f731-d8ad-4dcb-9857-b61260d5c78c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:51:06.156756 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3398f731-d8ad-4dcb-9857-b61260d5c78c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:51:06.158227 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3398f731-d8ad-4dcb-9857-b61260d5c78c None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:51:06.182142 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 462/945] 10.222.0.17 () {56 vars in 1143 bytes} [Fri Oct 14 12:51:05 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:51:06.189105 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ad7d72-277b-4f9f-a597-95f6c164109e None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:51:06.305510 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ad7d72-277b-4f9f-a597-95f6c164109e None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:51:06.307133 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:51:06.348593 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68deaa93-ac63-470b-bf0a-2944a48acdac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:51:06.349325 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68deaa93-ac63-470b-bf0a-2944a48acdac None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:51:06.349547 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68deaa93-ac63-470b-bf0a-2944a48acdac None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:51:06.349821 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68deaa93-ac63-470b-bf0a-2944a48acdac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:51:06.363792 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68deaa93-ac63-470b-bf0a-2944a48acdac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:51:06.365315 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68deaa93-ac63-470b-bf0a-2944a48acdac None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:51:06.391404 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-68deaa93-ac63-470b-bf0a-2944a48acdac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:51:06.391404 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:51:06.391404 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:51:06.391404 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:51:06.391404 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:51:06.391404 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:51:06.391404 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:51:06.391404 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:51:06.391404 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:51:06.391404 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:51:06.391404 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:51:06.391404 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:51:06.391404 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 12:51:06.391404 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 12:51:06.391404 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 12:51:06.391404 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 12:51:06.392483 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:51:06.392483 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:51:06.392483 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:51:06.392483 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:51:06.392483 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:51:06.392483 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:51:06.392483 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:51:06.392483 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 14 12:51:06.392483 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:51:06.392483 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:51:06.392483 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:51:06.392483 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:51:06.392483 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:51:06.392483 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:51:06.392483 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:51:06.392483 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:51:06.392483 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 12:51:06.393386 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 12:51:06.393386 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:51:06.393386 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 14 12:51:06.393386 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 484/946] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Oct 14 12:51:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:51:06.399405 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3398f731-d8ad-4dcb-9857-b61260d5c78c None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:51:06.527678 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3398f731-d8ad-4dcb-9857-b61260d5c78c None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:51:06.549827 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:51:06.570409 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39ed44c-e5ee-4008-b01d-7e52aa20a55b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:51:06.571027 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39ed44c-e5ee-4008-b01d-7e52aa20a55b None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:51:06.571308 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39ed44c-e5ee-4008-b01d-7e52aa20a55b None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:51:06.571585 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39ed44c-e5ee-4008-b01d-7e52aa20a55b None admin] PATH_INFO: `/v3/domains` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:51:06.572264 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39ed44c-e5ee-4008-b01d-7e52aa20a55b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:51:06.572620 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39ed44c-e5ee-4008-b01d-7e52aa20a55b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:51:06.574100 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39ed44c-e5ee-4008-b01d-7e52aa20a55b None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:51:06.586237 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 463/947] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Oct 14 12:51:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 12:51:06.592812 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68deaa93-ac63-470b-bf0a-2944a48acdac None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:51:06.713635 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68deaa93-ac63-470b-bf0a-2944a48acdac None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:51:06.750979 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3d8eaf-4458-4f4a-87a2-9fdac9b24363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:51:06.751735 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3d8eaf-4458-4f4a-87a2-9fdac9b24363 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:51:06.751896 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3d8eaf-4458-4f4a-87a2-9fdac9b24363 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:51:06.752171 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3d8eaf-4458-4f4a-87a2-9fdac9b24363 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:51:06.759188 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3d8eaf-4458-4f4a-87a2-9fdac9b24363 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:51:06.760640 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3d8eaf-4458-4f4a-87a2-9fdac9b24363 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:51:06.773122 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-4c3d8eaf-4458-4f4a-87a2-9fdac9b24363 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 12:51:06.773122 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:51:06.773122 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:51:06.773122 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:51:06.773122 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:51:06.773122 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:51:06.773122 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:51:06.773122 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:51:06.773122 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:51:06.773122 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:51:06.773122 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:51:06.773122 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:51:06.773122 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 14 12:51:06.773122 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 14 12:51:06.773122 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 14 12:51:06.774315 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 14 12:51:06.774315 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:51:06.774315 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:51:06.774315 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:51:06.774315 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:51:06.774315 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:51:06.774315 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:51:06.774315 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:51:06.774315 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 14 12:51:06.774315 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:51:06.774315 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:51:06.774315 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:51:06.774315 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:51:06.774315 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:51:06.774315 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:51:06.774315 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:51:06.774315 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:51:06.775351 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 14 12:51:06.775351 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 14 12:51:06.775351 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 14 12:51:06.775351 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 14 12:51:06.775351 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 14 12:51:06.775351 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 14 12:51:06.775351 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 12:51:06.775351 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 14 12:51:06.778343 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 485/948] 10.222.0.17 () {56 vars in 1111 bytes} [Fri Oct 14 12:51:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:51:06.780681 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39ed44c-e5ee-4008-b01d-7e52aa20a55b None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:51:06.891756 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39ed44c-e5ee-4008-b01d-7e52aa20a55b None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:51:06.931212 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86b8447-0da2-426c-a79d-f7d08b0bbd26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:51:06.931891 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86b8447-0da2-426c-a79d-f7d08b0bbd26 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:51:06.932193 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86b8447-0da2-426c-a79d-f7d08b0bbd26 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:51:06.932467 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86b8447-0da2-426c-a79d-f7d08b0bbd26 None admin] PATH_INFO: `/v3/projects` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:51:06.933682 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86b8447-0da2-426c-a79d-f7d08b0bbd26 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:51:06.933984 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86b8447-0da2-426c-a79d-f7d08b0bbd26 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:51:06.935570 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86b8447-0da2-426c-a79d-f7d08b0bbd26 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:51:06.949846 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 464/949] 10.222.0.17 () {56 vars in 1148 bytes} [Fri Oct 14 12:51:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 12:51:06.956363 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3d8eaf-4458-4f4a-87a2-9fdac9b24363 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:51:06.976871 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:51:07.076299 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3d8eaf-4458-4f4a-87a2-9fdac9b24363 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:51:07.118279 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e983ac4-bc3b-49c3-9d68-781d0dfb1307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:51:07.119078 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e983ac4-bc3b-49c3-9d68-781d0dfb1307 None admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:51:07.119459 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e983ac4-bc3b-49c3-9d68-781d0dfb1307 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:51:07.119755 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e983ac4-bc3b-49c3-9d68-781d0dfb1307 None admin] PATH_INFO: `/v3/projects/2486e73d493b40e18d9d988744993854/users/0a5e5c35ed8b4abc877ba8d8c490dacd/roles/7f6e29e390bc41f7a9af17659a2e95d1` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:51:07.122436 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e983ac4-bc3b-49c3-9d68-781d0dfb1307 None admin] RBAC: Authorizing `identity:create_grant(project_id=2486e73d493b40e18d9d988744993854, user_id=0a5e5c35ed8b4abc877ba8d8c490dacd, role_id=7f6e29e390bc41f7a9af17659a2e95d1)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:51:07.123949 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e983ac4-bc3b-49c3-9d68-781d0dfb1307 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:51:07.142623 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 486/950] 10.222.0.17 () {58 vars in 1439 bytes} [Fri Oct 14 12:51:06 2022] PUT /identity/v3/projects/2486e73d493b40e18d9d988744993854/users/0a5e5c35ed8b4abc877ba8d8c490dacd/roles/7f6e29e390bc41f7a9af17659a2e95d1 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 12:51:09.443519 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab6ff14-3bd7-4c7c-acb9-0ae326312a2a None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:51:09.444047 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab6ff14-3bd7-4c7c-acb9-0ae326312a2a None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:51:09.444150 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab6ff14-3bd7-4c7c-acb9-0ae326312a2a None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:51:09.445610 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 465/951] 10.222.0.17 () {54 vars in 927 bytes} [Fri Oct 14 12:51:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:51:09.452481 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1959b282-f2ca-4e7c-8d6e-cf17a3cc2d0b None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:51:09.453058 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1959b282-f2ca-4e7c-8d6e-cf17a3cc2d0b None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:51:09.453058 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1959b282-f2ca-4e7c-8d6e-cf17a3cc2d0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:51:09.474493 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-1959b282-f2ca-4e7c-8d6e-cf17a3cc2d0b None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:51:09.476266 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-1959b282-f2ca-4e7c-8d6e-cf17a3cc2d0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:51:09.563497 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 487/952] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Oct 14 12:51:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 14 12:51:09.848938 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab6ff14-3bd7-4c7c-acb9-0ae326312a2a None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:51:09.900811 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:51:09.971524 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab6ff14-3bd7-4c7c-acb9-0ae326312a2a None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:51:10.012532 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee94876e-dfb0-4658-9306-6b1ec17a9a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:51:10.013171 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee94876e-dfb0-4658-9306-6b1ec17a9a60 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:51:10.013450 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee94876e-dfb0-4658-9306-6b1ec17a9a60 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:51:10.013724 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee94876e-dfb0-4658-9306-6b1ec17a9a60 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:51:10.024453 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee94876e-dfb0-4658-9306-6b1ec17a9a60 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 12:51:10.031134 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-ee94876e-dfb0-4658-9306-6b1ec17a9a60 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 14 12:51:10.031134 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:51:10.031134 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:51:10.031134 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:51:10.031134 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:51:10.031134 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:51:10.031134 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:51:10.031134 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:51:10.031134 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:51:10.031134 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:51:10.031134 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:51:10.031134 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:51:10.031134 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 12:51:10.031134 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 12:51:10.031134 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 12:51:10.031134 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 12:51:10.032223 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 12:51:10.032223 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 12:51:10.032223 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 12:51:10.032223 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 12:51:10.032223 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:51:10.032223 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:51:10.032223 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:51:10.032223 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:51:10.032223 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:51:10.032223 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:51:10.032223 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:51:10.032223 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 14 12:51:10.032223 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:51:10.032223 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:51:10.032223 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:51:10.032223 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:51:10.033443 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:51:10.033443 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:51:10.033443 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:51:10.033443 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:51:10.033443 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 12:51:10.033443 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 12:51:10.033443 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 12:51:10.033443 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 12:51:10.033443 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 12:51:10.033443 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 12:51:10.033443 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 14 12:51:10.033443 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 14 12:51:10.033443 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 466/953] 10.222.0.17 () {56 vars in 1096 bytes} [Fri Oct 14 12:51:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:51:10.038899 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1959b282-f2ca-4e7c-8d6e-cf17a3cc2d0b None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:51:10.042615 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:51:10.167479 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1959b282-f2ca-4e7c-8d6e-cf17a3cc2d0b None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:51:10.204636 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfebcec-5e71-4014-b9d9-dfba047ba1bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:51:10.205256 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfebcec-5e71-4014-b9d9-dfba047ba1bc None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:51:10.205533 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfebcec-5e71-4014-b9d9-dfba047ba1bc None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:51:10.205821 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfebcec-5e71-4014-b9d9-dfba047ba1bc None admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:51:10.206498 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfebcec-5e71-4014-b9d9-dfba047ba1bc None admin] RBAC: Adding query filter params (name=admin) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:51:10.206803 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfebcec-5e71-4014-b9d9-dfba047ba1bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:51:10.208260 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfebcec-5e71-4014-b9d9-dfba047ba1bc None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:51:10.218458 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 488/954] 10.222.0.17 () {56 vars in 1099 bytes} [Fri Oct 14 12:51:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:51:10.224773 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee94876e-dfb0-4658-9306-6b1ec17a9a60 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:51:10.357394 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:51:10.360924 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee94876e-dfb0-4658-9306-6b1ec17a9a60 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:51:10.396515 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e510bb5-265a-43b2-86ab-c80dec26fcd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:51:10.397160 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e510bb5-265a-43b2-86ab-c80dec26fcd2 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:51:10.397439 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e510bb5-265a-43b2-86ab-c80dec26fcd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:51:10.397763 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e510bb5-265a-43b2-86ab-c80dec26fcd2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:51:10.408813 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e510bb5-265a-43b2-86ab-c80dec26fcd2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:51:10.410328 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e510bb5-265a-43b2-86ab-c80dec26fcd2 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:51:10.427223 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-7e510bb5-265a-43b2-86ab-c80dec26fcd2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:51:10.427223 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:51:10.427223 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:51:10.427223 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:51:10.427223 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:51:10.427223 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:51:10.427223 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:51:10.427223 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:51:10.427223 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:51:10.427223 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:51:10.427223 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:51:10.427223 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:51:10.427223 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 12:51:10.427223 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 12:51:10.427223 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 12:51:10.427223 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 12:51:10.428476 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:51:10.428476 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:51:10.428476 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:51:10.428476 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:51:10.428476 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:51:10.428476 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:51:10.428476 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:51:10.428476 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 14 12:51:10.428476 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:51:10.428476 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:51:10.428476 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:51:10.428476 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:51:10.428476 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:51:10.428476 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:51:10.428476 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:51:10.428476 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:51:10.428476 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 12:51:10.429632 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 12:51:10.429632 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:51:10.429632 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 14 12:51:10.430424 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 467/955] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Oct 14 12:51:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:51:10.436141 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfebcec-5e71-4014-b9d9-dfba047ba1bc None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:51:10.514966 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:51:10.563553 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfebcec-5e71-4014-b9d9-dfba047ba1bc None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:51:10.607041 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c012f5-bd3c-4088-b566-834b37865b6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:51:10.608172 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c012f5-bd3c-4088-b566-834b37865b6a None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:51:10.608512 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c012f5-bd3c-4088-b566-834b37865b6a None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:51:10.608877 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c012f5-bd3c-4088-b566-834b37865b6a None admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:51:10.609778 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c012f5-bd3c-4088-b566-834b37865b6a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:51:10.610259 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c012f5-bd3c-4088-b566-834b37865b6a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:51:10.612382 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c012f5-bd3c-4088-b566-834b37865b6a None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:51:10.629909 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 489/956] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Oct 14 12:51:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:51:10.636745 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e510bb5-265a-43b2-86ab-c80dec26fcd2 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:51:10.765763 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e510bb5-265a-43b2-86ab-c80dec26fcd2 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:51:10.816238 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bdad92-cd1c-4d29-a80d-ec58ef92c412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:51:10.816960 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bdad92-cd1c-4d29-a80d-ec58ef92c412 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:51:10.817400 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bdad92-cd1c-4d29-a80d-ec58ef92c412 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:51:10.817681 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bdad92-cd1c-4d29-a80d-ec58ef92c412 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:51:10.827462 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bdad92-cd1c-4d29-a80d-ec58ef92c412 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:51:10.829019 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bdad92-cd1c-4d29-a80d-ec58ef92c412 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:51:10.843881 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-66bdad92-cd1c-4d29-a80d-ec58ef92c412 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 14 12:51:10.843881 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:51:10.843881 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:51:10.843881 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:51:10.843881 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:51:10.843881 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:51:10.843881 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:51:10.843881 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:51:10.843881 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:51:10.843881 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:51:10.843881 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:51:10.843881 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:51:10.843881 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 14 12:51:10.843881 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 14 12:51:10.843881 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 14 12:51:10.843881 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 14 12:51:10.845093 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:51:10.845093 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:51:10.845093 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 14 12:51:10.845093 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 12:51:10.845093 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 14 12:51:10.845093 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 12:51:10.845093 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:51:10.845093 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:51:10.845093 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:51:10.845093 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:51:10.845093 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:51:10.845093 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 14 12:51:10.845093 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:51:10.845093 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:51:10.845093 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:51:10.845093 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:51:10.845093 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:51:10.845093 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:51:10.851242 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:51:10.851242 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:51:10.851242 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 14 12:51:10.851242 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 14 12:51:10.851242 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 14 12:51:10.851242 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 14 12:51:10.851242 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 14 12:51:10.851242 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 14 12:51:10.851242 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 14 12:51:10.851242 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 14 12:51:10.851242 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 468/957] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Oct 14 12:51:10 2022] GET /identity/v3/users/placement => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:51:10.853623 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c012f5-bd3c-4088-b566-834b37865b6a None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:51:10.967499 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c012f5-bd3c-4088-b566-834b37865b6a None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:51:10.996937 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:51:11.008077 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4457c03-c4ca-48bd-bd77-8785a8075cbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:51:11.008714 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4457c03-c4ca-48bd-bd77-8785a8075cbe None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:51:11.008976 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4457c03-c4ca-48bd-bd77-8785a8075cbe None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:51:11.009260 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4457c03-c4ca-48bd-bd77-8785a8075cbe None admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:51:11.010051 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4457c03-c4ca-48bd-bd77-8785a8075cbe None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:51:11.010367 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4457c03-c4ca-48bd-bd77-8785a8075cbe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:51:11.012697 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4457c03-c4ca-48bd-bd77-8785a8075cbe None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:51:11.032474 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 490/958] 10.222.0.17 () {56 vars in 1143 bytes} [Fri Oct 14 12:51:10 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:51:11.040919 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bdad92-cd1c-4d29-a80d-ec58ef92c412 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:51:11.059740 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:51:11.168596 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bdad92-cd1c-4d29-a80d-ec58ef92c412 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:51:11.205449 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f288ff-4948-44b9-90da-cfdbc0f717a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:51:11.206065 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f288ff-4948-44b9-90da-cfdbc0f717a0 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:51:11.206369 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f288ff-4948-44b9-90da-cfdbc0f717a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:51:11.206636 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f288ff-4948-44b9-90da-cfdbc0f717a0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:51:11.290990 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f288ff-4948-44b9-90da-cfdbc0f717a0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:51:11.293134 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f288ff-4948-44b9-90da-cfdbc0f717a0 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:51:11.308339 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:51:11.410215 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 469/959] 10.222.0.17 () {58 vars in 1282 bytes} [Fri Oct 14 12:51:11 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 14 12:51:11.416101 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4457c03-c4ca-48bd-bd77-8785a8075cbe None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:51:11.539990 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4457c03-c4ca-48bd-bd77-8785a8075cbe None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:51:11.580032 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a083d13-4eaf-40e1-9aea-ea3e3904e33e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:51:11.580675 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a083d13-4eaf-40e1-9aea-ea3e3904e33e None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:51:11.580951 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a083d13-4eaf-40e1-9aea-ea3e3904e33e None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:51:11.581283 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a083d13-4eaf-40e1-9aea-ea3e3904e33e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:51:11.594639 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a083d13-4eaf-40e1-9aea-ea3e3904e33e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:51:11.596469 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a083d13-4eaf-40e1-9aea-ea3e3904e33e None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:51:11.615793 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-6a083d13-4eaf-40e1-9aea-ea3e3904e33e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:51:11.615793 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:51:11.615793 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:51:11.615793 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:51:11.615793 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:51:11.615793 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:51:11.615793 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:51:11.615793 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:51:11.615793 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:51:11.615793 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:51:11.615793 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:51:11.615793 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:51:11.615793 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 12:51:11.615793 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 12:51:11.615793 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 12:51:11.615793 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 12:51:11.616984 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:51:11.616984 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:51:11.616984 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:51:11.616984 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:51:11.616984 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:51:11.616984 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:51:11.616984 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:51:11.616984 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 14 12:51:11.616984 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:51:11.616984 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:51:11.616984 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:51:11.616984 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:51:11.616984 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:51:11.616984 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:51:11.616984 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:51:11.616984 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:51:11.616984 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 12:51:11.617899 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 12:51:11.617899 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 12:51:11.617899 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 14 12:51:11.617899 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 491/960] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Oct 14 12:51:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:51:11.624609 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f288ff-4948-44b9-90da-cfdbc0f717a0 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:51:11.744582 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f288ff-4948-44b9-90da-cfdbc0f717a0 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:51:11.761610 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:51:11.786318 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec64e80d-cc39-43cf-a9d1-c95093c445b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:51:11.787106 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec64e80d-cc39-43cf-a9d1-c95093c445b9 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:51:11.787490 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec64e80d-cc39-43cf-a9d1-c95093c445b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:51:11.787892 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec64e80d-cc39-43cf-a9d1-c95093c445b9 None admin] PATH_INFO: `/v3/domains` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:51:11.788569 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec64e80d-cc39-43cf-a9d1-c95093c445b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:51:11.788947 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec64e80d-cc39-43cf-a9d1-c95093c445b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:51:11.790491 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec64e80d-cc39-43cf-a9d1-c95093c445b9 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:51:11.804447 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 470/961] 10.222.0.17 () {56 vars in 1109 bytes} [Fri Oct 14 12:51:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:51:11.811340 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a083d13-4eaf-40e1-9aea-ea3e3904e33e None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:51:11.856724 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:51:11.929619 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a083d13-4eaf-40e1-9aea-ea3e3904e33e None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:51:11.983637 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f346a39-eda9-4d1b-9793-15404f45a49c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:51:11.984283 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f346a39-eda9-4d1b-9793-15404f45a49c None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:51:11.984562 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f346a39-eda9-4d1b-9793-15404f45a49c None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:51:11.984832 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f346a39-eda9-4d1b-9793-15404f45a49c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:51:11.992322 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f346a39-eda9-4d1b-9793-15404f45a49c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:51:11.994622 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f346a39-eda9-4d1b-9793-15404f45a49c None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:51:12.007895 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application [None req-2f346a39-eda9-4d1b-9793-15404f45a49c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 12:51:12.007895 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:51:12.007895 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:51:12.007895 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:51:12.007895 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:51:12.007895 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:51:12.007895 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:51:12.007895 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:51:12.007895 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:51:12.007895 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:51:12.007895 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:51:12.007895 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:51:12.007895 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 14 12:51:12.007895 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 14 12:51:12.007895 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 14 12:51:12.009655 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 14 12:51:12.009655 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:51:12.009655 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:51:12.009655 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:51:12.009655 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:51:12.009655 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:51:12.009655 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:51:12.009655 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:51:12.009655 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application with Lock( Oct 14 12:51:12.009655 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:51:12.009655 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:51:12.009655 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:51:12.009655 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:51:12.009655 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:51:12.009655 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:51:12.009655 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:51:12.009655 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:51:12.011587 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 14 12:51:12.011587 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 14 12:51:12.011587 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 14 12:51:12.011587 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 14 12:51:12.011587 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 14 12:51:12.011587 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 14 12:51:12.011587 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 12:51:12.011587 dv-cinder-820994-7-smb devstack@keystone.service[81438]: ERROR keystone.server.flask.application Oct 14 12:51:12.011587 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 492/962] 10.222.0.17 () {56 vars in 1111 bytes} [Fri Oct 14 12:51:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:51:12.015515 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec64e80d-cc39-43cf-a9d1-c95093c445b9 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:51:12.143565 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec64e80d-cc39-43cf-a9d1-c95093c445b9 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:51:12.185728 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86219845-afad-4bda-a0dc-243afb1d20fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:51:12.186398 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86219845-afad-4bda-a0dc-243afb1d20fd None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:51:12.186682 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86219845-afad-4bda-a0dc-243afb1d20fd None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:51:12.186959 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86219845-afad-4bda-a0dc-243afb1d20fd None admin] PATH_INFO: `/v3/projects` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:51:12.187674 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86219845-afad-4bda-a0dc-243afb1d20fd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:51:12.187997 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86219845-afad-4bda-a0dc-243afb1d20fd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:51:12.189476 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86219845-afad-4bda-a0dc-243afb1d20fd None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:51:12.205044 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 471/963] 10.222.0.17 () {56 vars in 1148 bytes} [Fri Oct 14 12:51:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 12:51:12.211470 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f346a39-eda9-4d1b-9793-15404f45a49c None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:51:12.329404 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:51:12.337227 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f346a39-eda9-4d1b-9793-15404f45a49c None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:51:12.376620 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8b6c47-c4ae-4c6e-b279-b8762704e7f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:51:12.377239 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8b6c47-c4ae-4c6e-b279-b8762704e7f3 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:51:12.377516 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8b6c47-c4ae-4c6e-b279-b8762704e7f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:51:12.377787 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8b6c47-c4ae-4c6e-b279-b8762704e7f3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:51:12.378563 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8b6c47-c4ae-4c6e-b279-b8762704e7f3 None admin] RBAC: Adding query filter params (role.id=7f6e29e390bc41f7a9af17659a2e95d1, scope.project.id=2486e73d493b40e18d9d988744993854, user.id=0a5e5c35ed8b4abc877ba8d8c490dacd) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:51:12.378880 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8b6c47-c4ae-4c6e-b279-b8762704e7f3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:51:12.380394 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8b6c47-c4ae-4c6e-b279-b8762704e7f3 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:51:12.388348 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 493/964] 10.222.0.17 () {56 vars in 1374 bytes} [Fri Oct 14 12:51:12 2022] GET /identity/v3/role_assignments?user.id=0a5e5c35ed8b4abc877ba8d8c490dacd&scope.project.id=2486e73d493b40e18d9d988744993854&role.id=7f6e29e390bc41f7a9af17659a2e95d1 => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 12:51:14.616576 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290404f8-6cec-43eb-a310-d41ca4d0ac78 None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:51:14.617197 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290404f8-6cec-43eb-a310-d41ca4d0ac78 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:51:14.617197 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290404f8-6cec-43eb-a310-d41ca4d0ac78 None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:51:14.618849 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 472/965] 10.222.0.17 () {54 vars in 927 bytes} [Fri Oct 14 12:51:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 14 12:51:14.625299 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902bf7ef-24a4-4113-b3f6-6cd343f805a5 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:51:14.625941 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902bf7ef-24a4-4113-b3f6-6cd343f805a5 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:51:14.625941 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902bf7ef-24a4-4113-b3f6-6cd343f805a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:51:14.644971 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-902bf7ef-24a4-4113-b3f6-6cd343f805a5 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:51:14.646216 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-902bf7ef-24a4-4113-b3f6-6cd343f805a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:51:14.717685 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 494/966] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Oct 14 12:51:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 14 12:51:14.984036 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290404f8-6cec-43eb-a310-d41ca4d0ac78 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:51:15.015189 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:51:15.088362 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290404f8-6cec-43eb-a310-d41ca4d0ac78 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:51:15.123601 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8784247-0c04-4280-99dc-d78da8f1d0cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:51:15.124226 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8784247-0c04-4280-99dc-d78da8f1d0cc None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:51:15.124503 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8784247-0c04-4280-99dc-d78da8f1d0cc None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:51:15.124768 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8784247-0c04-4280-99dc-d78da8f1d0cc None admin] PATH_INFO: `/v3/services/placement` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:51:15.125344 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8784247-0c04-4280-99dc-d78da8f1d0cc None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:51:15.126745 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8784247-0c04-4280-99dc-d78da8f1d0cc None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:51:15.135663 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-e8784247-0c04-4280-99dc-d78da8f1d0cc None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 14 12:51:15.135663 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:51:15.135663 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 14 12:51:15.135663 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 14 12:51:15.135663 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 14 12:51:15.135663 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 14 12:51:15.135663 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 14 12:51:15.135663 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 12:51:15.135663 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 14 12:51:15.135663 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 14 12:51:15.135663 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 14 12:51:15.135663 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 14 12:51:15.135663 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:51:15.135663 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:51:15.135663 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:51:15.135663 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:51:15.135663 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:51:15.137097 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:51:15.137097 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:51:15.137097 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:51:15.137097 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:51:15.137097 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:51:15.137097 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:51:15.137097 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 14 12:51:15.137097 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 14 12:51:15.137097 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 14 12:51:15.137097 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 14 12:51:15.137097 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:51:15.137097 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:51:15.137097 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:51:15.137097 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:51:15.137097 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:51:15.137097 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:51:15.137959 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:51:15.137959 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 14 12:51:15.137959 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:51:15.137959 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:51:15.137959 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:51:15.137959 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:51:15.137959 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:51:15.137959 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:51:15.137959 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:51:15.137959 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:51:15.137959 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 14 12:51:15.137959 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 12:51:15.137959 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 14 12:51:15.137959 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 14 12:51:15.137959 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 473/967] 10.222.0.17 () {56 vars in 1117 bytes} [Fri Oct 14 12:51:14 2022] GET /identity/v3/services/placement => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:51:15.142962 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902bf7ef-24a4-4113-b3f6-6cd343f805a5 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:51:15.236535 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:51:15.246781 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902bf7ef-24a4-4113-b3f6-6cd343f805a5 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:51:15.281826 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee88ae3-bc00-4185-a7e8-3b4871fe1a69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:51:15.282470 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee88ae3-bc00-4185-a7e8-3b4871fe1a69 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:51:15.282748 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee88ae3-bc00-4185-a7e8-3b4871fe1a69 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:51:15.283017 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee88ae3-bc00-4185-a7e8-3b4871fe1a69 None admin] PATH_INFO: `/v3/services` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:51:15.283650 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee88ae3-bc00-4185-a7e8-3b4871fe1a69 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:51:15.283953 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee88ae3-bc00-4185-a7e8-3b4871fe1a69 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:51:15.285334 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee88ae3-bc00-4185-a7e8-3b4871fe1a69 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:51:15.290387 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 495/968] 10.222.0.17 () {56 vars in 1116 bytes} [Fri Oct 14 12:51:15 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:51:15.296378 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8784247-0c04-4280-99dc-d78da8f1d0cc None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:51:15.391612 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:51:15.397847 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8784247-0c04-4280-99dc-d78da8f1d0cc None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:51:15.433267 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fef20d-18b8-46e4-8372-4a52ab880849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:51:15.434011 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fef20d-18b8-46e4-8372-4a52ab880849 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:51:15.434328 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fef20d-18b8-46e4-8372-4a52ab880849 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:51:15.434603 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fef20d-18b8-46e4-8372-4a52ab880849 None admin] PATH_INFO: `/v3/services` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:51:15.435236 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fef20d-18b8-46e4-8372-4a52ab880849 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:51:15.435542 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fef20d-18b8-46e4-8372-4a52ab880849 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:51:15.436928 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fef20d-18b8-46e4-8372-4a52ab880849 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:51:15.441509 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 474/969] 10.222.0.17 () {56 vars in 1116 bytes} [Fri Oct 14 12:51:15 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:51:17.615472 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2deafa8-70f8-4a04-ab11-012f42dba883 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:51:17.616285 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2deafa8-70f8-4a04-ab11-012f42dba883 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:51:17.616285 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2deafa8-70f8-4a04-ab11-012f42dba883 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:51:17.617507 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 496/970] 10.222.0.17 () {54 vars in 927 bytes} [Fri Oct 14 12:51:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 14 12:51:17.624976 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d86aae5-eb99-4074-ad32-e0513338f48c None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:51:17.625672 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d86aae5-eb99-4074-ad32-e0513338f48c None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:51:17.625976 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d86aae5-eb99-4074-ad32-e0513338f48c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:51:17.650565 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-7d86aae5-eb99-4074-ad32-e0513338f48c None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:51:17.651993 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-7d86aae5-eb99-4074-ad32-e0513338f48c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:51:17.731203 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 475/971] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Oct 14 12:51:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 14 12:51:17.999528 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2deafa8-70f8-4a04-ab11-012f42dba883 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:51:18.106216 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2deafa8-70f8-4a04-ab11-012f42dba883 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:51:18.141913 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4a1a14-d450-4066-9339-eb6d0eb070bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:51:18.142681 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4a1a14-d450-4066-9339-eb6d0eb070bd None admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:51:18.142959 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4a1a14-d450-4066-9339-eb6d0eb070bd None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:51:18.143229 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4a1a14-d450-4066-9339-eb6d0eb070bd None admin] PATH_INFO: `/v3/services` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:51:18.143877 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4a1a14-d450-4066-9339-eb6d0eb070bd None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:51:18.145251 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4a1a14-d450-4066-9339-eb6d0eb070bd None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:51:18.164677 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 497/972] 10.222.0.17 () {60 vars in 1141 bytes} [Fri Oct 14 12:51:17 2022] POST /identity/v3/services => generated 246 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 12:51:20.365225 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda3e33d-313e-4796-b727-d6b5f3d29121 None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:51:20.365731 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda3e33d-313e-4796-b727-d6b5f3d29121 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:51:20.365731 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda3e33d-313e-4796-b727-d6b5f3d29121 None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:51:20.367054 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 476/973] 10.222.0.17 () {54 vars in 927 bytes} [Fri Oct 14 12:51:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:51:20.373045 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6c5094-7084-4f1f-bc30-9d1365b76fa4 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:51:20.373633 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6c5094-7084-4f1f-bc30-9d1365b76fa4 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:51:20.373633 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6c5094-7084-4f1f-bc30-9d1365b76fa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:51:20.392474 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-ce6c5094-7084-4f1f-bc30-9d1365b76fa4 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:51:20.393691 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-ce6c5094-7084-4f1f-bc30-9d1365b76fa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:51:20.403498 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:51:20.468032 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 498/974] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Oct 14 12:51:20 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 14 12:51:20.759703 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda3e33d-313e-4796-b727-d6b5f3d29121 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:51:20.852540 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:51:20.864316 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda3e33d-313e-4796-b727-d6b5f3d29121 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:51:20.899123 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372e5496-9f11-4d7a-89dc-795759d902b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:51:20.899746 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372e5496-9f11-4d7a-89dc-795759d902b4 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:51:20.900020 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372e5496-9f11-4d7a-89dc-795759d902b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:51:20.900290 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372e5496-9f11-4d7a-89dc-795759d902b4 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:51:20.900921 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372e5496-9f11-4d7a-89dc-795759d902b4 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:51:20.902375 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372e5496-9f11-4d7a-89dc-795759d902b4 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:51:20.911213 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-372e5496-9f11-4d7a-89dc-795759d902b4 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 14 12:51:20.911213 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:51:20.911213 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 14 12:51:20.911213 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 14 12:51:20.911213 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 14 12:51:20.911213 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 14 12:51:20.911213 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 14 12:51:20.911213 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 12:51:20.911213 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 14 12:51:20.911213 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 14 12:51:20.911213 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 14 12:51:20.911213 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 14 12:51:20.911213 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:51:20.911213 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:51:20.911213 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:51:20.911213 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:51:20.911213 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:51:20.912435 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:51:20.912435 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:51:20.912435 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:51:20.912435 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:51:20.912435 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:51:20.912435 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:51:20.912435 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 14 12:51:20.912435 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 14 12:51:20.912435 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 14 12:51:20.912435 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 14 12:51:20.912435 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:51:20.912435 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:51:20.912435 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:51:20.912435 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:51:20.912435 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:51:20.912435 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:51:20.913442 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:51:20.913442 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 14 12:51:20.913442 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:51:20.913442 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:51:20.913442 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:51:20.913442 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:51:20.913442 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:51:20.913442 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:51:20.913442 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:51:20.913442 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:51:20.913442 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 14 12:51:20.913442 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 12:51:20.913442 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 14 12:51:20.913442 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 14 12:51:20.913442 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 477/975] 10.222.0.17 () {56 vars in 1117 bytes} [Fri Oct 14 12:51:20 2022] GET /identity/v3/services/placement => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:51:20.918964 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6c5094-7084-4f1f-bc30-9d1365b76fa4 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:51:21.019109 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6c5094-7084-4f1f-bc30-9d1365b76fa4 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:51:21.056100 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd60e7a-f70c-4594-ac7b-fc2b79855871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:51:21.056709 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd60e7a-f70c-4594-ac7b-fc2b79855871 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:51:21.057504 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd60e7a-f70c-4594-ac7b-fc2b79855871 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:51:21.057776 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd60e7a-f70c-4594-ac7b-fc2b79855871 None admin] PATH_INFO: `/v3/services` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:51:21.058431 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd60e7a-f70c-4594-ac7b-fc2b79855871 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:51:21.058734 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd60e7a-f70c-4594-ac7b-fc2b79855871 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:51:21.060114 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd60e7a-f70c-4594-ac7b-fc2b79855871 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:51:21.065445 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 499/976] 10.222.0.17 () {56 vars in 1116 bytes} [Fri Oct 14 12:51:20 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:51:21.071507 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372e5496-9f11-4d7a-89dc-795759d902b4 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:51:21.172698 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372e5496-9f11-4d7a-89dc-795759d902b4 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:51:21.208889 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828755d1-41e9-4481-a184-ad496091392d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:51:21.209489 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828755d1-41e9-4481-a184-ad496091392d None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:51:21.209764 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828755d1-41e9-4481-a184-ad496091392d None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:51:21.210031 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828755d1-41e9-4481-a184-ad496091392d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:51:21.211249 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828755d1-41e9-4481-a184-ad496091392d None admin] RBAC: Adding query filter params (interface=public, service_id=871083e9576f4d39b93464a382d82913, region_id=RegionOne) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:51:21.211668 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828755d1-41e9-4481-a184-ad496091392d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:51:21.213044 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828755d1-41e9-4481-a184-ad496091392d None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:51:21.218635 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 478/977] 10.222.0.17 () {56 vars in 1251 bytes} [Fri Oct 14 12:51:21 2022] GET /identity/v3/endpoints?service_id=871083e9576f4d39b93464a382d82913&interface=public®ion_id=RegionOne => generated 194 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:51:21.224501 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd60e7a-f70c-4594-ac7b-fc2b79855871 None admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:51:21.228344 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:51:21.326441 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd60e7a-f70c-4594-ac7b-fc2b79855871 None admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:51:21.360055 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade3b058-425c-41d3-8cf9-771d5b1d81b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:51:21.360662 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade3b058-425c-41d3-8cf9-771d5b1d81b8 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:51:21.360937 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade3b058-425c-41d3-8cf9-771d5b1d81b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:51:21.361207 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade3b058-425c-41d3-8cf9-771d5b1d81b8 None admin] PATH_INFO: `/v3/services` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:51:21.361807 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade3b058-425c-41d3-8cf9-771d5b1d81b8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:51:21.363208 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade3b058-425c-41d3-8cf9-771d5b1d81b8 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:51:21.370761 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 500/978] 10.222.0.17 () {56 vars in 1087 bytes} [Fri Oct 14 12:51:21 2022] GET /identity/v3/services => generated 2191 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 12:51:23.538863 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43140707-f28f-42e8-9c05-665c2260e4c5 None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:51:23.539371 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43140707-f28f-42e8-9c05-665c2260e4c5 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:51:23.539371 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43140707-f28f-42e8-9c05-665c2260e4c5 None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:51:23.540667 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 479/979] 10.222.0.17 () {54 vars in 927 bytes} [Fri Oct 14 12:51:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:51:23.546595 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b20bb23-00f2-4fa9-822c-0980a5d86a77 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:51:23.547079 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b20bb23-00f2-4fa9-822c-0980a5d86a77 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:51:23.547190 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b20bb23-00f2-4fa9-822c-0980a5d86a77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:51:23.566269 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-8b20bb23-00f2-4fa9-822c-0980a5d86a77 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:51:23.567481 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-8b20bb23-00f2-4fa9-822c-0980a5d86a77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:51:23.634769 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:51:23.643406 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 501/980] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Oct 14 12:51:23 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 14 12:51:23.930270 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43140707-f28f-42e8-9c05-665c2260e4c5 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:51:23.950799 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:51:24.033559 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43140707-f28f-42e8-9c05-665c2260e4c5 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:51:24.066995 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b7a2cf-790a-431e-a8d5-d4a34422dce5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:51:24.067619 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b7a2cf-790a-431e-a8d5-d4a34422dce5 None admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:51:24.067894 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b7a2cf-790a-431e-a8d5-d4a34422dce5 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:51:24.068162 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b7a2cf-790a-431e-a8d5-d4a34422dce5 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:51:24.068733 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b7a2cf-790a-431e-a8d5-d4a34422dce5 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:51:24.070151 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b7a2cf-790a-431e-a8d5-d4a34422dce5 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:51:24.079298 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application [None req-e9b7a2cf-790a-431e-a8d5-d4a34422dce5 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 14 12:51:24.079298 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:51:24.079298 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 14 12:51:24.079298 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 14 12:51:24.079298 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 14 12:51:24.079298 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 14 12:51:24.079298 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 14 12:51:24.079298 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 12:51:24.079298 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 14 12:51:24.079298 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 14 12:51:24.079298 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 14 12:51:24.079298 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 14 12:51:24.079298 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 12:51:24.079298 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 12:51:24.079298 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 12:51:24.079298 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 12:51:24.079298 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 12:51:24.080471 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 12:51:24.080471 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 12:51:24.080471 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 12:51:24.080471 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 12:51:24.080471 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 12:51:24.080471 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 12:51:24.080471 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 14 12:51:24.080471 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 14 12:51:24.080471 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 14 12:51:24.080471 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 14 12:51:24.080471 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 12:51:24.080471 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 12:51:24.080471 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 12:51:24.080471 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 12:51:24.080471 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 12:51:24.080471 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 12:51:24.081316 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 12:51:24.081316 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application with Lock( Oct 14 12:51:24.081316 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 12:51:24.081316 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self._enter() Oct 14 12:51:24.081316 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 12:51:24.081316 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 12:51:24.081316 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 12:51:24.081316 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application return self.creator() Oct 14 12:51:24.081316 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 12:51:24.081316 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application created_value = creator( Oct 14 12:51:24.081316 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 14 12:51:24.081316 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 12:51:24.081316 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 14 12:51:24.081316 dv-cinder-820994-7-smb devstack@keystone.service[81439]: ERROR keystone.server.flask.application Oct 14 12:51:24.081316 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 480/981] 10.222.0.17 () {56 vars in 1117 bytes} [Fri Oct 14 12:51:23 2022] GET /identity/v3/services/placement => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 12:51:24.086478 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b20bb23-00f2-4fa9-822c-0980a5d86a77 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:51:24.184987 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b20bb23-00f2-4fa9-822c-0980a5d86a77 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:51:24.221194 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6560bd-088e-40a9-b0d7-cafdfa35d863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:51:24.221782 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6560bd-088e-40a9-b0d7-cafdfa35d863 None admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:51:24.222056 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6560bd-088e-40a9-b0d7-cafdfa35d863 None admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:51:24.222352 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6560bd-088e-40a9-b0d7-cafdfa35d863 None admin] PATH_INFO: `/v3/services` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:51:24.222968 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6560bd-088e-40a9-b0d7-cafdfa35d863 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:51:24.223266 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6560bd-088e-40a9-b0d7-cafdfa35d863 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:51:24.224633 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6560bd-088e-40a9-b0d7-cafdfa35d863 None admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:51:24.230317 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 502/982] 10.222.0.17 () {56 vars in 1116 bytes} [Fri Oct 14 12:51:24 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:51:24.236524 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b7a2cf-790a-431e-a8d5-d4a34422dce5 None admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:51:24.316102 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:51:24.333754 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b7a2cf-790a-431e-a8d5-d4a34422dce5 None admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:51:24.366493 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887676f3-0126-4c0b-8a56-47f0bc65b9e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:51:24.367095 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887676f3-0126-4c0b-8a56-47f0bc65b9e6 None admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:51:24.367377 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887676f3-0126-4c0b-8a56-47f0bc65b9e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:51:24.367652 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887676f3-0126-4c0b-8a56-47f0bc65b9e6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:51:24.368313 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887676f3-0126-4c0b-8a56-47f0bc65b9e6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:51:24.370357 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887676f3-0126-4c0b-8a56-47f0bc65b9e6 None admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:51:24.391963 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 481/983] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Oct 14 12:51:24 2022] POST /identity/v3/endpoints => generated 331 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 12:51:34.226880 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=69 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:51:34.387591 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=30,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:52:30.572002 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35739c4-e4c9-48fb-b0aa-2cd562add3e8 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:52:30.572592 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35739c4-e4c9-48fb-b0aa-2cd562add3e8 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:52:30.572592 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35739c4-e4c9-48fb-b0aa-2cd562add3e8 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:52:30.574196 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 503/984] 10.222.0.17 () {54 vars in 927 bytes} [Fri Oct 14 12:52:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:52:30.579527 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e117cb-9a93-479b-a832-5b2d6e07a508 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:52:30.580059 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e117cb-9a93-479b-a832-5b2d6e07a508 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:52:30.580059 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e117cb-9a93-479b-a832-5b2d6e07a508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:52:30.680561 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-56e117cb-9a93-479b-a832-5b2d6e07a508 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:52:30.681775 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-56e117cb-9a93-479b-a832-5b2d6e07a508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:52:30.792937 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 482/985] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Oct 14 12:52:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:52:31.088909 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a8822d-b784-4573-b6b3-da46e4d01320 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:52:31.089189 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a8822d-b784-4573-b6b3-da46e4d01320 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:52:31.089627 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a8822d-b784-4573-b6b3-da46e4d01320 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:52:31.091215 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 504/986] 10.222.0.17 () {54 vars in 964 bytes} [Fri Oct 14 12:52:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:52:31.098250 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f89d28-7bd8-4978-adcc-91ee8c81f340 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:52:31.098775 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f89d28-7bd8-4978-adcc-91ee8c81f340 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:52:31.099390 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f89d28-7bd8-4978-adcc-91ee8c81f340 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:52:31.193014 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-69f89d28-7bd8-4978-adcc-91ee8c81f340 None None] MFA Rules not processed for user `b2d483292f3a4794848fcacfba5b107e`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:52:31.194970 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-69f89d28-7bd8-4978-adcc-91ee8c81f340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:52:31.220030 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:52:31.284472 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 483/987] 10.222.0.17 () {58 vars in 1061 bytes} [Fri Oct 14 12:52:31 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:52:31.293550 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a8822d-b784-4573-b6b3-da46e4d01320 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:52:31.295357 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-06a8822d-b784-4573-b6b3-da46e4d01320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:52:31.415816 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a8822d-b784-4573-b6b3-da46e4d01320 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:52:31.495146 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a30c1c-d673-4fa8-9cdc-10f9d2ac5749 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d483292f3a4794848fcacfba5b107e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:52:31.495667 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a30c1c-d673-4fa8-9cdc-10f9d2ac5749 service neutron] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:52:31.495944 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a30c1c-d673-4fa8-9cdc-10f9d2ac5749 service neutron] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:52:31.496214 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a30c1c-d673-4fa8-9cdc-10f9d2ac5749 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:52:31.497797 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-45a30c1c-d673-4fa8-9cdc-10f9d2ac5749 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:52:31.556666 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:52:31.617759 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a30c1c-d673-4fa8-9cdc-10f9d2ac5749 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:52:31.619385 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a30c1c-d673-4fa8-9cdc-10f9d2ac5749 service neutron] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:52:31.641020 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 505/988] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 12:52:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 12:52:34.131192 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af7b006-0347-4a32-969d-d9632fa5bd60 None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:52:34.131831 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af7b006-0347-4a32-969d-d9632fa5bd60 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:52:34.132112 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af7b006-0347-4a32-969d-d9632fa5bd60 None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:52:34.133730 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 484/989] 10.222.0.17 () {54 vars in 927 bytes} [Fri Oct 14 12:52:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:52:34.138853 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba191494-df26-40a7-891a-6c83e3b80747 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:52:34.139285 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba191494-df26-40a7-891a-6c83e3b80747 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:52:34.139405 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba191494-df26-40a7-891a-6c83e3b80747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:52:34.211562 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-ba191494-df26-40a7-891a-6c83e3b80747 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:52:34.212797 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-ba191494-df26-40a7-891a-6c83e3b80747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:52:34.309193 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 506/990] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Oct 14 12:52:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:52:34.611488 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4228266e-5329-488e-9050-3b8a0f952d88 None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:52:34.611808 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4228266e-5329-488e-9050-3b8a0f952d88 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:52:34.612075 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4228266e-5329-488e-9050-3b8a0f952d88 None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:52:34.613431 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 485/991] 10.222.0.17 () {54 vars in 964 bytes} [Fri Oct 14 12:52:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:52:34.619678 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3c4284-bca8-4d09-9803-14d868e6b4a6 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:52:34.619958 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3c4284-bca8-4d09-9803-14d868e6b4a6 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:52:34.620321 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3c4284-bca8-4d09-9803-14d868e6b4a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:52:34.634461 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:52:34.708213 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-4c3c4284-bca8-4d09-9803-14d868e6b4a6 None None] MFA Rules not processed for user `b2d483292f3a4794848fcacfba5b107e`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:52:34.710138 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-4c3c4284-bca8-4d09-9803-14d868e6b4a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:52:34.795592 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 507/992] 10.222.0.17 () {58 vars in 1061 bytes} [Fri Oct 14 12:52:34 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:52:34.804925 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4228266e-5329-488e-9050-3b8a0f952d88 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:52:34.806544 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-4228266e-5329-488e-9050-3b8a0f952d88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:52:34.913317 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4228266e-5329-488e-9050-3b8a0f952d88 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:52:34.988051 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:52:34.990827 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8f02f5-7ebb-4cd6-a52b-c0c997f9be99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d483292f3a4794848fcacfba5b107e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:52:34.991453 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8f02f5-7ebb-4cd6-a52b-c0c997f9be99 service neutron] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:52:34.991924 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8f02f5-7ebb-4cd6-a52b-c0c997f9be99 service neutron] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:52:34.992259 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8f02f5-7ebb-4cd6-a52b-c0c997f9be99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:52:34.994280 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-da8f02f5-7ebb-4cd6-a52b-c0c997f9be99 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:52:35.102766 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8f02f5-7ebb-4cd6-a52b-c0c997f9be99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:52:35.104223 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8f02f5-7ebb-4cd6-a52b-c0c997f9be99 service neutron] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:52:35.123770 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 486/993] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 12:52:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 12:52:37.836004 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6d67b7-4559-469c-a251-7f5196e8f22b None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:52:37.836652 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6d67b7-4559-469c-a251-7f5196e8f22b None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:52:37.836652 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6d67b7-4559-469c-a251-7f5196e8f22b None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:52:37.837932 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 508/994] 10.222.0.17 () {54 vars in 927 bytes} [Fri Oct 14 12:52:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:52:37.843284 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3bbfe0-e7cf-4099-9bcb-a726fc06126b None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:52:37.843711 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3bbfe0-e7cf-4099-9bcb-a726fc06126b None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:52:37.843837 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3bbfe0-e7cf-4099-9bcb-a726fc06126b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:52:37.910889 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-cb3bbfe0-e7cf-4099-9bcb-a726fc06126b None None] MFA Rules not processed for user `bb38b29e9ad84f16b142b35dfce4e938`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:52:37.912138 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-cb3bbfe0-e7cf-4099-9bcb-a726fc06126b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:52:37.964719 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:52:38.009669 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 487/995] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Oct 14 12:52:37 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:52:38.301436 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6d67b7-4559-469c-a251-7f5196e8f22b None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:52:38.303524 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-db6d67b7-4559-469c-a251-7f5196e8f22b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:52:38.409018 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6d67b7-4559-469c-a251-7f5196e8f22b None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:52:38.411762 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:52:38.484795 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b268994f-bb61-4532-9c66-9c8aec7f1383 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d483292f3a4794848fcacfba5b107e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:52:38.485399 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b268994f-bb61-4532-9c66-9c8aec7f1383 service neutron] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:52:38.485681 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b268994f-bb61-4532-9c66-9c8aec7f1383 service neutron] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:52:38.485947 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b268994f-bb61-4532-9c66-9c8aec7f1383 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:52:38.487584 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-b268994f-bb61-4532-9c66-9c8aec7f1383 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:52:38.597080 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b268994f-bb61-4532-9c66-9c8aec7f1383 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:52:38.598564 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b268994f-bb61-4532-9c66-9c8aec7f1383 service neutron] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:52:38.616632 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 509/996] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 12:52:38 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 12:52:41.332995 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ec14a4-8d5d-4740-ab65-791fdfd21788 None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:52:41.333590 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ec14a4-8d5d-4740-ab65-791fdfd21788 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:52:41.333590 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ec14a4-8d5d-4740-ab65-791fdfd21788 None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:52:41.335002 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 488/997] 10.222.0.17 () {54 vars in 927 bytes} [Fri Oct 14 12:52:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:52:41.340185 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e7b37c-6e04-4c63-aec8-cab3154b2947 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:52:41.340587 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e7b37c-6e04-4c63-aec8-cab3154b2947 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:52:41.340729 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e7b37c-6e04-4c63-aec8-cab3154b2947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:52:41.383399 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:52:41.409691 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-19e7b37c-6e04-4c63-aec8-cab3154b2947 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:52:41.410930 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-19e7b37c-6e04-4c63-aec8-cab3154b2947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:52:41.507803 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 510/998] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Oct 14 12:52:41 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:52:41.793010 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ec14a4-8d5d-4740-ab65-791fdfd21788 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:52:41.794569 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-34ec14a4-8d5d-4740-ab65-791fdfd21788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:52:41.899783 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ec14a4-8d5d-4740-ab65-791fdfd21788 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:52:41.971164 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4caede-8821-48bb-ba8d-286ecd0acd6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d483292f3a4794848fcacfba5b107e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:52:41.971766 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4caede-8821-48bb-ba8d-286ecd0acd6e service neutron] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:52:41.972040 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4caede-8821-48bb-ba8d-286ecd0acd6e service neutron] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:52:41.972306 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4caede-8821-48bb-ba8d-286ecd0acd6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:52:41.973875 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-aa4caede-8821-48bb-ba8d-286ecd0acd6e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:52:41.981739 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:52:42.082207 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4caede-8821-48bb-ba8d-286ecd0acd6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:52:42.083657 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4caede-8821-48bb-ba8d-286ecd0acd6e service neutron] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:52:42.104615 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 489/999] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 12:52:41 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 12:52:44.963070 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e50a07-8d79-4618-8ebb-222d15e5bad7 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:52:44.963668 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e50a07-8d79-4618-8ebb-222d15e5bad7 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:52:44.963668 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e50a07-8d79-4618-8ebb-222d15e5bad7 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:52:44.965046 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 511/1000] 10.222.0.17 () {54 vars in 927 bytes} [Fri Oct 14 12:52:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:52:44.970696 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0604a1ce-d5a3-4ad6-90b3-1d080457193a None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:52:44.971197 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0604a1ce-d5a3-4ad6-90b3-1d080457193a None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:52:44.971391 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0604a1ce-d5a3-4ad6-90b3-1d080457193a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:52:45.047653 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-0604a1ce-d5a3-4ad6-90b3-1d080457193a None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:52:45.049532 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-0604a1ce-d5a3-4ad6-90b3-1d080457193a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:52:45.130468 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:52:45.179395 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 490/1001] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Oct 14 12:52:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:52:45.461219 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e50a07-8d79-4618-8ebb-222d15e5bad7 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:52:45.462862 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-02e50a07-8d79-4618-8ebb-222d15e5bad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:52:45.573549 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e50a07-8d79-4618-8ebb-222d15e5bad7 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:52:45.587283 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:52:45.661969 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c16831e-bc20-4eb8-840f-95e319032fc4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d483292f3a4794848fcacfba5b107e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:52:45.663126 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c16831e-bc20-4eb8-840f-95e319032fc4 service neutron] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:52:45.663439 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c16831e-bc20-4eb8-840f-95e319032fc4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:52:45.663735 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c16831e-bc20-4eb8-840f-95e319032fc4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:52:45.665378 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-2c16831e-bc20-4eb8-840f-95e319032fc4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:52:45.779046 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c16831e-bc20-4eb8-840f-95e319032fc4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:52:45.780684 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c16831e-bc20-4eb8-840f-95e319032fc4 service neutron] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:52:45.798844 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 512/1002] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 12:52:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 12:52:48.057180 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15f1bd8-678c-4d57-a4af-fef3eb120ea6 None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:52:48.057783 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15f1bd8-678c-4d57-a4af-fef3eb120ea6 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:52:48.057783 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15f1bd8-678c-4d57-a4af-fef3eb120ea6 None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:52:48.059132 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 491/1003] 10.222.0.17 () {54 vars in 927 bytes} [Fri Oct 14 12:52:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:52:48.065180 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560f7cb4-c291-4f8f-93a7-24c8373474c2 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:52:48.065760 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560f7cb4-c291-4f8f-93a7-24c8373474c2 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:52:48.065760 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560f7cb4-c291-4f8f-93a7-24c8373474c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:52:48.122367 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:52:48.141802 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-560f7cb4-c291-4f8f-93a7-24c8373474c2 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:52:48.143055 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-560f7cb4-c291-4f8f-93a7-24c8373474c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:52:48.246102 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 513/1004] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Oct 14 12:52:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:52:48.527997 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15f1bd8-678c-4d57-a4af-fef3eb120ea6 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:52:48.529581 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-d15f1bd8-678c-4d57-a4af-fef3eb120ea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:52:48.636167 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15f1bd8-678c-4d57-a4af-fef3eb120ea6 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:52:48.710942 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda4d32c-f609-4338-832d-271b7a7b5330 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d483292f3a4794848fcacfba5b107e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:52:48.711545 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda4d32c-f609-4338-832d-271b7a7b5330 service neutron] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:52:48.711817 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda4d32c-f609-4338-832d-271b7a7b5330 service neutron] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:52:48.712081 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda4d32c-f609-4338-832d-271b7a7b5330 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:52:48.713659 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-eda4d32c-f609-4338-832d-271b7a7b5330 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:52:48.732486 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:52:48.828389 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda4d32c-f609-4338-832d-271b7a7b5330 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:52:48.829953 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda4d32c-f609-4338-832d-271b7a7b5330 service neutron] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:52:48.851229 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 492/1005] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 12:52:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 12:52:51.159066 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437f40e3-9d8d-468d-b471-01741dca6b4c None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:52:51.159541 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437f40e3-9d8d-468d-b471-01741dca6b4c None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:52:51.159730 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437f40e3-9d8d-468d-b471-01741dca6b4c None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:52:51.163283 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 514/1006] 10.222.0.17 () {54 vars in 927 bytes} [Fri Oct 14 12:52:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:52:51.167859 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a3b604-4dc6-4fa4-835b-db82de54842c None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:52:51.168340 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a3b604-4dc6-4fa4-835b-db82de54842c None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:52:51.168432 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a3b604-4dc6-4fa4-835b-db82de54842c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:52:51.237249 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-62a3b604-4dc6-4fa4-835b-db82de54842c None None] MFA Rules not processed for user `bb38b29e9ad84f16b142b35dfce4e938`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:52:51.238557 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-62a3b604-4dc6-4fa4-835b-db82de54842c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:52:51.309138 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:52:51.342786 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 493/1007] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Oct 14 12:52:51 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:52:51.637601 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437f40e3-9d8d-468d-b471-01741dca6b4c None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:52:51.639202 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-437f40e3-9d8d-468d-b471-01741dca6b4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:52:51.766368 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437f40e3-9d8d-468d-b471-01741dca6b4c None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:52:51.789077 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:52:51.843234 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76dcbed-c74a-40dd-a149-7b8a86626c08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d483292f3a4794848fcacfba5b107e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:52:51.843841 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76dcbed-c74a-40dd-a149-7b8a86626c08 service neutron] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:52:51.844118 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76dcbed-c74a-40dd-a149-7b8a86626c08 service neutron] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:52:51.844385 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76dcbed-c74a-40dd-a149-7b8a86626c08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:52:51.845966 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-f76dcbed-c74a-40dd-a149-7b8a86626c08 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:52:51.993757 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76dcbed-c74a-40dd-a149-7b8a86626c08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:52:51.995256 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76dcbed-c74a-40dd-a149-7b8a86626c08 service neutron] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:52:52.016408 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 515/1008] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 12:52:51 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 12:52:54.852095 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9735a6-321d-49cc-93b8-96c984397d90 None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:52:54.852637 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9735a6-321d-49cc-93b8-96c984397d90 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:52:54.852732 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9735a6-321d-49cc-93b8-96c984397d90 None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:52:54.853981 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 494/1009] 10.222.0.17 () {54 vars in 927 bytes} [Fri Oct 14 12:52:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:52:54.859422 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7f6bdd-2723-4643-915e-c1188ab2f3b7 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:52:54.859829 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7f6bdd-2723-4643-915e-c1188ab2f3b7 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:52:54.859967 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7f6bdd-2723-4643-915e-c1188ab2f3b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:52:54.926637 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:52:54.933310 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-ca7f6bdd-2723-4643-915e-c1188ab2f3b7 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:52:54.934563 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-ca7f6bdd-2723-4643-915e-c1188ab2f3b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:52:55.033453 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 516/1010] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Oct 14 12:52:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:52:55.309946 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9735a6-321d-49cc-93b8-96c984397d90 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:52:55.311648 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-5d9735a6-321d-49cc-93b8-96c984397d90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:52:55.414334 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9735a6-321d-49cc-93b8-96c984397d90 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:52:55.486722 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf187b38-42ed-4e3c-abc9-1f554309a6d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d483292f3a4794848fcacfba5b107e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:52:55.487319 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf187b38-42ed-4e3c-abc9-1f554309a6d0 service neutron] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:52:55.487593 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf187b38-42ed-4e3c-abc9-1f554309a6d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:52:55.487862 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf187b38-42ed-4e3c-abc9-1f554309a6d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:52:55.489433 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-bf187b38-42ed-4e3c-abc9-1f554309a6d0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:52:55.515807 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:52:55.598358 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf187b38-42ed-4e3c-abc9-1f554309a6d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:52:55.600328 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf187b38-42ed-4e3c-abc9-1f554309a6d0 service neutron] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:52:55.618767 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 495/1011] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 12:52:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 12:52:57.808027 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f33b279-7542-4252-a689-2bc8d4f5feb5 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:52:57.808563 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f33b279-7542-4252-a689-2bc8d4f5feb5 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:52:57.808563 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f33b279-7542-4252-a689-2bc8d4f5feb5 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:52:57.809904 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 517/1012] 10.222.0.17 () {54 vars in 927 bytes} [Fri Oct 14 12:52:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:52:57.815517 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e40fe8-0d42-423b-887e-7b4864a68e25 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:52:57.815899 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e40fe8-0d42-423b-887e-7b4864a68e25 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:52:57.816283 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e40fe8-0d42-423b-887e-7b4864a68e25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:52:57.885842 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-c8e40fe8-0d42-423b-887e-7b4864a68e25 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:52:57.887093 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-c8e40fe8-0d42-423b-887e-7b4864a68e25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:52:57.964751 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:52:57.987509 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 496/1013] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Oct 14 12:52:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:52:58.273717 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f33b279-7542-4252-a689-2bc8d4f5feb5 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:52:58.275294 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-1f33b279-7542-4252-a689-2bc8d4f5feb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:52:58.389617 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f33b279-7542-4252-a689-2bc8d4f5feb5 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:52:58.419979 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:52:58.465321 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38e8187-dd09-440a-93a1-7bca3cb163e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d483292f3a4794848fcacfba5b107e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:52:58.465922 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38e8187-dd09-440a-93a1-7bca3cb163e1 service neutron] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:52:58.466225 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38e8187-dd09-440a-93a1-7bca3cb163e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:52:58.466503 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38e8187-dd09-440a-93a1-7bca3cb163e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:52:58.468168 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-f38e8187-dd09-440a-93a1-7bca3cb163e1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:52:58.578801 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38e8187-dd09-440a-93a1-7bca3cb163e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:52:58.580251 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38e8187-dd09-440a-93a1-7bca3cb163e1 service neutron] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:52:58.598048 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 518/1014] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 12:52:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 12:53:01.218673 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf806c8-5163-4412-9297-8c4731f228bc None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:53:01.219237 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf806c8-5163-4412-9297-8c4731f228bc None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:53:01.219443 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf806c8-5163-4412-9297-8c4731f228bc None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:53:01.220927 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 497/1015] 10.222.0.17 () {54 vars in 927 bytes} [Fri Oct 14 12:53:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:53:01.226298 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d824a753-7aef-42d6-82f9-c65db9ca162a None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:53:01.226834 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d824a753-7aef-42d6-82f9-c65db9ca162a None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:53:01.226834 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d824a753-7aef-42d6-82f9-c65db9ca162a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:53:01.294105 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-d824a753-7aef-42d6-82f9-c65db9ca162a None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:53:01.295340 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-d824a753-7aef-42d6-82f9-c65db9ca162a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:53:01.304335 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:53:01.394307 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 519/1016] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Oct 14 12:53:01 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:53:01.686027 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf806c8-5163-4412-9297-8c4731f228bc None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:53:01.687982 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-5cf806c8-5163-4412-9297-8c4731f228bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:53:01.792093 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf806c8-5163-4412-9297-8c4731f228bc None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:53:01.864816 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8a6b03-ae8c-478e-8a61-d0ebc3f25702 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d483292f3a4794848fcacfba5b107e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:53:01.865413 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8a6b03-ae8c-478e-8a61-d0ebc3f25702 service neutron] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:53:01.865691 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8a6b03-ae8c-478e-8a61-d0ebc3f25702 service neutron] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:53:01.865962 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8a6b03-ae8c-478e-8a61-d0ebc3f25702 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:53:01.867589 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-be8a6b03-ae8c-478e-8a61-d0ebc3f25702 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:53:01.905883 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:53:01.989259 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8a6b03-ae8c-478e-8a61-d0ebc3f25702 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:53:01.990812 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8a6b03-ae8c-478e-8a61-d0ebc3f25702 service neutron] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:53:02.010422 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 498/1017] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 12:53:01 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 12:53:06.183464 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be6eeaf-acc7-4adb-95be-2e49dd541bd8 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:53:06.184048 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be6eeaf-acc7-4adb-95be-2e49dd541bd8 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:53:06.184048 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be6eeaf-acc7-4adb-95be-2e49dd541bd8 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:53:06.185532 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 520/1018] 10.222.0.17 () {54 vars in 927 bytes} [Fri Oct 14 12:53:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:53:06.190608 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb36cfa-3df7-4e6e-a4c3-742becbe8d71 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:53:06.191016 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb36cfa-3df7-4e6e-a4c3-742becbe8d71 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:53:06.191153 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb36cfa-3df7-4e6e-a4c3-742becbe8d71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:53:06.258102 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-2bb36cfa-3df7-4e6e-a4c3-742becbe8d71 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:53:06.259259 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-2bb36cfa-3df7-4e6e-a4c3-742becbe8d71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:53:06.348688 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:53:06.360854 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 499/1019] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Oct 14 12:53:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:53:06.645978 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be6eeaf-acc7-4adb-95be-2e49dd541bd8 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:53:06.647634 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-4be6eeaf-acc7-4adb-95be-2e49dd541bd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:53:06.759776 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be6eeaf-acc7-4adb-95be-2e49dd541bd8 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:53:06.799338 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:53:06.841543 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b25bd4-86c5-49c1-8d9f-48cc048cdd0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d483292f3a4794848fcacfba5b107e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:53:06.842171 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b25bd4-86c5-49c1-8d9f-48cc048cdd0c service neutron] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:53:06.842458 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b25bd4-86c5-49c1-8d9f-48cc048cdd0c service neutron] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:53:06.842728 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b25bd4-86c5-49c1-8d9f-48cc048cdd0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:53:06.844327 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-e9b25bd4-86c5-49c1-8d9f-48cc048cdd0c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:53:06.959848 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b25bd4-86c5-49c1-8d9f-48cc048cdd0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:53:06.961224 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b25bd4-86c5-49c1-8d9f-48cc048cdd0c service neutron] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:53:06.981064 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 521/1020] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 12:53:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 12:53:09.987078 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7fd9ea-33e1-4992-8fe8-41ed81aaae7d None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:53:09.987731 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7fd9ea-33e1-4992-8fe8-41ed81aaae7d None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:53:09.987731 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7fd9ea-33e1-4992-8fe8-41ed81aaae7d None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:53:09.989632 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 500/1021] 10.222.0.17 () {54 vars in 927 bytes} [Fri Oct 14 12:53:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:53:09.995394 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfa611c-01a9-4f05-a41d-1ade0029020c None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:53:09.995833 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfa611c-01a9-4f05-a41d-1ade0029020c None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:53:09.996218 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfa611c-01a9-4f05-a41d-1ade0029020c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:53:10.072546 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-ebfa611c-01a9-4f05-a41d-1ade0029020c None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:53:10.073830 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-ebfa611c-01a9-4f05-a41d-1ade0029020c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:53:10.099649 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:53:10.182379 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 522/1022] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Oct 14 12:53:09 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:53:10.490423 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7fd9ea-33e1-4992-8fe8-41ed81aaae7d None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:53:10.491965 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-8b7fd9ea-33e1-4992-8fe8-41ed81aaae7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:53:10.599002 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7fd9ea-33e1-4992-8fe8-41ed81aaae7d None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:53:10.691491 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeca16b-fc3d-4b9c-b66a-17128e64f04c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d483292f3a4794848fcacfba5b107e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:53:10.692794 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeca16b-fc3d-4b9c-b66a-17128e64f04c service neutron] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:53:10.693070 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeca16b-fc3d-4b9c-b66a-17128e64f04c service neutron] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:53:10.693341 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeca16b-fc3d-4b9c-b66a-17128e64f04c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:53:10.694986 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-1eeca16b-fc3d-4b9c-b66a-17128e64f04c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:53:10.737728 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:53:10.823063 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eeca16b-fc3d-4b9c-b66a-17128e64f04c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:53:10.825258 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eeca16b-fc3d-4b9c-b66a-17128e64f04c service neutron] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:53:10.849418 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 501/1023] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 12:53:10 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 12:53:15.427374 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46847ec2-efa7-440f-b0c8-5803177fc092 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:53:15.427911 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46847ec2-efa7-440f-b0c8-5803177fc092 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:53:15.427911 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46847ec2-efa7-440f-b0c8-5803177fc092 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:53:15.429241 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 523/1024] 10.222.0.17 () {54 vars in 927 bytes} [Fri Oct 14 12:53:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:53:15.435859 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6848036f-6810-495d-9901-a0cb997f035e None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:53:15.437152 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6848036f-6810-495d-9901-a0cb997f035e None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:53:15.437638 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6848036f-6810-495d-9901-a0cb997f035e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:53:15.514801 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-6848036f-6810-495d-9901-a0cb997f035e None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:53:15.516036 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-6848036f-6810-495d-9901-a0cb997f035e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:53:15.621314 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:53:15.624240 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 502/1025] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Oct 14 12:53:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 12:53:15.908145 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46847ec2-efa7-440f-b0c8-5803177fc092 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:53:15.909691 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-46847ec2-efa7-440f-b0c8-5803177fc092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:53:16.025230 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46847ec2-efa7-440f-b0c8-5803177fc092 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:53:16.075717 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:53:16.115142 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdc5d52-af7b-4e3a-a41a-24d51e6a863c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d483292f3a4794848fcacfba5b107e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:53:16.115750 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdc5d52-af7b-4e3a-a41a-24d51e6a863c service neutron] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:53:16.116026 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdc5d52-af7b-4e3a-a41a-24d51e6a863c service neutron] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:53:16.116292 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdc5d52-af7b-4e3a-a41a-24d51e6a863c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:53:16.117928 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-3fdc5d52-af7b-4e3a-a41a-24d51e6a863c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:53:16.243573 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdc5d52-af7b-4e3a-a41a-24d51e6a863c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:53:16.245036 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdc5d52-af7b-4e3a-a41a-24d51e6a863c service neutron] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:53:16.263967 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 524/1026] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 12:53:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 12:53:21.848538 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b674d9-c670-4b01-ae71-33f06843cbe2 None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:53:21.849025 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b674d9-c670-4b01-ae71-33f06843cbe2 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:53:21.849124 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b674d9-c670-4b01-ae71-33f06843cbe2 None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:53:21.852430 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 503/1027] 10.222.0.17 () {54 vars in 921 bytes} [Fri Oct 14 12:53:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:53:21.858513 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7ecea4-8285-4910-a21e-bc47cbbb9129 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:53:21.858971 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7ecea4-8285-4910-a21e-bc47cbbb9129 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:53:21.859072 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7ecea4-8285-4910-a21e-bc47cbbb9129 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:53:21.974760 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-ed7ecea4-8285-4910-a21e-bc47cbbb9129 None None] MFA Rules not processed for user `0a5e5c35ed8b4abc877ba8d8c490dacd`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:53:21.974760 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-ed7ecea4-8285-4910-a21e-bc47cbbb9129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:53:22.020350 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:53:22.164828 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 525/1028] 10.222.0.17 () {58 vars in 1018 bytes} [Fri Oct 14 12:53:21 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:53:26.752954 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e34811-21f1-4234-b57d-0c9c9497fe52 None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:53:26.754242 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e34811-21f1-4234-b57d-0c9c9497fe52 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:53:26.754429 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e34811-21f1-4234-b57d-0c9c9497fe52 None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:53:26.756020 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 504/1029] 10.222.0.17 () {54 vars in 921 bytes} [Fri Oct 14 12:53:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 14 12:53:26.761310 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdad198-5739-4b61-9168-b4f7bcf2e398 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:53:26.761990 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdad198-5739-4b61-9168-b4f7bcf2e398 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:53:26.761990 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdad198-5739-4b61-9168-b4f7bcf2e398 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:53:26.857758 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-6cdad198-5739-4b61-9168-b4f7bcf2e398 None None] MFA Rules not processed for user `0a5e5c35ed8b4abc877ba8d8c490dacd`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:53:26.859031 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-6cdad198-5739-4b61-9168-b4f7bcf2e398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:53:26.974547 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:53:27.037309 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 526/1030] 10.222.0.17 () {58 vars in 1018 bytes} [Fri Oct 14 12:53:26 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 12:53:28.593443 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3e91c6-bcbf-426b-9fa9-7a9f05fa4db0 None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:53:28.594297 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3e91c6-bcbf-426b-9fa9-7a9f05fa4db0 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:53:28.594462 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3e91c6-bcbf-426b-9fa9-7a9f05fa4db0 None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:53:28.596001 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 505/1031] 10.222.0.17 () {54 vars in 921 bytes} [Fri Oct 14 12:53:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:53:28.601830 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3c83fe-c3c4-4b35-abd4-0a95122c346c None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:53:28.602368 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3c83fe-c3c4-4b35-abd4-0a95122c346c None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:53:28.602533 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3c83fe-c3c4-4b35-abd4-0a95122c346c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:53:28.684685 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-6d3c83fe-c3c4-4b35-abd4-0a95122c346c None None] MFA Rules not processed for user `0a5e5c35ed8b4abc877ba8d8c490dacd`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:53:28.685885 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-6d3c83fe-c3c4-4b35-abd4-0a95122c346c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:53:28.799879 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 527/1032] 10.222.0.17 () {58 vars in 1018 bytes} [Fri Oct 14 12:53:28 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:53:32.043934 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0449cd06-a0e9-43d0-bc03-a697eb404cae None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:53:32.044458 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0449cd06-a0e9-43d0-bc03-a697eb404cae None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:53:32.044574 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0449cd06-a0e9-43d0-bc03-a697eb404cae None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:53:32.046108 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 506/1033] 10.222.0.17 () {54 vars in 927 bytes} [Fri Oct 14 12:53:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:53:32.058819 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42627079-e45d-4da1-85aa-1d3c03fc1c1a None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:53:32.059938 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42627079-e45d-4da1-85aa-1d3c03fc1c1a None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:53:32.060215 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42627079-e45d-4da1-85aa-1d3c03fc1c1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:53:32.160226 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:53:32.212368 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-42627079-e45d-4da1-85aa-1d3c03fc1c1a None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:53:32.213869 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-42627079-e45d-4da1-85aa-1d3c03fc1c1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:53:32.361115 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 528/1034] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Oct 14 12:53:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:53:32.922976 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb1cb36-7cfa-48f5-9a7a-da81b6810d61 None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:53:32.923557 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb1cb36-7cfa-48f5-9a7a-da81b6810d61 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:53:32.924052 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb1cb36-7cfa-48f5-9a7a-da81b6810d61 None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:53:32.927536 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 507/1035] 10.222.0.17 () {54 vars in 961 bytes} [Fri Oct 14 12:53:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:53:32.936838 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7066ae3-0450-407a-a892-7c3f3768afb4 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:53:32.937706 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7066ae3-0450-407a-a892-7c3f3768afb4 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:53:32.938186 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7066ae3-0450-407a-a892-7c3f3768afb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:53:33.053700 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-e7066ae3-0450-407a-a892-7c3f3768afb4 None None] MFA Rules not processed for user `931f4e32c8764514b5efed31b0785be7`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:53:33.056156 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-e7066ae3-0450-407a-a892-7c3f3768afb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:53:33.138492 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:53:33.222963 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 529/1036] 10.222.0.17 () {58 vars in 1058 bytes} [Fri Oct 14 12:53:32 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 12:53:33.231134 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb1cb36-7cfa-48f5-9a7a-da81b6810d61 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:53:33.232659 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-3eb1cb36-7cfa-48f5-9a7a-da81b6810d61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:53:33.412468 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb1cb36-7cfa-48f5-9a7a-da81b6810d61 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:53:33.515857 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:53:33.566399 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc8af89-1622-4a8c-bff7-d9ecee862612 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '931f4e32c8764514b5efed31b0785be7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:53:33.567971 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc8af89-1622-4a8c-bff7-d9ecee862612 service nova] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:53:33.568298 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc8af89-1622-4a8c-bff7-d9ecee862612 service nova] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:53:33.568578 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc8af89-1622-4a8c-bff7-d9ecee862612 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:53:33.570226 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-7fc8af89-1622-4a8c-bff7-d9ecee862612 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:53:33.681979 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc8af89-1622-4a8c-bff7-d9ecee862612 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:53:33.683696 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc8af89-1622-4a8c-bff7-d9ecee862612 service nova] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:53:33.708277 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 508/1037] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 12:53:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 12:53:36.420419 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc69c3e6-d4fa-4032-a4e5-e0ee24fc24e4 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:53:36.420894 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc69c3e6-d4fa-4032-a4e5-e0ee24fc24e4 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:53:36.421126 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc69c3e6-d4fa-4032-a4e5-e0ee24fc24e4 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:53:36.422703 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 530/1038] 10.222.0.17 () {54 vars in 927 bytes} [Fri Oct 14 12:53:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:53:36.427803 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164a8ed2-9bc1-4d1a-8cef-9526eed60b0d None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:53:36.428218 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164a8ed2-9bc1-4d1a-8cef-9526eed60b0d None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:53:36.428658 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164a8ed2-9bc1-4d1a-8cef-9526eed60b0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:53:36.498620 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-164a8ed2-9bc1-4d1a-8cef-9526eed60b0d None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:53:36.499863 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-164a8ed2-9bc1-4d1a-8cef-9526eed60b0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:53:36.541812 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:53:36.611522 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 509/1039] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Oct 14 12:53:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:53:36.962782 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc69c3e6-d4fa-4032-a4e5-e0ee24fc24e4 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:53:36.965205 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-cc69c3e6-d4fa-4032-a4e5-e0ee24fc24e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:53:37.200760 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc69c3e6-d4fa-4032-a4e5-e0ee24fc24e4 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:53:37.211069 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:53:37.351905 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268f8a95-3a64-46d1-ab29-1894146143c3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '931f4e32c8764514b5efed31b0785be7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:53:37.352798 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268f8a95-3a64-46d1-ab29-1894146143c3 service nova] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:53:37.353074 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268f8a95-3a64-46d1-ab29-1894146143c3 service nova] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:53:37.353342 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268f8a95-3a64-46d1-ab29-1894146143c3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:53:37.357918 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-268f8a95-3a64-46d1-ab29-1894146143c3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:53:37.470255 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268f8a95-3a64-46d1-ab29-1894146143c3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:53:37.472442 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268f8a95-3a64-46d1-ab29-1894146143c3 service nova] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:53:37.493883 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 531/1040] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 12:53:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 532 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 12:53:40.103753 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752ce830-0112-4519-8566-73cff6383714 None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:53:40.104275 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752ce830-0112-4519-8566-73cff6383714 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:53:40.104275 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752ce830-0112-4519-8566-73cff6383714 None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:53:40.106201 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 510/1041] 10.222.0.17 () {54 vars in 927 bytes} [Fri Oct 14 12:53:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:53:40.111690 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cd164d-19e8-4c88-a540-43472862b757 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:53:40.112229 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cd164d-19e8-4c88-a540-43472862b757 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:53:40.112361 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cd164d-19e8-4c88-a540-43472862b757 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:53:40.130093 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:53:40.192258 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-03cd164d-19e8-4c88-a540-43472862b757 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:53:40.193419 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-03cd164d-19e8-4c88-a540-43472862b757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:53:40.306167 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 532/1042] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Oct 14 12:53:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:53:40.602445 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6541cd1-dea6-443b-864e-0ec6f628023c None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:53:40.602771 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6541cd1-dea6-443b-864e-0ec6f628023c None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:53:40.603031 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6541cd1-dea6-443b-864e-0ec6f628023c None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:53:40.604549 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 511/1043] 10.222.0.17 () {54 vars in 961 bytes} [Fri Oct 14 12:53:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:53:40.610695 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb35afe-aa0d-41d1-9dc9-9c42c36743b6 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:53:40.611060 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb35afe-aa0d-41d1-9dc9-9c42c36743b6 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:53:40.611404 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb35afe-aa0d-41d1-9dc9-9c42c36743b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:53:40.699383 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-8fb35afe-aa0d-41d1-9dc9-9c42c36743b6 None None] MFA Rules not processed for user `931f4e32c8764514b5efed31b0785be7`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:53:40.700593 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-8fb35afe-aa0d-41d1-9dc9-9c42c36743b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:53:40.742322 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:53:40.838996 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 533/1044] 10.222.0.17 () {58 vars in 1058 bytes} [Fri Oct 14 12:53:40 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:53:40.848718 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6541cd1-dea6-443b-864e-0ec6f628023c None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:53:40.850364 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-b6541cd1-dea6-443b-864e-0ec6f628023c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:53:41.010902 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6541cd1-dea6-443b-864e-0ec6f628023c None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:53:41.035260 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:53:41.148301 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4602072f-c054-4844-9f91-ea9d647206ca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '931f4e32c8764514b5efed31b0785be7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:53:41.149726 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4602072f-c054-4844-9f91-ea9d647206ca service nova] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:53:41.150280 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4602072f-c054-4844-9f91-ea9d647206ca service nova] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:53:41.150850 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4602072f-c054-4844-9f91-ea9d647206ca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:53:41.152722 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-4602072f-c054-4844-9f91-ea9d647206ca service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:53:41.271550 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4602072f-c054-4844-9f91-ea9d647206ca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:53:41.273464 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4602072f-c054-4844-9f91-ea9d647206ca service nova] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:53:41.295136 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 512/1045] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 12:53:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 14 12:53:41.310249 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e295f6b-4bef-4d1f-8f47-0e4209dcb464 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:53:41.310719 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e295f6b-4bef-4d1f-8f47-0e4209dcb464 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:53:41.310799 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e295f6b-4bef-4d1f-8f47-0e4209dcb464 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:53:41.312359 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 534/1046] 10.222.0.17 () {54 vars in 927 bytes} [Fri Oct 14 12:53:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:53:41.317764 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6c3724-cc56-4667-9d97-57203692695d None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:53:41.318111 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6c3724-cc56-4667-9d97-57203692695d None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:53:41.318420 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6c3724-cc56-4667-9d97-57203692695d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:53:41.356470 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:53:41.398637 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-fc6c3724-cc56-4667-9d97-57203692695d None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:53:41.399838 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-fc6c3724-cc56-4667-9d97-57203692695d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:53:41.517107 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 513/1047] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Oct 14 12:53:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:53:41.827180 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a1ef2d-f4bf-4cf6-a2bc-5a2a42754b76 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:53:41.827466 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a1ef2d-f4bf-4cf6-a2bc-5a2a42754b76 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:53:41.827742 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a1ef2d-f4bf-4cf6-a2bc-5a2a42754b76 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:53:41.829321 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 535/1048] 10.222.0.17 () {54 vars in 963 bytes} [Fri Oct 14 12:53:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 14 12:53:41.835382 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76868095-b9e1-4f60-8c7f-35988fb239db None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:53:41.835786 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76868095-b9e1-4f60-8c7f-35988fb239db None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:53:41.836268 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76868095-b9e1-4f60-8c7f-35988fb239db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:53:41.925362 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-76868095-b9e1-4f60-8c7f-35988fb239db None None] MFA Rules not processed for user `76c3c564b8c548e4beef1cbfba2ad343`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:53:41.926607 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-76868095-b9e1-4f60-8c7f-35988fb239db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:53:41.977029 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:53:42.010668 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 514/1049] 10.222.0.17 () {58 vars in 1060 bytes} [Fri Oct 14 12:53:41 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:53:42.018728 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a1ef2d-f4bf-4cf6-a2bc-5a2a42754b76 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:53:42.020381 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-d7a1ef2d-f4bf-4cf6-a2bc-5a2a42754b76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:53:42.158351 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a1ef2d-f4bf-4cf6-a2bc-5a2a42754b76 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:53:42.224297 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:53:42.286548 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c49dbf-43e3-46eb-b87e-ca22614223b0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c3c564b8c548e4beef1cbfba2ad343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:53:42.287453 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c49dbf-43e3-46eb-b87e-ca22614223b0 service cinder] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:53:42.288663 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c49dbf-43e3-46eb-b87e-ca22614223b0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:53:42.289093 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c49dbf-43e3-46eb-b87e-ca22614223b0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:53:42.291707 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-a2c49dbf-43e3-46eb-b87e-ca22614223b0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:53:42.457842 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c49dbf-43e3-46eb-b87e-ca22614223b0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:53:42.459357 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c49dbf-43e3-46eb-b87e-ca22614223b0 service cinder] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:53:42.480599 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 536/1050] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 12:53:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 12:53:43.606505 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c97f40e-82ca-4558-a5cd-ca845ffa78c8 None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:53:43.607075 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c97f40e-82ca-4558-a5cd-ca845ffa78c8 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:53:43.607075 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c97f40e-82ca-4558-a5cd-ca845ffa78c8 None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:53:43.608376 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 515/1051] 10.222.0.17 () {54 vars in 927 bytes} [Fri Oct 14 12:53:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 14 12:53:43.614517 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cb157a-b124-4975-9aef-226cd0995c19 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:53:43.615225 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cb157a-b124-4975-9aef-226cd0995c19 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:53:43.615477 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cb157a-b124-4975-9aef-226cd0995c19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:53:43.688225 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-22cb157a-b124-4975-9aef-226cd0995c19 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:53:43.689761 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-22cb157a-b124-4975-9aef-226cd0995c19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:53:43.712381 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:53:43.815957 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 537/1052] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Oct 14 12:53:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:53:44.115039 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c97f40e-82ca-4558-a5cd-ca845ffa78c8 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:53:44.116945 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-9c97f40e-82ca-4558-a5cd-ca845ffa78c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:53:44.304021 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c97f40e-82ca-4558-a5cd-ca845ffa78c8 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:53:44.376019 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:53:44.450739 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfb5cc6-0bc6-4547-858a-0b11ced3622d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '931f4e32c8764514b5efed31b0785be7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:53:44.450997 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfb5cc6-0bc6-4547-858a-0b11ced3622d service nova] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:53:44.451672 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfb5cc6-0bc6-4547-858a-0b11ced3622d service nova] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:53:44.451672 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfb5cc6-0bc6-4547-858a-0b11ced3622d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:53:44.453074 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-4cfb5cc6-0bc6-4547-858a-0b11ced3622d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:53:44.558917 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfb5cc6-0bc6-4547-858a-0b11ced3622d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:53:44.561313 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfb5cc6-0bc6-4547-858a-0b11ced3622d service nova] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:53:44.584492 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 516/1053] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 12:53:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 12:53:46.889335 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe03f16-8834-42fd-99b0-c52a62d4b48f None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:53:46.889920 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe03f16-8834-42fd-99b0-c52a62d4b48f None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:53:46.890228 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe03f16-8834-42fd-99b0-c52a62d4b48f None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:53:46.892490 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 538/1054] 10.222.0.17 () {54 vars in 927 bytes} [Fri Oct 14 12:53:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:53:46.900219 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67519960-8747-4cd7-9613-b2b5578206af None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:53:46.900696 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67519960-8747-4cd7-9613-b2b5578206af None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:53:46.900934 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67519960-8747-4cd7-9613-b2b5578206af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:53:46.981382 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-67519960-8747-4cd7-9613-b2b5578206af None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:53:46.982603 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-67519960-8747-4cd7-9613-b2b5578206af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:53:46.993170 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:53:47.108117 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 517/1055] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Oct 14 12:53:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:53:47.420147 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe03f16-8834-42fd-99b0-c52a62d4b48f None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:53:47.421934 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-8fe03f16-8834-42fd-99b0-c52a62d4b48f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:53:47.602157 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe03f16-8834-42fd-99b0-c52a62d4b48f None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:53:47.606649 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:53:47.773714 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa3029f-5449-499a-953b-61cfd65c6465 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '931f4e32c8764514b5efed31b0785be7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:53:47.774575 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa3029f-5449-499a-953b-61cfd65c6465 service nova] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:53:47.775002 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa3029f-5449-499a-953b-61cfd65c6465 service nova] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:53:47.775428 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa3029f-5449-499a-953b-61cfd65c6465 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:53:47.778056 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-2aa3029f-5449-499a-953b-61cfd65c6465 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:53:47.930786 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa3029f-5449-499a-953b-61cfd65c6465 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:53:47.933437 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa3029f-5449-499a-953b-61cfd65c6465 service nova] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:53:47.963897 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 539/1056] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 12:53:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 544 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 12:53:50.226051 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4d1af3-92aa-420d-b9e9-f9208b87776a None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:53:50.226891 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4d1af3-92aa-420d-b9e9-f9208b87776a None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:53:50.226891 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4d1af3-92aa-420d-b9e9-f9208b87776a None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:53:50.232474 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 518/1057] 10.222.0.17 () {54 vars in 927 bytes} [Fri Oct 14 12:53:50 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:53:50.233816 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a43f064-51a3-49c0-abc7-8bdf1d9f5416 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:53:50.233816 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a43f064-51a3-49c0-abc7-8bdf1d9f5416 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:53:50.234737 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a43f064-51a3-49c0-abc7-8bdf1d9f5416 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:53:50.246485 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:53:50.324514 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-2a43f064-51a3-49c0-abc7-8bdf1d9f5416 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:53:50.326165 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-2a43f064-51a3-49c0-abc7-8bdf1d9f5416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:53:50.434031 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 540/1058] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Oct 14 12:53:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:53:50.837997 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4d1af3-92aa-420d-b9e9-f9208b87776a None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:53:50.839543 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-bd4d1af3-92aa-420d-b9e9-f9208b87776a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:53:51.004582 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:53:51.016789 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4d1af3-92aa-420d-b9e9-f9208b87776a None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:53:51.166137 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619b5aff-cb55-42b8-b80b-5a06f601e89f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '931f4e32c8764514b5efed31b0785be7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:53:51.166925 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619b5aff-cb55-42b8-b80b-5a06f601e89f service nova] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:53:51.167283 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619b5aff-cb55-42b8-b80b-5a06f601e89f service nova] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:53:51.167618 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619b5aff-cb55-42b8-b80b-5a06f601e89f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:53:51.169669 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-619b5aff-cb55-42b8-b80b-5a06f601e89f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:53:51.284413 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619b5aff-cb55-42b8-b80b-5a06f601e89f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:53:51.286798 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619b5aff-cb55-42b8-b80b-5a06f601e89f service nova] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:53:51.302057 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:53:51.315836 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 519/1059] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 12:53:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 12:53:53.676646 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c0032b-4124-46c4-b073-b58c0019c0d5 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:53:53.677540 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c0032b-4124-46c4-b073-b58c0019c0d5 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:53:53.677845 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c0032b-4124-46c4-b073-b58c0019c0d5 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:53:53.679457 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 541/1060] 10.222.0.17 () {54 vars in 927 bytes} [Fri Oct 14 12:53:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:53:53.685497 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db04c90-5453-45c2-8c31-06b128945b15 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:53:53.685984 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db04c90-5453-45c2-8c31-06b128945b15 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:53:53.686077 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db04c90-5453-45c2-8c31-06b128945b15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:53:53.758967 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-4db04c90-5453-45c2-8c31-06b128945b15 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:53:53.760209 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-4db04c90-5453-45c2-8c31-06b128945b15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:53:53.883276 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 520/1061] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Oct 14 12:53:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:53:54.270927 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c0032b-4124-46c4-b073-b58c0019c0d5 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:53:54.273328 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-c2c0032b-4124-46c4-b073-b58c0019c0d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:53:54.387770 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:53:54.455626 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c0032b-4124-46c4-b073-b58c0019c0d5 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:53:54.583056 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d88664-bab6-4bf5-9e84-ad74da6c3a56 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '931f4e32c8764514b5efed31b0785be7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:53:54.583716 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d88664-bab6-4bf5-9e84-ad74da6c3a56 service nova] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:53:54.584024 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d88664-bab6-4bf5-9e84-ad74da6c3a56 service nova] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:53:54.584332 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d88664-bab6-4bf5-9e84-ad74da6c3a56 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:53:54.586174 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-a7d88664-bab6-4bf5-9e84-ad74da6c3a56 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:53:54.652295 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:53:54.714045 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d88664-bab6-4bf5-9e84-ad74da6c3a56 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:53:54.716421 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d88664-bab6-4bf5-9e84-ad74da6c3a56 service nova] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:53:54.740937 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 542/1062] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 12:53:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 12:53:56.964250 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571112cd-5217-4d16-836a-bea814301b98 None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:53:56.964863 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571112cd-5217-4d16-836a-bea814301b98 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:53:56.964863 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571112cd-5217-4d16-836a-bea814301b98 None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:53:56.966297 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 521/1063] 10.222.0.17 () {54 vars in 927 bytes} [Fri Oct 14 12:53:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:53:56.972216 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b77a3c-5984-4506-b16b-f13338d4fc99 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:53:56.972694 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b77a3c-5984-4506-b16b-f13338d4fc99 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:53:56.972796 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b77a3c-5984-4506-b16b-f13338d4fc99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:53:57.057001 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-f9b77a3c-5984-4506-b16b-f13338d4fc99 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:53:57.058264 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-f9b77a3c-5984-4506-b16b-f13338d4fc99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:53:57.191445 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 543/1064] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Oct 14 12:53:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:53:57.493674 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571112cd-5217-4d16-836a-bea814301b98 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:53:57.495224 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-571112cd-5217-4d16-836a-bea814301b98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:53:57.573645 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:53:57.652232 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571112cd-5217-4d16-836a-bea814301b98 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:53:57.771851 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af75cd30-fc83-492e-9f2d-6f29cf6fa42f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '931f4e32c8764514b5efed31b0785be7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:53:57.772453 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af75cd30-fc83-492e-9f2d-6f29cf6fa42f service nova] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:53:57.772729 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af75cd30-fc83-492e-9f2d-6f29cf6fa42f service nova] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:53:57.772997 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af75cd30-fc83-492e-9f2d-6f29cf6fa42f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:53:57.774622 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-af75cd30-fc83-492e-9f2d-6f29cf6fa42f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:53:57.815259 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:53:57.868816 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af75cd30-fc83-492e-9f2d-6f29cf6fa42f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:53:57.870574 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af75cd30-fc83-492e-9f2d-6f29cf6fa42f service nova] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:53:57.889271 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 522/1065] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 12:53:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 12:53:58.481278 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f240064d-7d07-4174-8a9c-461d82dff396 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:53:58.481858 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f240064d-7d07-4174-8a9c-461d82dff396 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:53:58.481858 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f240064d-7d07-4174-8a9c-461d82dff396 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:53:58.483416 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 544/1066] 10.222.0.17 () {54 vars in 927 bytes} [Fri Oct 14 12:53:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 14 12:53:58.489477 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3e3e5f-86b9-4f84-bed5-4f26993918a9 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:53:58.489940 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3e3e5f-86b9-4f84-bed5-4f26993918a9 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:53:58.490053 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3e3e5f-86b9-4f84-bed5-4f26993918a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:53:58.557103 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-bf3e3e5f-86b9-4f84-bed5-4f26993918a9 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:53:58.558379 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-bf3e3e5f-86b9-4f84-bed5-4f26993918a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:53:58.658925 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 523/1067] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Oct 14 12:53:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 12:53:58.964989 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14356696-a832-46d8-b906-260ce8fb080a None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:53:58.965352 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14356696-a832-46d8-b906-260ce8fb080a None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:53:58.965698 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14356696-a832-46d8-b906-260ce8fb080a None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:53:58.967283 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 545/1068] 10.222.0.17 () {54 vars in 962 bytes} [Fri Oct 14 12:53:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:53:58.973179 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e963d3f-c9d5-4190-ace6-60572dc6032a None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:53:58.973488 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e963d3f-c9d5-4190-ace6-60572dc6032a None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:53:58.973987 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e963d3f-c9d5-4190-ace6-60572dc6032a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:53:58.994668 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:53:59.059358 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-7e963d3f-c9d5-4190-ace6-60572dc6032a None None] MFA Rules not processed for user `a0de24488ed54df29d8da344d76651d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:53:59.060558 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-7e963d3f-c9d5-4190-ace6-60572dc6032a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:53:59.140299 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 524/1069] 10.222.0.17 () {58 vars in 1059 bytes} [Fri Oct 14 12:53:58 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:53:59.149677 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14356696-a832-46d8-b906-260ce8fb080a None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:53:59.151371 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-14356696-a832-46d8-b906-260ce8fb080a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:53:59.184431 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:53:59.260654 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14356696-a832-46d8-b906-260ce8fb080a None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:53:59.338996 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c6eae4-3c7f-4254-8fe9-886841682ab3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0de24488ed54df29d8da344d76651d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:53:59.339596 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c6eae4-3c7f-4254-8fe9-886841682ab3 service glance] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:53:59.339867 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c6eae4-3c7f-4254-8fe9-886841682ab3 service glance] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:53:59.340129 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c6eae4-3c7f-4254-8fe9-886841682ab3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:53:59.341775 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-93c6eae4-3c7f-4254-8fe9-886841682ab3 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:53:59.426972 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:53:59.464834 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c6eae4-3c7f-4254-8fe9-886841682ab3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:53:59.466217 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c6eae4-3c7f-4254-8fe9-886841682ab3 service glance] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:53:59.490812 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 546/1070] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 12:53:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 12:54:00.140037 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238a6419-e948-4c5e-83a2-f5ededf2f836 None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:54:00.140625 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238a6419-e948-4c5e-83a2-f5ededf2f836 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:54:00.140625 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238a6419-e948-4c5e-83a2-f5ededf2f836 None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:54:00.141919 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 525/1071] 10.222.0.17 () {54 vars in 927 bytes} [Fri Oct 14 12:54:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:54:00.148407 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45af5da9-95ce-4acf-876c-38237fc4f7a7 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:54:00.148715 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45af5da9-95ce-4acf-876c-38237fc4f7a7 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:54:00.148984 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45af5da9-95ce-4acf-876c-38237fc4f7a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:54:00.217049 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-45af5da9-95ce-4acf-876c-38237fc4f7a7 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:54:00.218727 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-45af5da9-95ce-4acf-876c-38237fc4f7a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:54:00.259827 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445769d1-60e0-414f-8d60-4f885f26c8a7 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:54:00.260135 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445769d1-60e0-414f-8d60-4f885f26c8a7 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:54:00.260388 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445769d1-60e0-414f-8d60-4f885f26c8a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:54:00.320161 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 547/1072] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Oct 14 12:54:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:54:00.333545 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-445769d1-60e0-414f-8d60-4f885f26c8a7 None None] MFA Rules not processed for user `b83a5a78f3e7486293907cb3012c0ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:54:00.335151 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-445769d1-60e0-414f-8d60-4f885f26c8a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:54:00.392518 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:54:00.424841 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 526/1073] 10.222.0.17 () {58 vars in 1009 bytes} [Fri Oct 14 12:54:00 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:54:00.477985 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8395276-8a41-45d5-980d-5fca3a19b626 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:54:00.478370 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8395276-8a41-45d5-980d-5fca3a19b626 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:54:00.478524 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8395276-8a41-45d5-980d-5fca3a19b626 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:54:00.480412 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 548/1074] 10.222.0.17 () {54 vars in 943 bytes} [Fri Oct 14 12:54:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 14 12:54:00.488183 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd28bde-5631-448e-925a-734027c66f23 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:54:00.488468 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd28bde-5631-448e-925a-734027c66f23 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:54:00.488744 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd28bde-5631-448e-925a-734027c66f23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:54:00.576693 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-4cd28bde-5631-448e-925a-734027c66f23 None None] MFA Rules not processed for user `86c9fc57b1ec4d00b9f392877f277284`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:54:00.577915 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-4cd28bde-5631-448e-925a-734027c66f23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:54:00.616030 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8395276-8a41-45d5-980d-5fca3a19b626 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:54:00.617572 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-d8395276-8a41-45d5-980d-5fca3a19b626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:54:00.663364 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:54:00.702846 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 527/1075] 10.222.0.17 () {58 vars in 1040 bytes} [Fri Oct 14 12:54:00 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:54:00.712943 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd28bde-5631-448e-925a-734027c66f23 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:54:00.723141 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd28bde-5631-448e-925a-734027c66f23 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:54:00.750373 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:54:00.788166 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8395276-8a41-45d5-980d-5fca3a19b626 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:54:00.848970 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b06e9b-cfaa-4c8b-b02c-158dda9821e0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c9fc57b1ec4d00b9f392877f277284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:54:00.849576 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b06e9b-cfaa-4c8b-b02c-158dda9821e0 service swift] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:54:00.849852 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b06e9b-cfaa-4c8b-b02c-158dda9821e0 service swift] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:54:00.850138 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b06e9b-cfaa-4c8b-b02c-158dda9821e0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:54:00.851790 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-83b06e9b-cfaa-4c8b-b02c-158dda9821e0 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:54:00.905919 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:54:00.908762 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ad30b0-5cf2-4af5-95b3-73f2c7776a4b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '931f4e32c8764514b5efed31b0785be7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:54:00.909652 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ad30b0-5cf2-4af5-95b3-73f2c7776a4b service nova] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:54:00.910140 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ad30b0-5cf2-4af5-95b3-73f2c7776a4b service nova] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:54:00.910597 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ad30b0-5cf2-4af5-95b3-73f2c7776a4b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:54:00.912405 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-05ad30b0-5cf2-4af5-95b3-73f2c7776a4b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:54:00.941058 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b06e9b-cfaa-4c8b-b02c-158dda9821e0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:54:00.942777 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b06e9b-cfaa-4c8b-b02c-158dda9821e0 service swift] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:54:00.951232 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 528/1076] 10.222.0.17 () {60 vars in 1384 bytes} [Fri Oct 14 12:54:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 14 12:54:01.012118 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ad30b0-5cf2-4af5-95b3-73f2c7776a4b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:54:01.013758 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ad30b0-5cf2-4af5-95b3-73f2c7776a4b service nova] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:54:01.034274 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 549/1077] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 12:54:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 14 12:54:03.373008 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a055a88f-e391-47be-8dac-08ce3347d8c7 None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:54:03.373575 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a055a88f-e391-47be-8dac-08ce3347d8c7 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:54:03.373575 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a055a88f-e391-47be-8dac-08ce3347d8c7 None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:54:03.375312 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 529/1078] 10.222.0.17 () {54 vars in 927 bytes} [Fri Oct 14 12:54:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:54:03.380688 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b075ead3-9d4d-45c9-b076-04e06a38b40c None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:54:03.381091 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b075ead3-9d4d-45c9-b076-04e06a38b40c None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:54:03.381275 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b075ead3-9d4d-45c9-b076-04e06a38b40c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:54:03.459808 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-b075ead3-9d4d-45c9-b076-04e06a38b40c None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:54:03.461037 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-b075ead3-9d4d-45c9-b076-04e06a38b40c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:54:03.544367 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:54:03.582169 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 550/1079] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Oct 14 12:54:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:54:03.890857 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a055a88f-e391-47be-8dac-08ce3347d8c7 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:54:03.893367 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-a055a88f-e391-47be-8dac-08ce3347d8c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:54:03.981948 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:54:04.093598 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a055a88f-e391-47be-8dac-08ce3347d8c7 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:54:04.237247 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57ff2b0-4b66-4ced-b947-1ddfa672f91f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '931f4e32c8764514b5efed31b0785be7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:54:04.237771 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57ff2b0-4b66-4ced-b947-1ddfa672f91f service nova] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:54:04.238613 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57ff2b0-4b66-4ced-b947-1ddfa672f91f service nova] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:54:04.238613 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57ff2b0-4b66-4ced-b947-1ddfa672f91f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:54:04.240318 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-a57ff2b0-4b66-4ced-b947-1ddfa672f91f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:54:04.265196 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:54:04.361464 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57ff2b0-4b66-4ced-b947-1ddfa672f91f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:54:04.363409 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57ff2b0-4b66-4ced-b947-1ddfa672f91f service nova] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:54:04.383450 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 530/1080] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 12:54:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 494 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 12:54:06.657148 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e633ef92-d053-4565-ac22-61c26e1a3495 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:54:06.658379 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e633ef92-d053-4565-ac22-61c26e1a3495 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:54:06.658379 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e633ef92-d053-4565-ac22-61c26e1a3495 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:54:06.659777 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 551/1081] 10.222.0.17 () {54 vars in 927 bytes} [Fri Oct 14 12:54:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 14 12:54:06.665737 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fd48e6-7aad-486d-8dba-3fd8c6b033f1 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:54:06.665737 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fd48e6-7aad-486d-8dba-3fd8c6b033f1 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:54:06.666347 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fd48e6-7aad-486d-8dba-3fd8c6b033f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:54:06.739154 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-93fd48e6-7aad-486d-8dba-3fd8c6b033f1 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:54:06.740480 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-93fd48e6-7aad-486d-8dba-3fd8c6b033f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:54:06.841659 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:54:06.849871 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 531/1082] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Oct 14 12:54:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:54:07.150282 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e633ef92-d053-4565-ac22-61c26e1a3495 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:54:07.151827 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-e633ef92-d053-4565-ac22-61c26e1a3495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:54:07.344463 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e633ef92-d053-4565-ac22-61c26e1a3495 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:54:07.417585 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:54:07.498318 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b530f82-249e-4a92-970d-c176a437af30 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '931f4e32c8764514b5efed31b0785be7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:54:07.498934 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b530f82-249e-4a92-970d-c176a437af30 service nova] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:54:07.499215 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b530f82-249e-4a92-970d-c176a437af30 service nova] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:54:07.499492 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b530f82-249e-4a92-970d-c176a437af30 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:54:07.501155 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-0b530f82-249e-4a92-970d-c176a437af30 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:54:07.601018 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b530f82-249e-4a92-970d-c176a437af30 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:54:07.602793 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b530f82-249e-4a92-970d-c176a437af30 service nova] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:54:07.629092 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 552/1083] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 12:54:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 12:54:09.881971 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385efd00-5a94-44c8-b656-032ba764b353 None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:54:09.882633 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385efd00-5a94-44c8-b656-032ba764b353 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:54:09.882633 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385efd00-5a94-44c8-b656-032ba764b353 None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:54:09.887150 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 532/1084] 10.222.0.17 () {54 vars in 927 bytes} [Fri Oct 14 12:54:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:54:09.889411 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b672e252-7c5a-454c-b67f-b5575d5f8207 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:54:09.889849 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b672e252-7c5a-454c-b67f-b5575d5f8207 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:54:09.889953 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b672e252-7c5a-454c-b67f-b5575d5f8207 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:54:09.968235 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-b672e252-7c5a-454c-b67f-b5575d5f8207 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:54:09.969620 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-b672e252-7c5a-454c-b67f-b5575d5f8207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:54:09.984240 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:54:10.090285 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 553/1085] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Oct 14 12:54:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:54:10.386707 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385efd00-5a94-44c8-b656-032ba764b353 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:54:10.388617 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-385efd00-5a94-44c8-b656-032ba764b353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:54:10.577130 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385efd00-5a94-44c8-b656-032ba764b353 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:54:10.668805 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:54:10.728825 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00f80b5-4761-4502-89f4-c8fcaf95bba5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '931f4e32c8764514b5efed31b0785be7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:54:10.729734 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00f80b5-4761-4502-89f4-c8fcaf95bba5 service nova] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:54:10.730020 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00f80b5-4761-4502-89f4-c8fcaf95bba5 service nova] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:54:10.730314 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00f80b5-4761-4502-89f4-c8fcaf95bba5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:54:10.732009 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-b00f80b5-4761-4502-89f4-c8fcaf95bba5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:54:10.847735 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00f80b5-4761-4502-89f4-c8fcaf95bba5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:54:10.849508 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00f80b5-4761-4502-89f4-c8fcaf95bba5 service nova] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:54:10.879089 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 533/1086] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 12:54:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 493 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 12:54:20.084616 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=38 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:54:20.875604 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=64 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:54:23.408718 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f8b7bc-02b2-429e-9a54-e2425b0f7588 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:54:23.409253 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f8b7bc-02b2-429e-9a54-e2425b0f7588 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:54:23.409253 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f8b7bc-02b2-429e-9a54-e2425b0f7588 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:54:23.410558 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 554/1087] 10.222.0.17 () {54 vars in 918 bytes} [Fri Oct 14 12:54:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:54:23.415609 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d8dd31-2aa2-4580-834a-94beade9e64c None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:54:23.416055 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d8dd31-2aa2-4580-834a-94beade9e64c None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:54:23.416152 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d8dd31-2aa2-4580-834a-94beade9e64c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:54:23.498742 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-e6d8dd31-2aa2-4580-834a-94beade9e64c None None] MFA Rules not processed for user `0a5e5c35ed8b4abc877ba8d8c490dacd`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:54:23.499947 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-e6d8dd31-2aa2-4580-834a-94beade9e64c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:54:23.604645 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 534/1088] 10.222.0.17 () {58 vars in 1015 bytes} [Fri Oct 14 12:54:23 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:54:23.619695 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47116a98-9c5f-4e0d-9a23-a8ce1a7b937b None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:54:23.619979 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47116a98-9c5f-4e0d-9a23-a8ce1a7b937b None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:54:23.620248 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47116a98-9c5f-4e0d-9a23-a8ce1a7b937b None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:54:23.621564 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 555/1089] 10.222.0.17 () {54 vars in 918 bytes} [Fri Oct 14 12:54:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:54:23.626197 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba78a0f-250f-4f96-be43-7824a1eca2f0 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:54:23.626489 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba78a0f-250f-4f96-be43-7824a1eca2f0 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:54:23.626768 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba78a0f-250f-4f96-be43-7824a1eca2f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:54:23.702985 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:54:23.705789 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-1ba78a0f-250f-4f96-be43-7824a1eca2f0 None None] MFA Rules not processed for user `931f4e32c8764514b5efed31b0785be7`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:54:23.707684 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-1ba78a0f-250f-4f96-be43-7824a1eca2f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:54:23.821747 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 535/1090] 10.222.0.17 () {58 vars in 1015 bytes} [Fri Oct 14 12:54:23 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:54:26.491110 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24643591-b1b4-43b0-88b7-0560fd803bab None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:54:26.491681 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24643591-b1b4-43b0-88b7-0560fd803bab None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:54:26.491681 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24643591-b1b4-43b0-88b7-0560fd803bab None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:54:26.492959 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 556/1091] 127.0.0.1 () {54 vars in 917 bytes} [Fri Oct 14 12:54:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:54:26.498548 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a72c51d-02ca-4276-b493-4f3e96d198b0 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:54:26.499005 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a72c51d-02ca-4276-b493-4f3e96d198b0 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:54:26.499141 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a72c51d-02ca-4276-b493-4f3e96d198b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:54:26.566063 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-5a72c51d-02ca-4276-b493-4f3e96d198b0 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:54:26.567288 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-5a72c51d-02ca-4276-b493-4f3e96d198b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:54:26.623520 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:54:26.667553 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 536/1092] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Oct 14 12:54:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:54:26.966021 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24643591-b1b4-43b0-88b7-0560fd803bab None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:54:26.967655 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-24643591-b1b4-43b0-88b7-0560fd803bab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:54:27.115154 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24643591-b1b4-43b0-88b7-0560fd803bab None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:54:27.187200 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:54:27.228417 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b5372a-6e96-4ac2-895f-d44e806fafe5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '931f4e32c8764514b5efed31b0785be7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:54:27.228931 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b5372a-6e96-4ac2-895f-d44e806fafe5 service nova] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:54:27.229468 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b5372a-6e96-4ac2-895f-d44e806fafe5 service nova] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:54:27.229742 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b5372a-6e96-4ac2-895f-d44e806fafe5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:54:27.231362 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-47b5372a-6e96-4ac2-895f-d44e806fafe5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:54:27.330181 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b5372a-6e96-4ac2-895f-d44e806fafe5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:54:27.331802 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b5372a-6e96-4ac2-895f-d44e806fafe5 service nova] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:54:27.349389 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 557/1093] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 12:54:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 12:54:28.507625 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c586a27-26e5-4ebe-88ee-317b6b41f72f None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:54:28.508211 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c586a27-26e5-4ebe-88ee-317b6b41f72f None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:54:28.508211 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c586a27-26e5-4ebe-88ee-317b6b41f72f None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:54:28.509586 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 537/1094] 127.0.0.1 () {54 vars in 901 bytes} [Fri Oct 14 12:54:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:54:28.516349 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbfaa32-45e7-4951-a783-f0e5b4b68c41 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:54:28.517165 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbfaa32-45e7-4951-a783-f0e5b4b68c41 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:54:28.517165 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbfaa32-45e7-4951-a783-f0e5b4b68c41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:54:28.594756 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-0bbfaa32-45e7-4951-a783-f0e5b4b68c41 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:54:28.595963 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-0bbfaa32-45e7-4951-a783-f0e5b4b68c41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:54:28.622841 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:54:28.695596 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 558/1095] 127.0.0.1 () {58 vars in 998 bytes} [Fri Oct 14 12:54:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:54:28.854987 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c586a27-26e5-4ebe-88ee-317b6b41f72f None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:54:28.856541 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-6c586a27-26e5-4ebe-88ee-317b6b41f72f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:54:29.008283 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c586a27-26e5-4ebe-88ee-317b6b41f72f None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:54:29.052576 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:54:29.136859 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a89d160-14f8-4455-8419-3301a34b9d79 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '931f4e32c8764514b5efed31b0785be7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:54:29.137470 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a89d160-14f8-4455-8419-3301a34b9d79 service nova] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:54:29.137750 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a89d160-14f8-4455-8419-3301a34b9d79 service nova] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:54:29.138020 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a89d160-14f8-4455-8419-3301a34b9d79 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:54:29.139648 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-6a89d160-14f8-4455-8419-3301a34b9d79 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:54:29.227560 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a89d160-14f8-4455-8419-3301a34b9d79 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:54:29.229429 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a89d160-14f8-4455-8419-3301a34b9d79 service nova] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:54:29.248078 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 538/1096] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 12:54:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 12:54:30.389901 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6bf1eb-a586-4443-9e32-7b1e8258447b None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:54:30.390521 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6bf1eb-a586-4443-9e32-7b1e8258447b None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:54:30.390521 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6bf1eb-a586-4443-9e32-7b1e8258447b None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:54:30.392371 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 559/1097] 127.0.0.1 () {54 vars in 901 bytes} [Fri Oct 14 12:54:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:54:30.398878 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997de876-d0d5-4d0c-b90f-defd3810ca9e None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:54:30.399329 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997de876-d0d5-4d0c-b90f-defd3810ca9e None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:54:30.399456 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997de876-d0d5-4d0c-b90f-defd3810ca9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:54:30.454060 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:54:30.476681 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-997de876-d0d5-4d0c-b90f-defd3810ca9e None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:54:30.477908 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-997de876-d0d5-4d0c-b90f-defd3810ca9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:54:30.579157 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 539/1098] 127.0.0.1 () {58 vars in 998 bytes} [Fri Oct 14 12:54:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:54:30.732305 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6bf1eb-a586-4443-9e32-7b1e8258447b None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:54:30.733724 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-6a6bf1eb-a586-4443-9e32-7b1e8258447b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:54:30.883067 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6bf1eb-a586-4443-9e32-7b1e8258447b None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:54:30.895978 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:54:31.005375 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558a61fc-18bc-4bb7-bb8d-9734996eeff8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '931f4e32c8764514b5efed31b0785be7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:54:31.005859 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558a61fc-18bc-4bb7-bb8d-9734996eeff8 service nova] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:54:31.006164 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558a61fc-18bc-4bb7-bb8d-9734996eeff8 service nova] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:54:31.006440 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558a61fc-18bc-4bb7-bb8d-9734996eeff8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:54:31.008033 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-558a61fc-18bc-4bb7-bb8d-9734996eeff8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:54:31.099232 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558a61fc-18bc-4bb7-bb8d-9734996eeff8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:54:31.100539 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558a61fc-18bc-4bb7-bb8d-9734996eeff8 service nova] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:54:31.119349 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 560/1099] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 12:54:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 12:54:32.243836 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1529733-3a4a-4f4c-9a6f-25685ccc17db None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:54:32.244453 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1529733-3a4a-4f4c-9a6f-25685ccc17db None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:54:32.244695 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1529733-3a4a-4f4c-9a6f-25685ccc17db None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:54:32.246065 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 540/1100] 127.0.0.1 () {54 vars in 901 bytes} [Fri Oct 14 12:54:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:54:32.253751 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9d06f0-8a0b-4aa4-99f4-8b9c450318f2 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:54:32.254289 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9d06f0-8a0b-4aa4-99f4-8b9c450318f2 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:54:32.254400 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9d06f0-8a0b-4aa4-99f4-8b9c450318f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:54:32.276182 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:54:32.335336 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-cf9d06f0-8a0b-4aa4-99f4-8b9c450318f2 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:54:32.336545 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-cf9d06f0-8a0b-4aa4-99f4-8b9c450318f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:54:32.431821 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 561/1101] 127.0.0.1 () {58 vars in 998 bytes} [Fri Oct 14 12:54:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:54:32.584252 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1529733-3a4a-4f4c-9a6f-25685ccc17db None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:54:32.585929 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-e1529733-3a4a-4f4c-9a6f-25685ccc17db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:54:32.698459 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:54:32.735190 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1529733-3a4a-4f4c-9a6f-25685ccc17db None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:54:32.847925 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd334e84-2ce9-40f4-80b8-1c59627f98fc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '931f4e32c8764514b5efed31b0785be7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:54:32.848432 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd334e84-2ce9-40f4-80b8-1c59627f98fc service nova] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:54:32.848706 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd334e84-2ce9-40f4-80b8-1c59627f98fc service nova] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:54:32.848973 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd334e84-2ce9-40f4-80b8-1c59627f98fc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:54:32.850648 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-dd334e84-2ce9-40f4-80b8-1c59627f98fc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:54:32.926407 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:54:32.941100 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd334e84-2ce9-40f4-80b8-1c59627f98fc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:54:32.942738 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd334e84-2ce9-40f4-80b8-1c59627f98fc service nova] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:54:32.960803 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 541/1102] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 12:54:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 12:54:34.141693 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724f842d-812b-4733-87c7-88e08aac4feb None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:54:34.142242 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724f842d-812b-4733-87c7-88e08aac4feb None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:54:34.142242 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724f842d-812b-4733-87c7-88e08aac4feb None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:54:34.143626 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 562/1103] 127.0.0.1 () {54 vars in 901 bytes} [Fri Oct 14 12:54:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:54:34.150682 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7868eb10-10b9-45f5-9241-509666aef0bb None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:54:34.151169 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7868eb10-10b9-45f5-9241-509666aef0bb None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:54:34.151271 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7868eb10-10b9-45f5-9241-509666aef0bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:54:34.226894 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-7868eb10-10b9-45f5-9241-509666aef0bb None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:54:34.228022 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-7868eb10-10b9-45f5-9241-509666aef0bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:54:34.328905 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 542/1104] 127.0.0.1 () {58 vars in 998 bytes} [Fri Oct 14 12:54:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:54:34.482459 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724f842d-812b-4733-87c7-88e08aac4feb None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:54:34.483880 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-724f842d-812b-4733-87c7-88e08aac4feb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:54:34.569134 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:54:34.637474 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724f842d-812b-4733-87c7-88e08aac4feb None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:54:34.756378 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262f2640-bd02-46d5-a850-874ab92d9b7c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '931f4e32c8764514b5efed31b0785be7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:54:34.756953 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262f2640-bd02-46d5-a850-874ab92d9b7c service nova] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:54:34.757177 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262f2640-bd02-46d5-a850-874ab92d9b7c service nova] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:54:34.757566 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262f2640-bd02-46d5-a850-874ab92d9b7c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:54:34.759210 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-262f2640-bd02-46d5-a850-874ab92d9b7c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:54:34.811986 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:54:34.856164 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262f2640-bd02-46d5-a850-874ab92d9b7c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:54:34.857784 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262f2640-bd02-46d5-a850-874ab92d9b7c service nova] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:54:34.876288 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 563/1105] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 12:54:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 12:54:35.955332 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a86920-3cff-4de0-a8e4-a0e0c042918e None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:54:35.955833 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a86920-3cff-4de0-a8e4-a0e0c042918e None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:54:35.955939 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a86920-3cff-4de0-a8e4-a0e0c042918e None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:54:35.957195 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 543/1106] 127.0.0.1 () {54 vars in 901 bytes} [Fri Oct 14 12:54:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:54:35.963638 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d71d1e5-1015-45ca-84dd-6b578dff1431 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:54:35.964075 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d71d1e5-1015-45ca-84dd-6b578dff1431 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:54:35.964277 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d71d1e5-1015-45ca-84dd-6b578dff1431 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:54:36.043559 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-3d71d1e5-1015-45ca-84dd-6b578dff1431 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:54:36.044761 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-3d71d1e5-1015-45ca-84dd-6b578dff1431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:54:36.140946 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 564/1107] 127.0.0.1 () {58 vars in 998 bytes} [Fri Oct 14 12:54:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:54:36.292130 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a86920-3cff-4de0-a8e4-a0e0c042918e None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:54:36.293547 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-45a86920-3cff-4de0-a8e4-a0e0c042918e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:54:36.341853 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:54:36.439560 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a86920-3cff-4de0-a8e4-a0e0c042918e None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:54:36.552436 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21880d6-630a-4876-9bfb-1deaf1e6e2da service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '931f4e32c8764514b5efed31b0785be7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:54:36.552960 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21880d6-630a-4876-9bfb-1deaf1e6e2da service nova] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:54:36.553238 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21880d6-630a-4876-9bfb-1deaf1e6e2da service nova] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:54:36.553515 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21880d6-630a-4876-9bfb-1deaf1e6e2da service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:54:36.555139 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-e21880d6-630a-4876-9bfb-1deaf1e6e2da service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:54:36.562000 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:54:36.647235 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21880d6-630a-4876-9bfb-1deaf1e6e2da service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:54:36.648837 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21880d6-630a-4876-9bfb-1deaf1e6e2da service nova] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:54:36.666602 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 544/1108] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 12:54:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 12:54:37.735618 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8831de-f3cd-47fe-8198-694a42ed7529 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:54:37.736157 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8831de-f3cd-47fe-8198-694a42ed7529 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:54:37.736251 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8831de-f3cd-47fe-8198-694a42ed7529 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:54:37.737528 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 565/1109] 127.0.0.1 () {54 vars in 901 bytes} [Fri Oct 14 12:54:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:54:37.743761 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5435d9a-939c-4d7e-b7a8-91081ef5b2ec None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:54:37.744251 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5435d9a-939c-4d7e-b7a8-91081ef5b2ec None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:54:37.744354 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5435d9a-939c-4d7e-b7a8-91081ef5b2ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:54:37.822695 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-b5435d9a-939c-4d7e-b7a8-91081ef5b2ec None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:54:37.823923 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-b5435d9a-939c-4d7e-b7a8-91081ef5b2ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:54:37.893160 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:54:37.921574 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 545/1110] 127.0.0.1 () {58 vars in 998 bytes} [Fri Oct 14 12:54:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:54:38.081494 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8831de-f3cd-47fe-8198-694a42ed7529 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:54:38.083054 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-5d8831de-f3cd-47fe-8198-694a42ed7529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:54:38.103227 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:54:38.232661 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8831de-f3cd-47fe-8198-694a42ed7529 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:54:38.323062 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:54:38.349337 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc44f8ca-2af5-48a3-a62f-c7cf43b3cd49 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '931f4e32c8764514b5efed31b0785be7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:54:38.349938 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc44f8ca-2af5-48a3-a62f-c7cf43b3cd49 service nova] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:54:38.350269 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc44f8ca-2af5-48a3-a62f-c7cf43b3cd49 service nova] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:54:38.350542 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc44f8ca-2af5-48a3-a62f-c7cf43b3cd49 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:54:38.352228 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-bc44f8ca-2af5-48a3-a62f-c7cf43b3cd49 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:54:38.445827 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc44f8ca-2af5-48a3-a62f-c7cf43b3cd49 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:54:38.447499 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc44f8ca-2af5-48a3-a62f-c7cf43b3cd49 service nova] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:54:38.465262 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 566/1111] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 12:54:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 12:54:39.528592 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbfe389-9524-4ba7-bc17-f2d834fdcf13 None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:54:39.529110 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbfe389-9524-4ba7-bc17-f2d834fdcf13 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:54:39.529110 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbfe389-9524-4ba7-bc17-f2d834fdcf13 None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:54:39.530401 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 546/1112] 127.0.0.1 () {54 vars in 901 bytes} [Fri Oct 14 12:54:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:54:39.536717 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafc0aaf-4fcc-4eb1-9e79-fb8af9fdc935 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:54:39.537167 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafc0aaf-4fcc-4eb1-9e79-fb8af9fdc935 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:54:39.537282 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafc0aaf-4fcc-4eb1-9e79-fb8af9fdc935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:54:39.615296 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-aafc0aaf-4fcc-4eb1-9e79-fb8af9fdc935 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:54:39.616522 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-aafc0aaf-4fcc-4eb1-9e79-fb8af9fdc935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:54:39.658766 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:54:39.715510 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 567/1113] 127.0.0.1 () {58 vars in 998 bytes} [Fri Oct 14 12:54:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:54:39.870111 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbfe389-9524-4ba7-bc17-f2d834fdcf13 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:54:39.872126 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-4fbfe389-9524-4ba7-bc17-f2d834fdcf13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:54:40.019133 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbfe389-9524-4ba7-bc17-f2d834fdcf13 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:54:40.074441 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:54:40.133300 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f54383-e32e-42ea-9a7a-803d88b07a68 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '931f4e32c8764514b5efed31b0785be7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:54:40.133840 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f54383-e32e-42ea-9a7a-803d88b07a68 service nova] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:54:40.134138 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f54383-e32e-42ea-9a7a-803d88b07a68 service nova] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:54:40.134421 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f54383-e32e-42ea-9a7a-803d88b07a68 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:54:40.136015 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-76f54383-e32e-42ea-9a7a-803d88b07a68 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:54:40.225781 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f54383-e32e-42ea-9a7a-803d88b07a68 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:54:40.227558 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f54383-e32e-42ea-9a7a-803d88b07a68 service nova] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:54:40.245974 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 547/1114] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 12:54:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 12:54:41.304288 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a956576-556b-457a-b522-406049569100 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:54:41.304825 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a956576-556b-457a-b522-406049569100 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:54:41.304919 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a956576-556b-457a-b522-406049569100 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:54:41.306247 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 568/1115] 127.0.0.1 () {54 vars in 901 bytes} [Fri Oct 14 12:54:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:54:41.313378 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b3f675-1ff2-4eeb-8832-41488211c195 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:54:41.313898 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b3f675-1ff2-4eeb-8832-41488211c195 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:54:41.314022 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b3f675-1ff2-4eeb-8832-41488211c195 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:54:41.390487 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-e6b3f675-1ff2-4eeb-8832-41488211c195 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:54:41.391641 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-e6b3f675-1ff2-4eeb-8832-41488211c195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:54:41.393654 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:54:41.491487 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 548/1116] 127.0.0.1 () {58 vars in 998 bytes} [Fri Oct 14 12:54:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:54:41.646996 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a956576-556b-457a-b522-406049569100 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:54:41.648478 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-2a956576-556b-457a-b522-406049569100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:54:41.807909 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a956576-556b-457a-b522-406049569100 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:54:41.835004 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:54:41.922764 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9197c42e-8ff5-40e5-b94e-806b77c46a19 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '931f4e32c8764514b5efed31b0785be7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:54:41.923283 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9197c42e-8ff5-40e5-b94e-806b77c46a19 service nova] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:54:41.923583 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9197c42e-8ff5-40e5-b94e-806b77c46a19 service nova] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:54:41.923840 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9197c42e-8ff5-40e5-b94e-806b77c46a19 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:54:41.925432 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-9197c42e-8ff5-40e5-b94e-806b77c46a19 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:54:42.019292 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9197c42e-8ff5-40e5-b94e-806b77c46a19 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:54:42.020913 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9197c42e-8ff5-40e5-b94e-806b77c46a19 service nova] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:54:42.038934 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 569/1117] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 12:54:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 12:54:44.110764 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9615d8-c83e-409e-8e34-812d8fae0f0d None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:54:44.111284 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9615d8-c83e-409e-8e34-812d8fae0f0d None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:54:44.111396 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9615d8-c83e-409e-8e34-812d8fae0f0d None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:54:44.112655 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 549/1118] 127.0.0.1 () {54 vars in 917 bytes} [Fri Oct 14 12:54:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 14 12:54:44.117962 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5d1e8c-6587-4841-8130-716aa18f2c57 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:54:44.118396 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5d1e8c-6587-4841-8130-716aa18f2c57 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:54:44.118538 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5d1e8c-6587-4841-8130-716aa18f2c57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:54:44.161047 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:54:44.188712 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-1f5d1e8c-6587-4841-8130-716aa18f2c57 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:54:44.189940 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-1f5d1e8c-6587-4841-8130-716aa18f2c57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:54:44.300601 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 570/1119] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Oct 14 12:54:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:54:44.587413 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9615d8-c83e-409e-8e34-812d8fae0f0d None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:54:44.588989 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-4c9615d8-c83e-409e-8e34-812d8fae0f0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:54:44.694060 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9615d8-c83e-409e-8e34-812d8fae0f0d None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:54:44.726854 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:54:44.769040 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a9ae20-dae7-43ec-a3f6-24eeed218dbb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d483292f3a4794848fcacfba5b107e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:54:44.769639 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a9ae20-dae7-43ec-a3f6-24eeed218dbb service neutron] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:54:44.769912 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a9ae20-dae7-43ec-a3f6-24eeed218dbb service neutron] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:54:44.770215 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a9ae20-dae7-43ec-a3f6-24eeed218dbb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:54:44.771797 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-d8a9ae20-dae7-43ec-a3f6-24eeed218dbb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:54:44.881056 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a9ae20-dae7-43ec-a3f6-24eeed218dbb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:54:44.882437 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a9ae20-dae7-43ec-a3f6-24eeed218dbb service neutron] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:54:44.903703 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 550/1120] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 12:54:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 14 12:54:47.241674 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df11a9f6-1442-48e7-91cb-7790f30c2380 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:54:47.242295 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df11a9f6-1442-48e7-91cb-7790f30c2380 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:54:47.242295 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df11a9f6-1442-48e7-91cb-7790f30c2380 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:54:47.243611 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 571/1121] 127.0.0.1 () {54 vars in 917 bytes} [Fri Oct 14 12:54:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:54:47.249233 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35467bbf-2d0e-4901-89e9-a7763527b5bd None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:54:47.249759 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35467bbf-2d0e-4901-89e9-a7763527b5bd None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:54:47.249872 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35467bbf-2d0e-4901-89e9-a7763527b5bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:54:47.315680 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-35467bbf-2d0e-4901-89e9-a7763527b5bd None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:54:47.316904 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-35467bbf-2d0e-4901-89e9-a7763527b5bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:54:47.330208 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:54:47.415751 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 551/1122] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Oct 14 12:54:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:54:47.705342 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df11a9f6-1442-48e7-91cb-7790f30c2380 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:54:47.707078 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-df11a9f6-1442-48e7-91cb-7790f30c2380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:54:47.821438 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df11a9f6-1442-48e7-91cb-7790f30c2380 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:54:47.833681 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:54:47.896704 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759da620-d74a-40f7-90a1-d42ad2b66aad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d483292f3a4794848fcacfba5b107e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:54:47.897305 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759da620-d74a-40f7-90a1-d42ad2b66aad service neutron] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:54:47.897583 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759da620-d74a-40f7-90a1-d42ad2b66aad service neutron] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:54:47.897853 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759da620-d74a-40f7-90a1-d42ad2b66aad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:54:47.899477 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-759da620-d74a-40f7-90a1-d42ad2b66aad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:54:48.010036 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759da620-d74a-40f7-90a1-d42ad2b66aad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:54:48.011410 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759da620-d74a-40f7-90a1-d42ad2b66aad service neutron] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:54:48.029157 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 572/1123] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 12:54:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 12:54:50.636124 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dc089e-2e8e-4a1e-9fe3-c8cb51c89697 None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:54:50.636707 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dc089e-2e8e-4a1e-9fe3-c8cb51c89697 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:54:50.636707 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dc089e-2e8e-4a1e-9fe3-c8cb51c89697 None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:54:50.638042 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 552/1124] 127.0.0.1 () {54 vars in 917 bytes} [Fri Oct 14 12:54:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:54:50.644393 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c39b11-7eed-4328-9039-f379dccbe86e None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:54:50.644852 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c39b11-7eed-4328-9039-f379dccbe86e None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:54:50.645015 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c39b11-7eed-4328-9039-f379dccbe86e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:54:50.695861 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:54:50.715236 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-56c39b11-7eed-4328-9039-f379dccbe86e None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:54:50.716451 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-56c39b11-7eed-4328-9039-f379dccbe86e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:54:50.817367 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 573/1125] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Oct 14 12:54:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:54:51.105284 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dc089e-2e8e-4a1e-9fe3-c8cb51c89697 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:54:51.106863 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-20dc089e-2e8e-4a1e-9fe3-c8cb51c89697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:54:51.210589 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dc089e-2e8e-4a1e-9fe3-c8cb51c89697 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:54:51.251584 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:54:51.286279 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b4ff78-0a2c-4774-8557-62ab50d9b2b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d483292f3a4794848fcacfba5b107e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:54:51.286885 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b4ff78-0a2c-4774-8557-62ab50d9b2b3 service neutron] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:54:51.287163 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b4ff78-0a2c-4774-8557-62ab50d9b2b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:54:51.287433 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b4ff78-0a2c-4774-8557-62ab50d9b2b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:54:51.289033 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-01b4ff78-0a2c-4774-8557-62ab50d9b2b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:54:51.399019 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b4ff78-0a2c-4774-8557-62ab50d9b2b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:54:51.400384 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b4ff78-0a2c-4774-8557-62ab50d9b2b3 service neutron] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:54:51.418032 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 553/1126] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 12:54:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 12:54:53.749075 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e790e2-4f07-406c-b664-9ebfe67189f5 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:54:53.750367 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e790e2-4f07-406c-b664-9ebfe67189f5 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:54:53.750367 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e790e2-4f07-406c-b664-9ebfe67189f5 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:54:53.751902 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 574/1127] 127.0.0.1 () {54 vars in 917 bytes} [Fri Oct 14 12:54:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:54:53.759656 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a97b5c-cc20-4d0d-b00f-e314587be8db None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:54:53.760174 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a97b5c-cc20-4d0d-b00f-e314587be8db None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:54:53.760284 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a97b5c-cc20-4d0d-b00f-e314587be8db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:54:53.858113 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-a9a97b5c-cc20-4d0d-b00f-e314587be8db None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:54:53.859786 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-a9a97b5c-cc20-4d0d-b00f-e314587be8db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:54:53.896897 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:54:53.997991 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 554/1128] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Oct 14 12:54:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:54:54.341836 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e790e2-4f07-406c-b664-9ebfe67189f5 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:54:54.344192 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-60e790e2-4f07-406c-b664-9ebfe67189f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:54:54.464837 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e790e2-4f07-406c-b664-9ebfe67189f5 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:54:54.496742 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:54:54.558511 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cc0f08-8615-4ad7-a6fe-4a234f6aa374 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d483292f3a4794848fcacfba5b107e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:54:54.559533 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cc0f08-8615-4ad7-a6fe-4a234f6aa374 service neutron] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:54:54.560033 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cc0f08-8615-4ad7-a6fe-4a234f6aa374 service neutron] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:54:54.560529 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cc0f08-8615-4ad7-a6fe-4a234f6aa374 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:54:54.563595 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-f3cc0f08-8615-4ad7-a6fe-4a234f6aa374 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:54:54.695830 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cc0f08-8615-4ad7-a6fe-4a234f6aa374 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:54:54.697277 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cc0f08-8615-4ad7-a6fe-4a234f6aa374 service neutron] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:54:54.715300 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 575/1129] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 12:54:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 12:54:56.942841 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12b4223-eab0-44ff-81f5-a32ed8f2f4c5 None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:54:56.943413 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12b4223-eab0-44ff-81f5-a32ed8f2f4c5 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:54:56.943413 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12b4223-eab0-44ff-81f5-a32ed8f2f4c5 None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:54:56.944708 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 555/1130] 127.0.0.1 () {54 vars in 917 bytes} [Fri Oct 14 12:54:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:54:56.950247 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03f5683-b7dd-452f-a9a0-5b3a3f72e0b1 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:54:56.950671 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03f5683-b7dd-452f-a9a0-5b3a3f72e0b1 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:54:56.950884 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03f5683-b7dd-452f-a9a0-5b3a3f72e0b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:54:57.016410 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:54:57.019744 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-f03f5683-b7dd-452f-a9a0-5b3a3f72e0b1 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:54:57.021339 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-f03f5683-b7dd-452f-a9a0-5b3a3f72e0b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:54:57.119520 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 576/1131] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Oct 14 12:54:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:54:57.416851 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12b4223-eab0-44ff-81f5-a32ed8f2f4c5 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:54:57.418447 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-f12b4223-eab0-44ff-81f5-a32ed8f2f4c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:54:57.523084 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12b4223-eab0-44ff-81f5-a32ed8f2f4c5 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:54:57.574412 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:54:57.599730 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45036e96-06db-4175-9ff3-433b5153069f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d483292f3a4794848fcacfba5b107e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:54:57.600333 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45036e96-06db-4175-9ff3-433b5153069f service neutron] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:54:57.600606 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45036e96-06db-4175-9ff3-433b5153069f service neutron] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:54:57.600874 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45036e96-06db-4175-9ff3-433b5153069f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:54:57.602545 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-45036e96-06db-4175-9ff3-433b5153069f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:54:57.718609 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45036e96-06db-4175-9ff3-433b5153069f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:54:57.720052 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45036e96-06db-4175-9ff3-433b5153069f service neutron] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:54:57.739365 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 556/1132] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 12:54:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 12:55:00.025044 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cafc65-aca8-493a-a1c0-42e4a7e70a09 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:55:00.025597 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cafc65-aca8-493a-a1c0-42e4a7e70a09 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:55:00.025597 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cafc65-aca8-493a-a1c0-42e4a7e70a09 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:55:00.027271 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 577/1133] 127.0.0.1 () {54 vars in 917 bytes} [Fri Oct 14 12:55:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:55:00.033179 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff49ad2-3596-4122-876f-ae195946ab4b None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:55:00.033607 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff49ad2-3596-4122-876f-ae195946ab4b None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:55:00.033762 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff49ad2-3596-4122-876f-ae195946ab4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:55:00.106092 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-aff49ad2-3596-4122-876f-ae195946ab4b None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:55:00.107349 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-aff49ad2-3596-4122-876f-ae195946ab4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:55:00.137050 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:55:00.205924 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 557/1134] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Oct 14 12:55:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:55:00.491462 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cafc65-aca8-493a-a1c0-42e4a7e70a09 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:55:00.493062 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-d6cafc65-aca8-493a-a1c0-42e4a7e70a09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:55:00.608564 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cafc65-aca8-493a-a1c0-42e4a7e70a09 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:55:00.639726 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:55:00.691299 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce534b54-0647-49a5-a393-0803e9062c77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d483292f3a4794848fcacfba5b107e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:55:00.691910 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce534b54-0647-49a5-a393-0803e9062c77 service neutron] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:55:00.692213 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce534b54-0647-49a5-a393-0803e9062c77 service neutron] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:55:00.692484 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce534b54-0647-49a5-a393-0803e9062c77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:55:00.694101 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-ce534b54-0647-49a5-a393-0803e9062c77 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:55:00.803939 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce534b54-0647-49a5-a393-0803e9062c77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:55:00.805297 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce534b54-0647-49a5-a393-0803e9062c77 service neutron] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:55:00.823351 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 578/1135] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 12:55:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 12:55:03.155354 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6341cd-0b96-4143-b22b-db82e3d58d8a None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:55:03.155888 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6341cd-0b96-4143-b22b-db82e3d58d8a None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:55:03.155888 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6341cd-0b96-4143-b22b-db82e3d58d8a None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:55:03.157221 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 558/1136] 127.0.0.1 () {54 vars in 917 bytes} [Fri Oct 14 12:55:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:55:03.162790 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898574e3-aab3-47d9-8565-a9b2db0bfefe None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:55:03.163181 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898574e3-aab3-47d9-8565-a9b2db0bfefe None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:55:03.163338 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898574e3-aab3-47d9-8565-a9b2db0bfefe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:55:03.234069 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-898574e3-aab3-47d9-8565-a9b2db0bfefe None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:55:03.235337 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-898574e3-aab3-47d9-8565-a9b2db0bfefe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:55:03.243975 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:55:03.333903 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 579/1137] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Oct 14 12:55:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:55:03.629394 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6341cd-0b96-4143-b22b-db82e3d58d8a None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:55:03.633612 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-8e6341cd-0b96-4143-b22b-db82e3d58d8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:55:03.753523 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6341cd-0b96-4143-b22b-db82e3d58d8a None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:55:03.808542 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:55:03.827130 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fd5049-af76-4173-9307-835ab9f86dd3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d483292f3a4794848fcacfba5b107e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:55:03.828093 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fd5049-af76-4173-9307-835ab9f86dd3 service neutron] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:55:03.828376 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fd5049-af76-4173-9307-835ab9f86dd3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:55:03.828647 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fd5049-af76-4173-9307-835ab9f86dd3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:55:03.830286 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-72fd5049-af76-4173-9307-835ab9f86dd3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:55:03.943930 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fd5049-af76-4173-9307-835ab9f86dd3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:55:03.945274 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fd5049-af76-4173-9307-835ab9f86dd3 service neutron] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:55:03.963583 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 559/1138] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 12:55:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 12:55:06.191206 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c088ee4b-cbed-4407-91d7-c085239f0f05 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:55:06.191728 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c088ee4b-cbed-4407-91d7-c085239f0f05 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:55:06.191845 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c088ee4b-cbed-4407-91d7-c085239f0f05 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:55:06.193129 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 580/1139] 127.0.0.1 () {54 vars in 917 bytes} [Fri Oct 14 12:55:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:55:06.198381 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18451e0b-b4a7-40ec-bafd-005ed0d6fd94 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:55:06.198784 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18451e0b-b4a7-40ec-bafd-005ed0d6fd94 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:55:06.198945 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18451e0b-b4a7-40ec-bafd-005ed0d6fd94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:55:06.264726 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-18451e0b-b4a7-40ec-bafd-005ed0d6fd94 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:55:06.265945 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-18451e0b-b4a7-40ec-bafd-005ed0d6fd94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:55:06.305394 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:55:06.364191 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 560/1140] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Oct 14 12:55:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:55:06.650577 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c088ee4b-cbed-4407-91d7-c085239f0f05 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:55:06.652140 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-c088ee4b-cbed-4407-91d7-c085239f0f05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:55:06.757987 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c088ee4b-cbed-4407-91d7-c085239f0f05 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:55:06.797588 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:55:06.833983 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea7ab93-601c-4529-9a5e-85c0d0f9e73e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d483292f3a4794848fcacfba5b107e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:55:06.834622 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea7ab93-601c-4529-9a5e-85c0d0f9e73e service neutron] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:55:06.834904 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea7ab93-601c-4529-9a5e-85c0d0f9e73e service neutron] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:55:06.835174 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea7ab93-601c-4529-9a5e-85c0d0f9e73e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:55:06.836767 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-3ea7ab93-601c-4529-9a5e-85c0d0f9e73e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:55:06.947268 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea7ab93-601c-4529-9a5e-85c0d0f9e73e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:55:06.948899 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea7ab93-601c-4529-9a5e-85c0d0f9e73e service neutron] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:55:06.968131 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 581/1141] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 12:55:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 12:55:09.244487 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260d755a-6c36-4629-99dc-5398f14e3b05 None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:55:09.245020 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260d755a-6c36-4629-99dc-5398f14e3b05 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:55:09.245020 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260d755a-6c36-4629-99dc-5398f14e3b05 None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:55:09.246410 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 561/1142] 127.0.0.1 () {54 vars in 917 bytes} [Fri Oct 14 12:55:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:55:09.252128 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c36807-ed8d-44ef-961a-f5a5706daabf None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:55:09.252553 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c36807-ed8d-44ef-961a-f5a5706daabf None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:55:09.252661 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c36807-ed8d-44ef-961a-f5a5706daabf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:55:09.319921 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-e8c36807-ed8d-44ef-961a-f5a5706daabf None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:55:09.321169 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-e8c36807-ed8d-44ef-961a-f5a5706daabf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:55:09.339913 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:55:09.421791 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 582/1143] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Oct 14 12:55:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:55:09.709792 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260d755a-6c36-4629-99dc-5398f14e3b05 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:55:09.711365 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-260d755a-6c36-4629-99dc-5398f14e3b05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:55:09.813968 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260d755a-6c36-4629-99dc-5398f14e3b05 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:55:09.881509 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:55:09.888756 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00f23fb-9547-46dc-bd32-6c23a1a86a18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d483292f3a4794848fcacfba5b107e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:55:09.889893 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00f23fb-9547-46dc-bd32-6c23a1a86a18 service neutron] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:55:09.890206 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00f23fb-9547-46dc-bd32-6c23a1a86a18 service neutron] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:55:09.890485 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00f23fb-9547-46dc-bd32-6c23a1a86a18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:55:09.892118 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-b00f23fb-9547-46dc-bd32-6c23a1a86a18 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:55:10.005324 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00f23fb-9547-46dc-bd32-6c23a1a86a18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:55:10.006741 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00f23fb-9547-46dc-bd32-6c23a1a86a18 service neutron] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:55:10.025128 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 562/1144] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 12:55:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 12:55:12.194344 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00e1956-4d01-4dd2-894f-775c5280c531 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:55:12.194344 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00e1956-4d01-4dd2-894f-775c5280c531 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:55:12.194344 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00e1956-4d01-4dd2-894f-775c5280c531 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:55:12.194344 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 583/1145] 127.0.0.1 () {54 vars in 917 bytes} [Fri Oct 14 12:55:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:55:12.199847 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9930ec-c29d-472f-b791-b691ad8ee846 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:55:12.200290 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9930ec-c29d-472f-b791-b691ad8ee846 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:55:12.200396 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9930ec-c29d-472f-b791-b691ad8ee846 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:55:12.274529 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-4a9930ec-c29d-472f-b791-b691ad8ee846 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:55:12.275751 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-4a9930ec-c29d-472f-b791-b691ad8ee846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:55:12.328234 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:55:12.376779 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 563/1146] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Oct 14 12:55:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:55:12.659328 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00e1956-4d01-4dd2-894f-775c5280c531 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:55:12.660861 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-b00e1956-4d01-4dd2-894f-775c5280c531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:55:12.767225 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00e1956-4d01-4dd2-894f-775c5280c531 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:55:12.821355 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:55:12.848927 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5a52d5-6326-43cb-9afb-5a4a043e175e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d483292f3a4794848fcacfba5b107e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:55:12.849521 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5a52d5-6326-43cb-9afb-5a4a043e175e service neutron] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:55:12.849795 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5a52d5-6326-43cb-9afb-5a4a043e175e service neutron] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:55:12.850063 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5a52d5-6326-43cb-9afb-5a4a043e175e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:55:12.851801 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-de5a52d5-6326-43cb-9afb-5a4a043e175e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:55:12.965067 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5a52d5-6326-43cb-9afb-5a4a043e175e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:55:12.966449 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5a52d5-6326-43cb-9afb-5a4a043e175e service neutron] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:55:12.985731 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 584/1147] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 12:55:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 12:55:22.375181 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=22 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:55:22.983397 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=66 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:55:33.010886 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b45b6b-0eb2-4d65-af6c-baf9120fc7bb None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:55:33.011444 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b45b6b-0eb2-4d65-af6c-baf9120fc7bb None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:55:33.011444 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b45b6b-0eb2-4d65-af6c-baf9120fc7bb None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:55:33.012759 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 564/1148] 10.222.0.17 () {54 vars in 927 bytes} [Fri Oct 14 12:55:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 14 12:55:33.018269 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65bed63-149a-4770-bc6c-f12e22ac4aff None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:55:33.018661 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65bed63-149a-4770-bc6c-f12e22ac4aff None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:55:33.018824 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65bed63-149a-4770-bc6c-f12e22ac4aff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:55:33.083959 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-c65bed63-149a-4770-bc6c-f12e22ac4aff None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:55:33.085181 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-c65bed63-149a-4770-bc6c-f12e22ac4aff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:55:33.182487 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 585/1149] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Oct 14 12:55:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:55:33.484710 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da8c459-b1f5-4d52-b945-8584950a218c None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:55:33.484990 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da8c459-b1f5-4d52-b945-8584950a218c None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:55:33.485261 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da8c459-b1f5-4d52-b945-8584950a218c None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:55:33.486628 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 565/1150] 10.222.0.17 () {54 vars in 962 bytes} [Fri Oct 14 12:55:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:55:33.491530 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e68c9b2-12e7-4c3e-b882-97de4a9245e6 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:55:33.491812 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e68c9b2-12e7-4c3e-b882-97de4a9245e6 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:55:33.492080 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e68c9b2-12e7-4c3e-b882-97de4a9245e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:55:33.567088 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-2e68c9b2-12e7-4c3e-b882-97de4a9245e6 None None] MFA Rules not processed for user `a0de24488ed54df29d8da344d76651d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:55:33.568282 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-2e68c9b2-12e7-4c3e-b882-97de4a9245e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:55:33.588852 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:55:33.645537 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 586/1151] 10.222.0.17 () {58 vars in 1059 bytes} [Fri Oct 14 12:55:33 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:55:33.653277 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da8c459-b1f5-4d52-b945-8584950a218c None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:55:33.655557 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-4da8c459-b1f5-4d52-b945-8584950a218c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:55:33.757537 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da8c459-b1f5-4d52-b945-8584950a218c None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:55:33.829872 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa4b1ad-e495-4d1c-b5ff-02269f857877 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0de24488ed54df29d8da344d76651d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:55:33.830484 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa4b1ad-e495-4d1c-b5ff-02269f857877 service glance] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:55:33.830766 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa4b1ad-e495-4d1c-b5ff-02269f857877 service glance] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:55:33.831042 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa4b1ad-e495-4d1c-b5ff-02269f857877 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:55:33.832643 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-7aa4b1ad-e495-4d1c-b5ff-02269f857877 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:55:33.886020 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:55:33.941382 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa4b1ad-e495-4d1c-b5ff-02269f857877 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:55:33.942856 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa4b1ad-e495-4d1c-b5ff-02269f857877 service glance] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:55:33.961469 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 566/1152] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 12:55:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 12:55:36.209913 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5f90ae-1cb3-41b3-8517-460e6ca1ddf9 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:55:36.210498 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5f90ae-1cb3-41b3-8517-460e6ca1ddf9 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:55:36.210498 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5f90ae-1cb3-41b3-8517-460e6ca1ddf9 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:55:36.211833 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 587/1153] 10.222.0.17 () {54 vars in 927 bytes} [Fri Oct 14 12:55:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:55:36.217166 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7414beba-3289-4af0-b8f2-876a21b9d0bb None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:55:36.217572 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7414beba-3289-4af0-b8f2-876a21b9d0bb None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:55:36.217677 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7414beba-3289-4af0-b8f2-876a21b9d0bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:55:36.283441 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-7414beba-3289-4af0-b8f2-876a21b9d0bb None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:55:36.284647 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-7414beba-3289-4af0-b8f2-876a21b9d0bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:55:36.379926 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 567/1154] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Oct 14 12:55:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:55:36.655699 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5f90ae-1cb3-41b3-8517-460e6ca1ddf9 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:55:36.657258 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-7d5f90ae-1cb3-41b3-8517-460e6ca1ddf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:55:36.780277 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5f90ae-1cb3-41b3-8517-460e6ca1ddf9 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:55:36.829561 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:55:36.874171 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22538dc-499c-4abc-b90b-882d5197e62c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:55:36.874844 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22538dc-499c-4abc-b90b-882d5197e62c admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:55:36.875102 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22538dc-499c-4abc-b90b-882d5197e62c admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:55:36.875373 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22538dc-499c-4abc-b90b-882d5197e62c admin admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:55:36.876008 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22538dc-499c-4abc-b90b-882d5197e62c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:55:36.877118 dv-cinder-820994-7-smb devstack@keystone.service[81438]: WARNING py.warnings [None req-b22538dc-499c-4abc-b90b-882d5197e62c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 14 12:55:36.877118 dv-cinder-820994-7-smb devstack@keystone.service[81438]: warnings.warn(msg) Oct 14 12:55:36.877118 dv-cinder-820994-7-smb devstack@keystone.service[81438]: Oct 14 12:55:36.878279 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22538dc-499c-4abc-b90b-882d5197e62c admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:55:36.897284 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 588/1155] 10.222.0.17 () {56 vars in 1108 bytes} [Fri Oct 14 12:55:36 2022] GET /identity/v3/projects => generated 2553 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 12:55:39.067771 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b83d3d5-9a29-49f5-92ae-f2f9961b8d57 None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:55:39.068351 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b83d3d5-9a29-49f5-92ae-f2f9961b8d57 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:55:39.068351 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b83d3d5-9a29-49f5-92ae-f2f9961b8d57 None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:55:39.069678 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 568/1156] 10.222.0.17 () {54 vars in 927 bytes} [Fri Oct 14 12:55:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:55:39.075034 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769e4430-2bd8-40e6-995a-6431702fa076 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:55:39.075438 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769e4430-2bd8-40e6-995a-6431702fa076 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:55:39.075588 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769e4430-2bd8-40e6-995a-6431702fa076 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:55:39.141215 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-769e4430-2bd8-40e6-995a-6431702fa076 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:55:39.142469 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-769e4430-2bd8-40e6-995a-6431702fa076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:55:39.238476 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 589/1157] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Oct 14 12:55:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:55:39.534103 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b83d3d5-9a29-49f5-92ae-f2f9961b8d57 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:55:39.535723 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-4b83d3d5-9a29-49f5-92ae-f2f9961b8d57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:55:39.546471 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:55:39.681049 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b83d3d5-9a29-49f5-92ae-f2f9961b8d57 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:55:39.760544 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:55:39.792904 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5740d322-33b7-43b8-bee2-e476bc5145f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '931f4e32c8764514b5efed31b0785be7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:55:39.793435 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5740d322-33b7-43b8-bee2-e476bc5145f7 service nova] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:55:39.793714 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5740d322-33b7-43b8-bee2-e476bc5145f7 service nova] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:55:39.794598 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5740d322-33b7-43b8-bee2-e476bc5145f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:55:39.796195 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-5740d322-33b7-43b8-bee2-e476bc5145f7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:55:39.884175 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5740d322-33b7-43b8-bee2-e476bc5145f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:55:39.885760 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5740d322-33b7-43b8-bee2-e476bc5145f7 service nova] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:55:39.903057 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 569/1158] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 12:55:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 12:55:42.261040 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c898be7-7609-4117-b169-dbf9d0c7a117 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:55:42.261542 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c898be7-7609-4117-b169-dbf9d0c7a117 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:55:42.261648 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c898be7-7609-4117-b169-dbf9d0c7a117 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:55:42.263135 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 590/1159] 10.222.0.17 () {54 vars in 927 bytes} [Fri Oct 14 12:55:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:55:42.268469 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bc5cec-781d-4c03-84a7-e9433b3d446d None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:55:42.268872 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bc5cec-781d-4c03-84a7-e9433b3d446d None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:55:42.269009 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bc5cec-781d-4c03-84a7-e9433b3d446d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:55:42.334082 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-11bc5cec-781d-4c03-84a7-e9433b3d446d None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:55:42.335315 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-11bc5cec-781d-4c03-84a7-e9433b3d446d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:55:42.382869 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:55:42.432719 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 570/1160] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Oct 14 12:55:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:55:42.725082 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c898be7-7609-4117-b169-dbf9d0c7a117 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:55:42.726642 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-1c898be7-7609-4117-b169-dbf9d0c7a117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:55:42.750247 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:55:42.831674 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c898be7-7609-4117-b169-dbf9d0c7a117 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:55:42.904936 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f13b8f-26b5-49fa-a98d-e917eb0e6ff3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d483292f3a4794848fcacfba5b107e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:55:42.905532 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f13b8f-26b5-49fa-a98d-e917eb0e6ff3 service neutron] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:55:42.905811 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f13b8f-26b5-49fa-a98d-e917eb0e6ff3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:55:42.906082 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f13b8f-26b5-49fa-a98d-e917eb0e6ff3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:55:42.907703 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-05f13b8f-26b5-49fa-a98d-e917eb0e6ff3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:55:42.981039 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:55:43.016871 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f13b8f-26b5-49fa-a98d-e917eb0e6ff3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:55:43.018370 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f13b8f-26b5-49fa-a98d-e917eb0e6ff3 service neutron] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:55:43.036302 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 591/1161] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 12:55:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 12:55:45.221041 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322bd238-cee5-4235-9046-cb574f10887e None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:55:45.221633 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322bd238-cee5-4235-9046-cb574f10887e None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:55:45.221633 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322bd238-cee5-4235-9046-cb574f10887e None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:55:45.223142 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 571/1162] 10.222.0.17 () {54 vars in 927 bytes} [Fri Oct 14 12:55:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:55:45.228276 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676d0f49-fc07-48e8-97da-95114c10013d None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:55:45.228964 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676d0f49-fc07-48e8-97da-95114c10013d None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:55:45.229067 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676d0f49-fc07-48e8-97da-95114c10013d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:55:45.294271 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-676d0f49-fc07-48e8-97da-95114c10013d None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:55:45.295471 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-676d0f49-fc07-48e8-97da-95114c10013d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:55:45.389188 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 592/1163] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Oct 14 12:55:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:55:45.676190 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322bd238-cee5-4235-9046-cb574f10887e None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:55:45.677745 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-322bd238-cee5-4235-9046-cb574f10887e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:55:45.779320 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322bd238-cee5-4235-9046-cb574f10887e None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:55:45.849736 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:55:45.851383 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac95a03e-9f69-4809-af21-b721e2d86e22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d483292f3a4794848fcacfba5b107e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:55:45.852095 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac95a03e-9f69-4809-af21-b721e2d86e22 service neutron] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:55:45.852579 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac95a03e-9f69-4809-af21-b721e2d86e22 service neutron] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:55:45.853078 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac95a03e-9f69-4809-af21-b721e2d86e22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:55:45.855234 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-ac95a03e-9f69-4809-af21-b721e2d86e22 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:55:45.961582 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac95a03e-9f69-4809-af21-b721e2d86e22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:55:45.962955 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac95a03e-9f69-4809-af21-b721e2d86e22 service neutron] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:55:45.982166 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 572/1164] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 12:55:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 12:55:48.222068 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c1ebb7-13c7-42bc-a751-5b377b1c6ff6 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:55:48.222657 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c1ebb7-13c7-42bc-a751-5b377b1c6ff6 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:55:48.222657 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c1ebb7-13c7-42bc-a751-5b377b1c6ff6 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:55:48.224064 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 593/1165] 10.222.0.17 () {54 vars in 927 bytes} [Fri Oct 14 12:55:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 14 12:55:48.229804 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c777cec9-aedc-4bce-ad61-ac94699824d3 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:55:48.230241 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c777cec9-aedc-4bce-ad61-ac94699824d3 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:55:48.230397 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c777cec9-aedc-4bce-ad61-ac94699824d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:55:48.295980 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-c777cec9-aedc-4bce-ad61-ac94699824d3 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:55:48.297194 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-c777cec9-aedc-4bce-ad61-ac94699824d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:55:48.351881 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:55:48.396155 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 573/1166] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Oct 14 12:55:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 12:55:48.687464 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c1ebb7-13c7-42bc-a751-5b377b1c6ff6 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:55:48.689039 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-98c1ebb7-13c7-42bc-a751-5b377b1c6ff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:55:48.725550 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:55:48.793295 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c1ebb7-13c7-42bc-a751-5b377b1c6ff6 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:55:48.866410 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee952d7d-8839-4281-a559-f51633992785 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d483292f3a4794848fcacfba5b107e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:55:48.867006 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee952d7d-8839-4281-a559-f51633992785 service neutron] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:55:48.867283 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee952d7d-8839-4281-a559-f51633992785 service neutron] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:55:48.867549 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee952d7d-8839-4281-a559-f51633992785 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:55:48.869112 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-ee952d7d-8839-4281-a559-f51633992785 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:55:48.948870 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:55:48.978792 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee952d7d-8839-4281-a559-f51633992785 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:55:48.980255 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee952d7d-8839-4281-a559-f51633992785 service neutron] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:55:48.998619 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 594/1167] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 12:55:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 12:55:51.376287 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c784e9a-0ff0-4d39-b3a6-76c699a321a3 None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:55:51.376920 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c784e9a-0ff0-4d39-b3a6-76c699a321a3 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:55:51.376920 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c784e9a-0ff0-4d39-b3a6-76c699a321a3 None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:55:51.378071 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 574/1168] 10.222.0.17 () {54 vars in 927 bytes} [Fri Oct 14 12:55:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:55:51.383314 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88baf043-e297-45f8-88fd-96bbe55f388b None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:55:51.383759 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88baf043-e297-45f8-88fd-96bbe55f388b None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:55:51.383865 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88baf043-e297-45f8-88fd-96bbe55f388b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:55:51.448374 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-88baf043-e297-45f8-88fd-96bbe55f388b None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:55:51.450318 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-88baf043-e297-45f8-88fd-96bbe55f388b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:55:51.545174 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 595/1169] 10.222.0.17 () {58 vars in 1024 bytes} [Fri Oct 14 12:55:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:55:51.838399 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c784e9a-0ff0-4d39-b3a6-76c699a321a3 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:55:51.839932 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-4c784e9a-0ff0-4d39-b3a6-76c699a321a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:55:51.940574 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c784e9a-0ff0-4d39-b3a6-76c699a321a3 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:55:52.011615 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38467782-50aa-4060-9a9b-7e507d5b2699 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d483292f3a4794848fcacfba5b107e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:55:52.012395 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38467782-50aa-4060-9a9b-7e507d5b2699 service neutron] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:55:52.012776 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38467782-50aa-4060-9a9b-7e507d5b2699 service neutron] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:55:52.013047 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38467782-50aa-4060-9a9b-7e507d5b2699 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:55:52.014650 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-38467782-50aa-4060-9a9b-7e507d5b2699 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:55:52.023754 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:55:52.126621 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38467782-50aa-4060-9a9b-7e507d5b2699 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:55:52.128067 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38467782-50aa-4060-9a9b-7e507d5b2699 service neutron] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:55:52.145600 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 575/1170] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 12:55:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 12:56:01.543700 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=82 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:56:02.143466 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=50 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:57:06.123521 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724275be-97dc-4627-9a24-18279b31e723 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:57:06.124055 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724275be-97dc-4627-9a24-18279b31e723 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:57:06.124162 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724275be-97dc-4627-9a24-18279b31e723 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:57:06.200333 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-724275be-97dc-4627-9a24-18279b31e723 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:57:06.201549 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-724275be-97dc-4627-9a24-18279b31e723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:57:06.297998 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 596/1171] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 12:57:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:57:06.306254 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b109f1c-e9dc-4842-829e-e2b35e1cf0bf None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:57:06.306756 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b109f1c-e9dc-4842-829e-e2b35e1cf0bf None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:57:06.306867 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b109f1c-e9dc-4842-829e-e2b35e1cf0bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:57:06.382634 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-1b109f1c-e9dc-4842-829e-e2b35e1cf0bf None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:57:06.384114 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-1b109f1c-e9dc-4842-829e-e2b35e1cf0bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:57:06.481237 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 576/1172] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 12:57:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:57:06.485864 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724275be-97dc-4627-9a24-18279b31e723 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:57:06.487091 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-724275be-97dc-4627-9a24-18279b31e723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:57:06.501861 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724275be-97dc-4627-9a24-18279b31e723 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:57:06.567472 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:57:06.602187 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5105afb7-b028-4f1b-b6b9-2830b23a6f7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:57:06.603268 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5105afb7-b028-4f1b-b6b9-2830b23a6f7f admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:57:06.603549 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5105afb7-b028-4f1b-b6b9-2830b23a6f7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:57:06.603823 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5105afb7-b028-4f1b-b6b9-2830b23a6f7f admin admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:57:06.604481 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5105afb7-b028-4f1b-b6b9-2830b23a6f7f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 12:57:06.604762 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5105afb7-b028-4f1b-b6b9-2830b23a6f7f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:57:06.605775 dv-cinder-820994-7-smb devstack@keystone.service[81438]: WARNING py.warnings [None req-5105afb7-b028-4f1b-b6b9-2830b23a6f7f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 14 12:57:06.605775 dv-cinder-820994-7-smb devstack@keystone.service[81438]: warnings.warn(msg) Oct 14 12:57:06.605775 dv-cinder-820994-7-smb devstack@keystone.service[81438]: Oct 14 12:57:06.606688 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5105afb7-b028-4f1b-b6b9-2830b23a6f7f admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:57:06.617767 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 597/1173] 10.222.0.17 () {58 vars in 1153 bytes} [Fri Oct 14 12:57:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:57:06.627159 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b109f1c-e9dc-4842-829e-e2b35e1cf0bf None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:57:06.636691 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b109f1c-e9dc-4842-829e-e2b35e1cf0bf None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:57:06.699250 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:57:06.733233 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca806739-e1a3-4e19-a57d-01c15619c5df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:57:06.733835 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca806739-e1a3-4e19-a57d-01c15619c5df admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:57:06.734114 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca806739-e1a3-4e19-a57d-01c15619c5df admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:57:06.734410 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca806739-e1a3-4e19-a57d-01c15619c5df admin admin] PATH_INFO: `/v3/projects` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:57:06.735047 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca806739-e1a3-4e19-a57d-01c15619c5df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:57:06.736067 dv-cinder-820994-7-smb devstack@keystone.service[81439]: WARNING py.warnings [None req-ca806739-e1a3-4e19-a57d-01c15619c5df admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 14 12:57:06.736067 dv-cinder-820994-7-smb devstack@keystone.service[81439]: warnings.warn(msg) Oct 14 12:57:06.736067 dv-cinder-820994-7-smb devstack@keystone.service[81439]: Oct 14 12:57:06.737273 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca806739-e1a3-4e19-a57d-01c15619c5df admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:57:06.793793 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 577/1174] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Oct 14 12:57:06 2022] POST /identity/v3/projects => generated 379 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 12:57:06.798150 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5105afb7-b028-4f1b-b6b9-2830b23a6f7f admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:57:06.799755 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-5105afb7-b028-4f1b-b6b9-2830b23a6f7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:57:06.833561 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5105afb7-b028-4f1b-b6b9-2830b23a6f7f admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:57:06.926019 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f949986e-26b8-40ef-8d02-2e8ae07698b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:57:06.926654 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f949986e-26b8-40ef-8d02-2e8ae07698b6 admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:57:06.926936 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f949986e-26b8-40ef-8d02-2e8ae07698b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:57:06.927211 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f949986e-26b8-40ef-8d02-2e8ae07698b6 admin admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:57:06.927848 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f949986e-26b8-40ef-8d02-2e8ae07698b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:57:06.928869 dv-cinder-820994-7-smb devstack@keystone.service[81438]: WARNING py.warnings [None req-f949986e-26b8-40ef-8d02-2e8ae07698b6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 14 12:57:06.928869 dv-cinder-820994-7-smb devstack@keystone.service[81438]: warnings.warn(msg) Oct 14 12:57:06.928869 dv-cinder-820994-7-smb devstack@keystone.service[81438]: Oct 14 12:57:06.930073 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f949986e-26b8-40ef-8d02-2e8ae07698b6 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:57:06.972929 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 598/1175] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Oct 14 12:57:06 2022] POST /identity/v3/users => generated 290 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 12:57:06.976984 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca806739-e1a3-4e19-a57d-01c15619c5df admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:57:06.978834 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-ca806739-e1a3-4e19-a57d-01c15619c5df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:57:07.041572 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca806739-e1a3-4e19-a57d-01c15619c5df admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:57:07.124649 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:57:07.136088 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b81a5d1-de9c-46b3-bbe0-059be3a18b95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:57:07.136686 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b81a5d1-de9c-46b3-bbe0-059be3a18b95 admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:57:07.136961 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b81a5d1-de9c-46b3-bbe0-059be3a18b95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:57:07.137229 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b81a5d1-de9c-46b3-bbe0-059be3a18b95 admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:57:07.137858 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b81a5d1-de9c-46b3-bbe0-059be3a18b95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:57:07.139492 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b81a5d1-de9c-46b3-bbe0-059be3a18b95 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:57:07.152315 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 578/1176] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 12:57:06 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 12:57:07.156358 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f949986e-26b8-40ef-8d02-2e8ae07698b6 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:57:07.157923 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-f949986e-26b8-40ef-8d02-2e8ae07698b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:57:07.170353 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f949986e-26b8-40ef-8d02-2e8ae07698b6 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:57:07.195069 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:57:07.266139 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cc6eb9-72c5-463b-9242-70ebbcd02a8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:57:07.266907 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cc6eb9-72c5-463b-9242-70ebbcd02a8e admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:57:07.267166 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cc6eb9-72c5-463b-9242-70ebbcd02a8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:57:07.267433 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cc6eb9-72c5-463b-9242-70ebbcd02a8e admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:57:07.268066 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cc6eb9-72c5-463b-9242-70ebbcd02a8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:57:07.269655 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cc6eb9-72c5-463b-9242-70ebbcd02a8e admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:57:07.282344 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 599/1177] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 12:57:07 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 12:57:07.286647 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b81a5d1-de9c-46b3-bbe0-059be3a18b95 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:57:07.288151 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-4b81a5d1-de9c-46b3-bbe0-059be3a18b95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:57:07.321669 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b81a5d1-de9c-46b3-bbe0-059be3a18b95 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:57:07.413883 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51598a81-d4b3-4648-b075-12f6ef90396c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:57:07.414478 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51598a81-d4b3-4648-b075-12f6ef90396c admin admin] REQUEST_METHOD: `PUT` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:57:07.415628 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51598a81-d4b3-4648-b075-12f6ef90396c admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:57:07.415914 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51598a81-d4b3-4648-b075-12f6ef90396c admin admin] PATH_INFO: `/v3/projects/3809718639fc4377afd7dc442942d1b3/users/e5ede49c75d84b26833f6fa843b32b3d/roles/5e8849303a75425b9eaa2681cc031af1` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:57:07.438922 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51598a81-d4b3-4648-b075-12f6ef90396c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3809718639fc4377afd7dc442942d1b3, user_id=e5ede49c75d84b26833f6fa843b32b3d, role_id=5e8849303a75425b9eaa2681cc031af1)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:57:07.441607 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51598a81-d4b3-4648-b075-12f6ef90396c admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:57:07.466627 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 579/1178] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Oct 14 12:57:07 2022] PUT /identity/v3/projects/3809718639fc4377afd7dc442942d1b3/users/e5ede49c75d84b26833f6fa843b32b3d/roles/5e8849303a75425b9eaa2681cc031af1 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 12:57:07.478511 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe635aa-81d1-471a-91cb-8a1678654a48 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:57:07.478824 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe635aa-81d1-471a-91cb-8a1678654a48 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:57:07.479127 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe635aa-81d1-471a-91cb-8a1678654a48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:57:07.536500 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-afe635aa-81d1-471a-91cb-8a1678654a48 None None] MFA Rules not processed for user `e5ede49c75d84b26833f6fa843b32b3d`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:57:07.537709 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-afe635aa-81d1-471a-91cb-8a1678654a48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:57:07.613481 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 600/1179] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 12:57:07 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:57:07.627351 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3698675-a329-4b8b-a5cd-bb983abc9630 None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:57:07.627639 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3698675-a329-4b8b-a5cd-bb983abc9630 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:57:07.627909 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3698675-a329-4b8b-a5cd-bb983abc9630 None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:57:07.629235 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 580/1180] 10.222.0.17 () {54 vars in 963 bytes} [Fri Oct 14 12:57:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:57:07.634163 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b815f961-98ee-4b6f-98d4-9490dbf5a762 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:57:07.634453 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b815f961-98ee-4b6f-98d4-9490dbf5a762 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:57:07.634731 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b815f961-98ee-4b6f-98d4-9490dbf5a762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:57:07.670226 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:57:07.714859 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-b815f961-98ee-4b6f-98d4-9490dbf5a762 None None] MFA Rules not processed for user `76c3c564b8c548e4beef1cbfba2ad343`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:57:07.716072 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-b815f961-98ee-4b6f-98d4-9490dbf5a762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:57:07.790459 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 601/1181] 10.222.0.17 () {58 vars in 1060 bytes} [Fri Oct 14 12:57:07 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:57:07.800067 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3698675-a329-4b8b-a5cd-bb983abc9630 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:57:07.801607 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-a3698675-a329-4b8b-a5cd-bb983abc9630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:57:07.850439 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:57:07.904741 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3698675-a329-4b8b-a5cd-bb983abc9630 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:57:07.977199 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed959141-4922-4d03-ab52-7d8357c83fab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c3c564b8c548e4beef1cbfba2ad343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:57:07.979257 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed959141-4922-4d03-ab52-7d8357c83fab service cinder] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:57:07.979257 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed959141-4922-4d03-ab52-7d8357c83fab service cinder] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:57:07.979257 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed959141-4922-4d03-ab52-7d8357c83fab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:57:07.980678 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-ed959141-4922-4d03-ab52-7d8357c83fab service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:57:08.077163 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed959141-4922-4d03-ab52-7d8357c83fab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:57:08.078633 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed959141-4922-4d03-ab52-7d8357c83fab service cinder] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:57:08.082084 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:57:08.097558 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 581/1182] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 12:57:07 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 12:57:08.143977 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b37a2b-3d26-4622-9ac0-a254c488c1b8 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:57:08.144268 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b37a2b-3d26-4622-9ac0-a254c488c1b8 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:57:08.144541 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b37a2b-3d26-4622-9ac0-a254c488c1b8 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:57:08.145789 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 602/1183] 10.222.0.17 () {52 vars in 830 bytes} [Fri Oct 14 12:57:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:57:08.149360 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed959141-4922-4d03-ab52-7d8357c83fab service cinder] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:57:08.150593 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-ed959141-4922-4d03-ab52-7d8357c83fab service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:57:08.248952 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed959141-4922-4d03-ab52-7d8357c83fab service cinder] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:57:08.341682 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a70784-78b0-42cf-ad9e-7bc2774cd0fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:57:08.342383 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a70784-78b0-42cf-ad9e-7bc2774cd0fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:57:08.342601 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a70784-78b0-42cf-ad9e-7bc2774cd0fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:57:08.342878 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a70784-78b0-42cf-ad9e-7bc2774cd0fd admin admin] PATH_INFO: `/v3/users/e5ede49c75d84b26833f6fa843b32b3d` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:57:08.357001 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a70784-78b0-42cf-ad9e-7bc2774cd0fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5ede49c75d84b26833f6fa843b32b3d)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:57:08.358033 dv-cinder-820994-7-smb devstack@keystone.service[81439]: WARNING py.warnings [None req-b8a70784-78b0-42cf-ad9e-7bc2774cd0fd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 14 12:57:08.358033 dv-cinder-820994-7-smb devstack@keystone.service[81439]: warnings.warn(msg) Oct 14 12:57:08.358033 dv-cinder-820994-7-smb devstack@keystone.service[81439]: Oct 14 12:57:08.359296 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a70784-78b0-42cf-ad9e-7bc2774cd0fd admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:57:08.369465 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:57:08.424811 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-b8a70784-78b0-42cf-ad9e-7bc2774cd0fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5ede49c75d84b26833f6fa843b32b3d'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 12:57:08.440323 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-b8a70784-78b0-42cf-ad9e-7bc2774cd0fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5ede49c75d84b26833f6fa843b32b3d'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 12:57:08.440808 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-b8a70784-78b0-42cf-ad9e-7bc2774cd0fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5ede49c75d84b26833f6fa843b32b3d'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 12:57:08.450372 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-b8a70784-78b0-42cf-ad9e-7bc2774cd0fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5ede49c75d84b26833f6fa843b32b3d'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 12:57:08.473570 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-b8a70784-78b0-42cf-ad9e-7bc2774cd0fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5ede49c75d84b26833f6fa843b32b3d'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 12:57:08.480433 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 582/1184] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Oct 14 12:57:08 2022] DELETE /identity/v3/users/e5ede49c75d84b26833f6fa843b32b3d => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 12:57:08.484821 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83c102c-9eab-495e-8bd9-7741af486510 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:57:08.485285 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83c102c-9eab-495e-8bd9-7741af486510 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:57:08.485394 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83c102c-9eab-495e-8bd9-7741af486510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:57:08.544426 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-e83c102c-9eab-495e-8bd9-7741af486510 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:57:08.545555 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-e83c102c-9eab-495e-8bd9-7741af486510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:57:08.619296 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:57:08.632344 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 603/1185] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 12:57:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:57:08.642254 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a70784-78b0-42cf-ad9e-7bc2774cd0fd admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:57:08.643599 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-b8a70784-78b0-42cf-ad9e-7bc2774cd0fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:57:08.743099 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a70784-78b0-42cf-ad9e-7bc2774cd0fd admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:57:08.798147 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:57:08.818816 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e4ea92-7ba4-4eb5-8857-fe961443513b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d483292f3a4794848fcacfba5b107e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:57:08.819460 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e4ea92-7ba4-4eb5-8857-fe961443513b service neutron] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:57:08.819789 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e4ea92-7ba4-4eb5-8857-fe961443513b service neutron] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:57:08.820059 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e4ea92-7ba4-4eb5-8857-fe961443513b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:57:08.822276 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-57e4ea92-7ba4-4eb5-8857-fe961443513b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:57:08.929132 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e4ea92-7ba4-4eb5-8857-fe961443513b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:57:08.930781 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e4ea92-7ba4-4eb5-8857-fe961443513b service neutron] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:57:08.951472 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 583/1186] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 12:57:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 12:57:09.273029 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83c102c-9eab-495e-8bd9-7741af486510 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:57:09.274741 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-e83c102c-9eab-495e-8bd9-7741af486510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:57:09.286183 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83c102c-9eab-495e-8bd9-7741af486510 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:57:09.386191 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220f1bcf-9937-437b-bbb8-97f09c1f92e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:57:09.386744 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220f1bcf-9937-437b-bbb8-97f09c1f92e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:57:09.387020 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220f1bcf-9937-437b-bbb8-97f09c1f92e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:57:09.387290 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220f1bcf-9937-437b-bbb8-97f09c1f92e0 admin admin] PATH_INFO: `/v3/projects/3809718639fc4377afd7dc442942d1b3` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:57:09.397673 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220f1bcf-9937-437b-bbb8-97f09c1f92e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3809718639fc4377afd7dc442942d1b3)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:57:09.398730 dv-cinder-820994-7-smb devstack@keystone.service[81438]: WARNING py.warnings [None req-220f1bcf-9937-437b-bbb8-97f09c1f92e0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 14 12:57:09.398730 dv-cinder-820994-7-smb devstack@keystone.service[81438]: warnings.warn(msg) Oct 14 12:57:09.398730 dv-cinder-820994-7-smb devstack@keystone.service[81438]: Oct 14 12:57:09.399981 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220f1bcf-9937-437b-bbb8-97f09c1f92e0 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:57:09.457201 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-220f1bcf-9937-437b-bbb8-97f09c1f92e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3809718639fc4377afd7dc442942d1b3', 'request_id': 'req-220f1bcf-9937-437b-bbb8-97f09c1f92e0'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 12:57:09.463262 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-220f1bcf-9937-437b-bbb8-97f09c1f92e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3809718639fc4377afd7dc442942d1b3', 'request_id': 'req-220f1bcf-9937-437b-bbb8-97f09c1f92e0'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 12:57:09.476318 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-220f1bcf-9937-437b-bbb8-97f09c1f92e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3809718639fc4377afd7dc442942d1b3', 'request_id': 'req-220f1bcf-9937-437b-bbb8-97f09c1f92e0'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 12:57:09.503653 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-220f1bcf-9937-437b-bbb8-97f09c1f92e0 admin admin] The token cache is being invalidate because project 3809718639fc4377afd7dc442942d1b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 12:57:09.504302 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-220f1bcf-9937-437b-bbb8-97f09c1f92e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 12:57:09.504422 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-220f1bcf-9937-437b-bbb8-97f09c1f92e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 12:57:09.505749 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 604/1187] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Oct 14 12:57:09 2022] DELETE /identity/v3/projects/3809718639fc4377afd7dc442942d1b3 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 12:57:18.949211 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=62 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:57:19.501625 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:58:44.791215 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fa74e9-72c2-4531-857b-f518c85b4db0 None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:58:44.791830 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fa74e9-72c2-4531-857b-f518c85b4db0 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:58:44.791830 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fa74e9-72c2-4531-857b-f518c85b4db0 None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:58:44.793255 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 584/1188] 127.0.0.1 () {54 vars in 901 bytes} [Fri Oct 14 12:58:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:58:44.798039 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df95ee0-fc62-4cea-8728-c0fd6a68d591 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:58:44.798512 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df95ee0-fc62-4cea-8728-c0fd6a68d591 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:58:44.798639 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df95ee0-fc62-4cea-8728-c0fd6a68d591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:58:44.879721 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-0df95ee0-fc62-4cea-8728-c0fd6a68d591 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:58:44.880941 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-0df95ee0-fc62-4cea-8728-c0fd6a68d591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:58:44.985885 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 605/1189] 127.0.0.1 () {58 vars in 998 bytes} [Fri Oct 14 12:58:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:58:45.143889 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fa74e9-72c2-4531-857b-f518c85b4db0 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:58:45.145968 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-45fa74e9-72c2-4531-857b-f518c85b4db0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:58:45.265864 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fa74e9-72c2-4531-857b-f518c85b4db0 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:58:45.271531 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5489bc1e-7f8d-4b00-922e-fe653c152838 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '931f4e32c8764514b5efed31b0785be7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:58:45.272146 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5489bc1e-7f8d-4b00-922e-fe653c152838 service nova] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:58:45.272424 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5489bc1e-7f8d-4b00-922e-fe653c152838 service nova] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:58:45.272700 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5489bc1e-7f8d-4b00-922e-fe653c152838 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:58:45.280971 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5489bc1e-7f8d-4b00-922e-fe653c152838 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:58:45.282618 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5489bc1e-7f8d-4b00-922e-fe653c152838 service nova] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:58:45.292556 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 585/1190] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 12:58:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 14 12:58:46.383573 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c3540b-8cef-4982-bb88-423d01b288e1 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:58:46.384181 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c3540b-8cef-4982-bb88-423d01b288e1 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:58:46.384181 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c3540b-8cef-4982-bb88-423d01b288e1 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:58:46.385453 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 606/1191] 127.0.0.1 () {54 vars in 901 bytes} [Fri Oct 14 12:58:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:58:46.392069 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a4eb44-f6d3-49d1-9c87-cd82a451a312 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:58:46.392587 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a4eb44-f6d3-49d1-9c87-cd82a451a312 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:58:46.392702 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a4eb44-f6d3-49d1-9c87-cd82a451a312 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:58:46.413000 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-02a4eb44-f6d3-49d1-9c87-cd82a451a312 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:58:46.414330 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-02a4eb44-f6d3-49d1-9c87-cd82a451a312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:58:46.422248 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 586/1192] 127.0.0.1 () {58 vars in 998 bytes} [Fri Oct 14 12:58:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:58:46.576284 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c3540b-8cef-4982-bb88-423d01b288e1 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:58:46.591118 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c3540b-8cef-4982-bb88-423d01b288e1 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:58:46.596554 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334a24eb-11b6-4f36-a5fa-cbd415e5e881 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '931f4e32c8764514b5efed31b0785be7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:58:46.597146 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334a24eb-11b6-4f36-a5fa-cbd415e5e881 service nova] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:58:46.597429 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334a24eb-11b6-4f36-a5fa-cbd415e5e881 service nova] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:58:46.597699 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334a24eb-11b6-4f36-a5fa-cbd415e5e881 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:58:46.606051 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334a24eb-11b6-4f36-a5fa-cbd415e5e881 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:58:46.607670 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334a24eb-11b6-4f36-a5fa-cbd415e5e881 service nova] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:58:46.617598 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 607/1193] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 12:58:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 12:58:46.830717 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0e08f2-2a9a-4e4c-8885-528f7fc74a2a None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:58:46.831001 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0e08f2-2a9a-4e4c-8885-528f7fc74a2a None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:58:46.831290 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0e08f2-2a9a-4e4c-8885-528f7fc74a2a None None] PATH_INFO: `/v3` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:58:46.832550 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 587/1194] 10.222.0.33 () {54 vars in 925 bytes} [Fri Oct 14 12:58:46 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 12:58:46.839084 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d58a0c-3e9b-48ca-b0a3-0309b2d80198 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:58:46.839362 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d58a0c-3e9b-48ca-b0a3-0309b2d80198 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:58:46.839642 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d58a0c-3e9b-48ca-b0a3-0309b2d80198 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:58:46.909206 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-86d58a0c-3e9b-48ca-b0a3-0309b2d80198 None None] MFA Rules not processed for user `0a5e5c35ed8b4abc877ba8d8c490dacd`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:58:46.910429 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-86d58a0c-3e9b-48ca-b0a3-0309b2d80198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:58:46.931807 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:58:46.991493 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 608/1195] 10.222.0.33 () {58 vars in 1015 bytes} [Fri Oct 14 12:58:46 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:58:50.613629 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf31e794-629f-4763-bb95-e5b1b9d70d19 None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:58:50.614225 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf31e794-629f-4763-bb95-e5b1b9d70d19 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:58:50.614225 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf31e794-629f-4763-bb95-e5b1b9d70d19 None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:58:50.616271 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 588/1196] 10.222.0.17 () {54 vars in 961 bytes} [Fri Oct 14 12:58:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:58:50.621633 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5409b9dc-d6ba-4438-9522-08a993c7e065 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:58:50.622101 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5409b9dc-d6ba-4438-9522-08a993c7e065 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:58:50.622225 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5409b9dc-d6ba-4438-9522-08a993c7e065 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:58:50.642592 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-5409b9dc-d6ba-4438-9522-08a993c7e065 None None] MFA Rules not processed for user `0a5e5c35ed8b4abc877ba8d8c490dacd`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:58:50.643818 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-5409b9dc-d6ba-4438-9522-08a993c7e065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:58:50.653040 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 609/1197] 10.222.0.17 () {58 vars in 1058 bytes} [Fri Oct 14 12:58:50 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:58:50.660995 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf31e794-629f-4763-bb95-e5b1b9d70d19 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:58:50.679373 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf31e794-629f-4763-bb95-e5b1b9d70d19 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:58:50.686053 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6998fc-5e83-4b24-a588-343350bf8f8f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a5e5c35ed8b4abc877ba8d8c490dacd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:58:50.686653 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6998fc-5e83-4b24-a588-343350bf8f8f service placement] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:58:50.686930 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6998fc-5e83-4b24-a588-343350bf8f8f service placement] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:58:50.687202 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6998fc-5e83-4b24-a588-343350bf8f8f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:58:50.696448 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6998fc-5e83-4b24-a588-343350bf8f8f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:58:50.698099 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6998fc-5e83-4b24-a588-343350bf8f8f service placement] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:58:50.708714 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 589/1198] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 12:58:50 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 12:58:58.220052 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4daebb5-26f6-44eb-9ea1-144b6d4d70f9 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:58:58.220657 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4daebb5-26f6-44eb-9ea1-144b6d4d70f9 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:58:58.220657 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4daebb5-26f6-44eb-9ea1-144b6d4d70f9 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:58:58.221932 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 610/1199] 127.0.0.1 () {54 vars in 901 bytes} [Fri Oct 14 12:58:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:58:58.229655 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dde6b03-68e0-40a2-bb13-3d777a70e3b0 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:58:58.230258 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dde6b03-68e0-40a2-bb13-3d777a70e3b0 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:58:58.230258 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dde6b03-68e0-40a2-bb13-3d777a70e3b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:58:58.250436 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-7dde6b03-68e0-40a2-bb13-3d777a70e3b0 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:58:58.251646 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-7dde6b03-68e0-40a2-bb13-3d777a70e3b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:58:58.259952 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 590/1200] 127.0.0.1 () {58 vars in 998 bytes} [Fri Oct 14 12:58:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:58:58.459874 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4daebb5-26f6-44eb-9ea1-144b6d4d70f9 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:58:58.477469 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4daebb5-26f6-44eb-9ea1-144b6d4d70f9 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:58:58.483300 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f572f516-91ef-4245-a8ac-0f5ff806295c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '931f4e32c8764514b5efed31b0785be7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:58:58.483915 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f572f516-91ef-4245-a8ac-0f5ff806295c service nova] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:58:58.484196 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f572f516-91ef-4245-a8ac-0f5ff806295c service nova] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:58:58.484501 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f572f516-91ef-4245-a8ac-0f5ff806295c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:58:58.494030 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f572f516-91ef-4245-a8ac-0f5ff806295c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:58:58.495682 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f572f516-91ef-4245-a8ac-0f5ff806295c service nova] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:58:58.505805 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 611/1201] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 12:58:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 12:58:59.607653 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aadcbfa-8dbd-44c8-9f8f-6b8cbd628d80 None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:58:59.608269 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aadcbfa-8dbd-44c8-9f8f-6b8cbd628d80 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:58:59.608269 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aadcbfa-8dbd-44c8-9f8f-6b8cbd628d80 None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:58:59.609528 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 591/1202] 127.0.0.1 () {54 vars in 901 bytes} [Fri Oct 14 12:58:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:58:59.616789 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ee841b-71ae-4eaf-9785-84466ee818ac None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:58:59.617351 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ee841b-71ae-4eaf-9785-84466ee818ac None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:58:59.617351 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ee841b-71ae-4eaf-9785-84466ee818ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:58:59.637835 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-e5ee841b-71ae-4eaf-9785-84466ee818ac None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:58:59.639102 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-e5ee841b-71ae-4eaf-9785-84466ee818ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:58:59.647092 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 612/1203] 127.0.0.1 () {58 vars in 998 bytes} [Fri Oct 14 12:58:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:58:59.801495 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aadcbfa-8dbd-44c8-9f8f-6b8cbd628d80 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:58:59.816661 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aadcbfa-8dbd-44c8-9f8f-6b8cbd628d80 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:58:59.823085 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1eaa72-7bb9-4617-b943-a572db6a0ef9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '931f4e32c8764514b5efed31b0785be7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:58:59.823691 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1eaa72-7bb9-4617-b943-a572db6a0ef9 service nova] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:58:59.823972 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1eaa72-7bb9-4617-b943-a572db6a0ef9 service nova] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:58:59.824245 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1eaa72-7bb9-4617-b943-a572db6a0ef9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:58:59.833061 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1eaa72-7bb9-4617-b943-a572db6a0ef9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:58:59.835807 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1eaa72-7bb9-4617-b943-a572db6a0ef9 service nova] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:58:59.845842 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 592/1204] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 12:58:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 12:59:03.978823 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19de86a3-7179-4f3d-91b8-a8ad1bad98f1 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:03.979407 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19de86a3-7179-4f3d-91b8-a8ad1bad98f1 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:03.979407 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19de86a3-7179-4f3d-91b8-a8ad1bad98f1 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:03.980766 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 613/1205] 127.0.0.1 () {54 vars in 917 bytes} [Fri Oct 14 12:59:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:59:03.986839 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8d605b-b15e-42f1-a366-20b2093c9c87 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:03.987406 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8d605b-b15e-42f1-a366-20b2093c9c87 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:03.987406 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8d605b-b15e-42f1-a366-20b2093c9c87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:04.008510 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-cb8d605b-b15e-42f1-a366-20b2093c9c87 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:59:04.009728 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-cb8d605b-b15e-42f1-a366-20b2093c9c87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:59:04.017757 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 593/1206] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Oct 14 12:59:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:59:04.319152 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19de86a3-7179-4f3d-91b8-a8ad1bad98f1 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:59:04.320926 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-19de86a3-7179-4f3d-91b8-a8ad1bad98f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:59:04.404501 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19de86a3-7179-4f3d-91b8-a8ad1bad98f1 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:59:04.408145 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4efdd2-d11a-4a10-a67e-058fc7a07c0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d483292f3a4794848fcacfba5b107e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:59:04.408754 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4efdd2-d11a-4a10-a67e-058fc7a07c0f service neutron] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:04.409036 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4efdd2-d11a-4a10-a67e-058fc7a07c0f service neutron] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:04.409309 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4efdd2-d11a-4a10-a67e-058fc7a07c0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:04.420065 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4efdd2-d11a-4a10-a67e-058fc7a07c0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:59:04.421532 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4efdd2-d11a-4a10-a67e-058fc7a07c0f service neutron] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:59:04.432284 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 614/1207] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 12:59:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 12:59:06.670924 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c228d718-de79-4fe3-8396-bec2e3ac10c4 None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:06.671512 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c228d718-de79-4fe3-8396-bec2e3ac10c4 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:06.671512 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c228d718-de79-4fe3-8396-bec2e3ac10c4 None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:06.672822 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 594/1208] 127.0.0.1 () {54 vars in 917 bytes} [Fri Oct 14 12:59:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:59:06.679056 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dee949-29ab-45ce-ac4d-7f62aec7a5b7 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:06.679860 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dee949-29ab-45ce-ac4d-7f62aec7a5b7 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:06.679860 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dee949-29ab-45ce-ac4d-7f62aec7a5b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:06.699598 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-a5dee949-29ab-45ce-ac4d-7f62aec7a5b7 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:59:06.700818 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-a5dee949-29ab-45ce-ac4d-7f62aec7a5b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:59:06.709270 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 615/1209] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Oct 14 12:59:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 12:59:07.008075 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c228d718-de79-4fe3-8396-bec2e3ac10c4 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:59:07.018886 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c228d718-de79-4fe3-8396-bec2e3ac10c4 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:59:07.023645 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2539ba-2033-4f35-aa5c-1e7a6cb4dd94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d483292f3a4794848fcacfba5b107e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:59:07.024250 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2539ba-2033-4f35-aa5c-1e7a6cb4dd94 service neutron] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:07.024528 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2539ba-2033-4f35-aa5c-1e7a6cb4dd94 service neutron] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:07.024799 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2539ba-2033-4f35-aa5c-1e7a6cb4dd94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:07.037327 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2539ba-2033-4f35-aa5c-1e7a6cb4dd94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:59:07.038919 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2539ba-2033-4f35-aa5c-1e7a6cb4dd94 service neutron] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:59:07.049397 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 595/1210] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 12:59:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 12:59:10.997874 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91503745-c356-4a95-a571-ac9913a44268 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:10.998478 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91503745-c356-4a95-a571-ac9913a44268 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:10.998478 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91503745-c356-4a95-a571-ac9913a44268 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:10.999812 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 616/1211] 127.0.0.1 () {54 vars in 917 bytes} [Fri Oct 14 12:59:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:59:11.005277 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fda5a0-a00d-430c-866c-aa1629e8337f None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:11.005821 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fda5a0-a00d-430c-866c-aa1629e8337f None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:11.005929 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fda5a0-a00d-430c-866c-aa1629e8337f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:11.014446 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=81 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:59:11.028406 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-f4fda5a0-a00d-430c-866c-aa1629e8337f None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:59:11.029656 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-f4fda5a0-a00d-430c-866c-aa1629e8337f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:59:11.038486 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 596/1212] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Oct 14 12:59:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:59:11.345698 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91503745-c356-4a95-a571-ac9913a44268 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:59:11.347525 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-91503745-c356-4a95-a571-ac9913a44268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:59:11.418508 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:59:11.433885 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91503745-c356-4a95-a571-ac9913a44268 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:59:11.437791 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c338d52f-93f9-4e7f-a323-1637c32fdd36 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c3c564b8c548e4beef1cbfba2ad343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:59:11.438423 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c338d52f-93f9-4e7f-a323-1637c32fdd36 service cinder] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:11.438699 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c338d52f-93f9-4e7f-a323-1637c32fdd36 service cinder] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:11.438992 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c338d52f-93f9-4e7f-a323-1637c32fdd36 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:11.448575 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c338d52f-93f9-4e7f-a323-1637c32fdd36 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:59:11.450054 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c338d52f-93f9-4e7f-a323-1637c32fdd36 service cinder] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:59:11.460464 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 617/1213] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 12:59:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 12:59:13.699373 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eac0ac-de3c-498b-85d7-617c1dc1b888 None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:13.699936 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eac0ac-de3c-498b-85d7-617c1dc1b888 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:13.699936 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eac0ac-de3c-498b-85d7-617c1dc1b888 None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:13.701259 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 597/1214] 127.0.0.1 () {54 vars in 917 bytes} [Fri Oct 14 12:59:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 12:59:13.706712 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7643af16-6dff-4d8f-8c3d-5347e883660a None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:13.707227 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7643af16-6dff-4d8f-8c3d-5347e883660a None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:13.707389 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7643af16-6dff-4d8f-8c3d-5347e883660a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:13.730036 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-7643af16-6dff-4d8f-8c3d-5347e883660a None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 12:59:13.731302 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-7643af16-6dff-4d8f-8c3d-5347e883660a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:59:13.740539 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 618/1215] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Oct 14 12:59:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 12:59:14.044056 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eac0ac-de3c-498b-85d7-617c1dc1b888 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 12:59:14.045718 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-06eac0ac-de3c-498b-85d7-617c1dc1b888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 12:59:14.061945 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eac0ac-de3c-498b-85d7-617c1dc1b888 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 12:59:14.065536 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315e5a36-a486-451e-b86e-d21fe2698f32 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c3c564b8c548e4beef1cbfba2ad343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 12:59:14.066152 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315e5a36-a486-451e-b86e-d21fe2698f32 service cinder] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 12:59:14.066433 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315e5a36-a486-451e-b86e-d21fe2698f32 service cinder] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 12:59:14.066699 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315e5a36-a486-451e-b86e-d21fe2698f32 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 12:59:14.076611 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315e5a36-a486-451e-b86e-d21fe2698f32 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 12:59:14.078024 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315e5a36-a486-451e-b86e-d21fe2698f32 service cinder] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 12:59:14.088205 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 598/1216] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 12:59:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 12:59:23.724783 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=11 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:59:24.083368 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=8 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:00:48.788048 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18baae11-49a1-44fd-a6a8-b4c9ed4b6080 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:48.788718 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18baae11-49a1-44fd-a6a8-b4c9ed4b6080 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:48.788718 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18baae11-49a1-44fd-a6a8-b4c9ed4b6080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:48.815167 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-18baae11-49a1-44fd-a6a8-b4c9ed4b6080 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:00:48.816405 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-18baae11-49a1-44fd-a6a8-b4c9ed4b6080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:48.830158 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 619/1217] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:00:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:00:48.840502 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37d28e3-fec8-4ad6-972f-ff6d34089274 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:48.841069 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37d28e3-fec8-4ad6-972f-ff6d34089274 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:48.841069 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37d28e3-fec8-4ad6-972f-ff6d34089274 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:48.871451 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-d37d28e3-fec8-4ad6-972f-ff6d34089274 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:00:48.872753 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-d37d28e3-fec8-4ad6-972f-ff6d34089274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:48.886681 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 599/1218] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:00:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:00:48.891441 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18baae11-49a1-44fd-a6a8-b4c9ed4b6080 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:48.908733 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18baae11-49a1-44fd-a6a8-b4c9ed4b6080 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:48.919094 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5876c04-c09a-49c9-9abd-75beff66a267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:48.920035 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5876c04-c09a-49c9-9abd-75beff66a267 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:48.920498 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5876c04-c09a-49c9-9abd-75beff66a267 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:48.920942 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5876c04-c09a-49c9-9abd-75beff66a267 admin admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:48.921958 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5876c04-c09a-49c9-9abd-75beff66a267 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 13:00:48.922791 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5876c04-c09a-49c9-9abd-75beff66a267 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:48.924668 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5876c04-c09a-49c9-9abd-75beff66a267 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:48.940092 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 620/1219] 10.222.0.17 () {58 vars in 1153 bytes} [Fri Oct 14 13:00:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 13:00:48.948805 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37d28e3-fec8-4ad6-972f-ff6d34089274 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:48.962529 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37d28e3-fec8-4ad6-972f-ff6d34089274 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:48.972865 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c9cdd1-a6ed-45ef-9b3c-f0c43b9adec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:48.973516 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c9cdd1-a6ed-45ef-9b3c-f0c43b9adec6 admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:48.973804 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c9cdd1-a6ed-45ef-9b3c-f0c43b9adec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:48.974084 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c9cdd1-a6ed-45ef-9b3c-f0c43b9adec6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:48.974801 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c9cdd1-a6ed-45ef-9b3c-f0c43b9adec6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:48.977119 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c9cdd1-a6ed-45ef-9b3c-f0c43b9adec6 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:49.038462 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 600/1220] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Oct 14 13:00:48 2022] POST /identity/v3/projects => generated 367 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:00:49.043131 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5876c04-c09a-49c9-9abd-75beff66a267 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:49.056550 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5876c04-c09a-49c9-9abd-75beff66a267 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:49.146822 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856dd54e-68b0-4040-bc1f-4974054c61c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:49.147459 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856dd54e-68b0-4040-bc1f-4974054c61c6 admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:49.147740 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856dd54e-68b0-4040-bc1f-4974054c61c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:49.148016 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856dd54e-68b0-4040-bc1f-4974054c61c6 admin admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:49.148693 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856dd54e-68b0-4040-bc1f-4974054c61c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:49.150720 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856dd54e-68b0-4040-bc1f-4974054c61c6 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:49.185104 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 621/1221] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Oct 14 13:00:49 2022] POST /identity/v3/users => generated 284 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:00:49.185446 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28605fb1-1ffc-4f20-a4a5-63c81e236de8 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:49.185783 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28605fb1-1ffc-4f20-a4a5-63c81e236de8 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:49.186156 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28605fb1-1ffc-4f20-a4a5-63c81e236de8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:49.189229 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856dd54e-68b0-4040-bc1f-4974054c61c6 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:49.200237 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856dd54e-68b0-4040-bc1f-4974054c61c6 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:49.214962 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0f3e73-d6d4-4b06-a7f8-f77aa9fdaf05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:49.215600 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0f3e73-d6d4-4b06-a7f8-f77aa9fdaf05 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:49.215886 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0f3e73-d6d4-4b06-a7f8-f77aa9fdaf05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:49.216166 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0f3e73-d6d4-4b06-a7f8-f77aa9fdaf05 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:49.216977 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0f3e73-d6d4-4b06-a7f8-f77aa9fdaf05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:49.218715 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0f3e73-d6d4-4b06-a7f8-f77aa9fdaf05 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:49.230896 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 622/1222] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:00:49 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 14 13:00:49.231951 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-28605fb1-1ffc-4f20-a4a5-63c81e236de8 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:00:49.233530 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-28605fb1-1ffc-4f20-a4a5-63c81e236de8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:49.235085 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef13030-529b-45cf-a3a5-b184b5a299d8 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:49.235576 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef13030-529b-45cf-a3a5-b184b5a299d8 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:49.235865 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef13030-529b-45cf-a3a5-b184b5a299d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:49.251915 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 601/1223] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:00:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 13:00:49.252617 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28605fb1-1ffc-4f20-a4a5-63c81e236de8 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:49.264388 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28605fb1-1ffc-4f20-a4a5-63c81e236de8 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:49.271242 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-4ef13030-529b-45cf-a3a5-b184b5a299d8 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:00:49.272504 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-4ef13030-529b-45cf-a3a5-b184b5a299d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:49.277712 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62385d0e-fe48-4f0d-90f6-e614299c7382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:49.278432 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62385d0e-fe48-4f0d-90f6-e614299c7382 admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:49.278764 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62385d0e-fe48-4f0d-90f6-e614299c7382 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:49.279045 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62385d0e-fe48-4f0d-90f6-e614299c7382 admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:49.279704 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62385d0e-fe48-4f0d-90f6-e614299c7382 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:49.281654 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62385d0e-fe48-4f0d-90f6-e614299c7382 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:49.299577 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 602/1224] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:00:49 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:00:49.300896 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 623/1225] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:00:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:00:49.301034 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b91afa-cf50-4883-962f-a6ef460e9ab5 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:49.301212 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b91afa-cf50-4883-962f-a6ef460e9ab5 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:49.301494 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b91afa-cf50-4883-962f-a6ef460e9ab5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:49.303261 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3314add-dccd-4f06-9a62-c14b624fccf7 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:49.303776 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3314add-dccd-4f06-9a62-c14b624fccf7 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:49.304251 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3314add-dccd-4f06-9a62-c14b624fccf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:49.338701 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-98b91afa-cf50-4883-962f-a6ef460e9ab5 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:00:49.338701 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-98b91afa-cf50-4883-962f-a6ef460e9ab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:49.345481 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-a3314add-dccd-4f06-9a62-c14b624fccf7 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:00:49.347327 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-a3314add-dccd-4f06-9a62-c14b624fccf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:49.355152 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 603/1226] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:00:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:00:49.356694 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b91afa-cf50-4883-962f-a6ef460e9ab5 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:49.367687 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 624/1227] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:00:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:00:49.369263 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac865b68-261f-45bf-b7da-46ac3168860a None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:49.369775 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac865b68-261f-45bf-b7da-46ac3168860a None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:49.370606 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac865b68-261f-45bf-b7da-46ac3168860a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:49.378373 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b91afa-cf50-4883-962f-a6ef460e9ab5 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:49.389590 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6beccc06-770a-4055-aac3-7ce4c1ecc05a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:49.390289 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beccc06-770a-4055-aac3-7ce4c1ecc05a admin admin] REQUEST_METHOD: `PUT` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:49.390573 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beccc06-770a-4055-aac3-7ce4c1ecc05a admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:49.390925 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beccc06-770a-4055-aac3-7ce4c1ecc05a admin admin] PATH_INFO: `/v3/projects/4ccbceb7ff4d4c1dbc1f514286a15640/users/50d96957c6794ac1bbc86765295a03eb/roles/5e8849303a75425b9eaa2681cc031af1` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:49.404312 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-ac865b68-261f-45bf-b7da-46ac3168860a None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:00:49.405535 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-ac865b68-261f-45bf-b7da-46ac3168860a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:49.407918 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6beccc06-770a-4055-aac3-7ce4c1ecc05a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ccbceb7ff4d4c1dbc1f514286a15640, user_id=50d96957c6794ac1bbc86765295a03eb, role_id=5e8849303a75425b9eaa2681cc031af1)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:49.410996 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6beccc06-770a-4055-aac3-7ce4c1ecc05a admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:49.414550 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 625/1228] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:00:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:00:49.415942 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a09f14-abd9-4bcf-aba9-cbf0dfc7d4c3 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:49.416235 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a09f14-abd9-4bcf-aba9-cbf0dfc7d4c3 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:49.416518 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a09f14-abd9-4bcf-aba9-cbf0dfc7d4c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:49.429358 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 604/1229] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Oct 14 13:00:49 2022] PUT /identity/v3/projects/4ccbceb7ff4d4c1dbc1f514286a15640/users/50d96957c6794ac1bbc86765295a03eb/roles/5e8849303a75425b9eaa2681cc031af1 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:00:49.430480 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6beccc06-770a-4055-aac3-7ce4c1ecc05a admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:49.446079 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-e1a09f14-abd9-4bcf-aba9-cbf0dfc7d4c3 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:00:49.447339 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-e1a09f14-abd9-4bcf-aba9-cbf0dfc7d4c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:49.512044 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 626/1230] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:00:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:00:49.512284 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6beccc06-770a-4055-aac3-7ce4c1ecc05a admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:49.513292 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbbc46a-59c0-4400-82ce-59a3edffd050 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:49.513582 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbbc46a-59c0-4400-82ce-59a3edffd050 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:49.513858 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbbc46a-59c0-4400-82ce-59a3edffd050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:49.521126 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01902569-e09f-4971-ac07-1af564f6a772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:49.521843 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01902569-e09f-4971-ac07-1af564f6a772 admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:49.522139 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01902569-e09f-4971-ac07-1af564f6a772 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:49.522433 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01902569-e09f-4971-ac07-1af564f6a772 admin admin] PATH_INFO: `/v3/domains` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:49.523092 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01902569-e09f-4971-ac07-1af564f6a772 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 13:00:49.523405 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01902569-e09f-4971-ac07-1af564f6a772 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:49.524442 dv-cinder-820994-7-smb devstack@keystone.service[81439]: WARNING py.warnings [None req-01902569-e09f-4971-ac07-1af564f6a772 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 14 13:00:49.524442 dv-cinder-820994-7-smb devstack@keystone.service[81439]: warnings.warn(msg) Oct 14 13:00:49.524442 dv-cinder-820994-7-smb devstack@keystone.service[81439]: Oct 14 13:00:49.525399 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01902569-e09f-4971-ac07-1af564f6a772 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:49.534828 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-9dbbc46a-59c0-4400-82ce-59a3edffd050 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:00:49.536044 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-9dbbc46a-59c0-4400-82ce-59a3edffd050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:49.537651 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 605/1231] 10.222.0.17 () {58 vars in 1153 bytes} [Fri Oct 14 13:00:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 13:00:49.538927 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62d60b8-4784-4e6a-bf41-a3c7eae988ea None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:49.539266 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62d60b8-4784-4e6a-bf41-a3c7eae988ea None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:49.539541 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62d60b8-4784-4e6a-bf41-a3c7eae988ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:49.553076 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 627/1232] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:00:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:00:49.553076 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbbc46a-59c0-4400-82ce-59a3edffd050 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:49.559676 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbbc46a-59c0-4400-82ce-59a3edffd050 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:49.560560 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-c62d60b8-4784-4e6a-bf41-a3c7eae988ea None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:00:49.561923 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-c62d60b8-4784-4e6a-bf41-a3c7eae988ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:49.565018 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db007f84-5c9a-4ad8-a0e0-f6deb6b8690a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:49.565659 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db007f84-5c9a-4ad8-a0e0-f6deb6b8690a admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:49.565941 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db007f84-5c9a-4ad8-a0e0-f6deb6b8690a admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:49.566246 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db007f84-5c9a-4ad8-a0e0-f6deb6b8690a admin admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:49.566916 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db007f84-5c9a-4ad8-a0e0-f6deb6b8690a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 13:00:49.567225 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db007f84-5c9a-4ad8-a0e0-f6deb6b8690a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:49.568841 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db007f84-5c9a-4ad8-a0e0-f6deb6b8690a admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:49.570658 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 606/1233] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:00:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:00:49.572038 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676a1830-3701-4506-b7c2-4ec2b770b2e0 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:49.572493 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676a1830-3701-4506-b7c2-4ec2b770b2e0 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:49.572941 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676a1830-3701-4506-b7c2-4ec2b770b2e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:49.581547 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 628/1234] 10.222.0.17 () {58 vars in 1153 bytes} [Fri Oct 14 13:00:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 13:00:49.582821 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d61da7-b05f-49de-a3b4-59fa4abb9164 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:49.583098 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d61da7-b05f-49de-a3b4-59fa4abb9164 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:49.583376 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d61da7-b05f-49de-a3b4-59fa4abb9164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:49.604400 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-67d61da7-b05f-49de-a3b4-59fa4abb9164 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:00:49.605612 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-67d61da7-b05f-49de-a3b4-59fa4abb9164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:49.609294 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-676a1830-3701-4506-b7c2-4ec2b770b2e0 None None] MFA Rules not processed for user `50d96957c6794ac1bbc86765295a03eb`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:00:49.610543 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-676a1830-3701-4506-b7c2-4ec2b770b2e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:49.613914 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 629/1235] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:00:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:00:49.615130 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e586db-48ca-4bff-b333-9ac3aaa02b1a None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:49.615417 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e586db-48ca-4bff-b333-9ac3aaa02b1a None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:49.615691 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e586db-48ca-4bff-b333-9ac3aaa02b1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:49.639456 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-e2e586db-48ca-4bff-b333-9ac3aaa02b1a None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:00:49.641244 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-e2e586db-48ca-4bff-b333-9ac3aaa02b1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:49.649681 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 630/1236] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:00:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:00:49.650767 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c664dd64-fa16-4504-b99f-e53f35c4dc14 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:49.651058 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c664dd64-fa16-4504-b99f-e53f35c4dc14 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:49.651337 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c664dd64-fa16-4504-b99f-e53f35c4dc14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:49.664613 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:00:49.667061 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:00:49.673706 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-c664dd64-fa16-4504-b99f-e53f35c4dc14 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:00:49.675945 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-c664dd64-fa16-4504-b99f-e53f35c4dc14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:49.684030 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 631/1237] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:00:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:00:49.684875 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c664dd64-fa16-4504-b99f-e53f35c4dc14 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:49.685136 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 607/1238] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:00:49 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:00:49.685984 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676a1830-3701-4506-b7c2-4ec2b770b2e0 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:49.697911 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676a1830-3701-4506-b7c2-4ec2b770b2e0 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:49.699515 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c664dd64-fa16-4504-b99f-e53f35c4dc14 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:49.702729 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c45ecd-d142-4b67-bf87-55b1f7042050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:49.704004 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c45ecd-d142-4b67-bf87-55b1f7042050 admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:49.704284 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c45ecd-d142-4b67-bf87-55b1f7042050 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:49.704560 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c45ecd-d142-4b67-bf87-55b1f7042050 admin admin] PATH_INFO: `/v3/domains` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:49.705054 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe4f691-63f0-4fab-823f-1efebcccf773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:49.705202 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c45ecd-d142-4b67-bf87-55b1f7042050 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 13:00:49.705506 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c45ecd-d142-4b67-bf87-55b1f7042050 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:49.705656 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe4f691-63f0-4fab-823f-1efebcccf773 admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:49.705945 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe4f691-63f0-4fab-823f-1efebcccf773 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:49.706259 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe4f691-63f0-4fab-823f-1efebcccf773 admin admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:49.706890 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe4f691-63f0-4fab-823f-1efebcccf773 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:49.707151 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c45ecd-d142-4b67-bf87-55b1f7042050 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:49.707907 dv-cinder-820994-7-smb devstack@keystone.service[81438]: WARNING py.warnings [None req-afe4f691-63f0-4fab-823f-1efebcccf773 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 14 13:00:49.707907 dv-cinder-820994-7-smb devstack@keystone.service[81438]: warnings.warn(msg) Oct 14 13:00:49.707907 dv-cinder-820994-7-smb devstack@keystone.service[81438]: Oct 14 13:00:49.709094 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe4f691-63f0-4fab-823f-1efebcccf773 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:49.726578 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 608/1239] 10.222.0.17 () {58 vars in 1153 bytes} [Fri Oct 14 13:00:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 13:00:49.726578 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72e9739-5f49-4000-a4ab-9230f60e80ce None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:49.726578 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72e9739-5f49-4000-a4ab-9230f60e80ce None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:49.726578 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72e9739-5f49-4000-a4ab-9230f60e80ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:49.737308 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 632/1240] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Oct 14 13:00:49 2022] POST /identity/v3/projects => generated 371 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:00:49.738225 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe4f691-63f0-4fab-823f-1efebcccf773 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:49.742147 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-b72e9739-5f49-4000-a4ab-9230f60e80ce None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:00:49.743474 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-b72e9739-5f49-4000-a4ab-9230f60e80ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:49.800625 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe4f691-63f0-4fab-823f-1efebcccf773 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:49.803859 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 609/1241] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:00:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:00:49.805193 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ddcbe6-6992-45c2-9a67-5c21fb2f3f33 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:49.805462 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ddcbe6-6992-45c2-9a67-5c21fb2f3f33 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:49.805741 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde044d7-bd68-4024-bc43-c586474c181f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:49.805881 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ddcbe6-6992-45c2-9a67-5c21fb2f3f33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:49.806384 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde044d7-bd68-4024-bc43-c586474c181f admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:49.806662 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde044d7-bd68-4024-bc43-c586474c181f admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:49.806984 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde044d7-bd68-4024-bc43-c586474c181f admin admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:49.807643 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde044d7-bd68-4024-bc43-c586474c181f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:49.809552 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde044d7-bd68-4024-bc43-c586474c181f admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:49.826784 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-85ddcbe6-6992-45c2-9a67-5c21fb2f3f33 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:00:49.828045 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-85ddcbe6-6992-45c2-9a67-5c21fb2f3f33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:49.836206 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 610/1242] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:00:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:00:49.840181 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 633/1243] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Oct 14 13:00:49 2022] POST /identity/v3/projects => generated 405 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:00:49.840327 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6493e6-c754-4d35-b996-b47961338b2e None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:49.840422 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde044d7-bd68-4024-bc43-c586474c181f admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:49.840550 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6493e6-c754-4d35-b996-b47961338b2e None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:49.840550 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6493e6-c754-4d35-b996-b47961338b2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:49.857617 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-6f6493e6-c754-4d35-b996-b47961338b2e None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:00:49.858831 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-6f6493e6-c754-4d35-b996-b47961338b2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:49.904675 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde044d7-bd68-4024-bc43-c586474c181f admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:49.909602 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85622620-cc51-4fd3-806f-eaeae567516a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:49.910244 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85622620-cc51-4fd3-806f-eaeae567516a admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:49.910523 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85622620-cc51-4fd3-806f-eaeae567516a admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:49.910804 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85622620-cc51-4fd3-806f-eaeae567516a admin admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:49.911652 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85622620-cc51-4fd3-806f-eaeae567516a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 13:00:49.911913 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85622620-cc51-4fd3-806f-eaeae567516a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:49.913519 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85622620-cc51-4fd3-806f-eaeae567516a admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:49.919039 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 611/1244] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:00:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:00:49.919801 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6493e6-c754-4d35-b996-b47961338b2e None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:49.935414 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 634/1245] 10.222.0.17 () {58 vars in 1153 bytes} [Fri Oct 14 13:00:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 13:00:49.935414 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85622620-cc51-4fd3-806f-eaeae567516a admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:49.938807 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85622620-cc51-4fd3-806f-eaeae567516a admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:49.943590 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7805169c-c626-4f80-ab0a-1e08c521d0be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:49.944182 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7805169c-c626-4f80-ab0a-1e08c521d0be admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:49.944464 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7805169c-c626-4f80-ab0a-1e08c521d0be admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:49.944743 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7805169c-c626-4f80-ab0a-1e08c521d0be admin admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:49.945367 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7805169c-c626-4f80-ab0a-1e08c521d0be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:49.947300 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7805169c-c626-4f80-ab0a-1e08c521d0be admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:49.977348 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 635/1246] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Oct 14 13:00:49 2022] POST /identity/v3/projects => generated 383 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:00:49.978235 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7805169c-c626-4f80-ab0a-1e08c521d0be admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:49.983354 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6493e6-c754-4d35-b996-b47961338b2e None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:50.009126 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:00:50.020637 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:00:50.033954 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ede170c-5e96-4d2d-9547-2c96730b551b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c3c564b8c548e4beef1cbfba2ad343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:50.034602 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ede170c-5e96-4d2d-9547-2c96730b551b service cinder] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:50.034884 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ede170c-5e96-4d2d-9547-2c96730b551b service cinder] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:50.035161 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ede170c-5e96-4d2d-9547-2c96730b551b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:50.047968 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7805169c-c626-4f80-ab0a-1e08c521d0be admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:50.053291 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53e2446-5459-4a16-a427-58f6cc682ee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:50.054027 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53e2446-5459-4a16-a427-58f6cc682ee8 admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:50.054738 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53e2446-5459-4a16-a427-58f6cc682ee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:50.055088 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53e2446-5459-4a16-a427-58f6cc682ee8 admin admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:50.055811 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53e2446-5459-4a16-a427-58f6cc682ee8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:50.057761 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53e2446-5459-4a16-a427-58f6cc682ee8 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:50.080024 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 636/1247] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Oct 14 13:00:49 2022] POST /identity/v3/users => generated 286 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:00:50.080839 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53e2446-5459-4a16-a427-58f6cc682ee8 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:50.092308 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53e2446-5459-4a16-a427-58f6cc682ee8 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:50.097267 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b390a1-27cd-4b26-a62f-d4174287f4ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:50.097877 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b390a1-27cd-4b26-a62f-d4174287f4ef admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:50.098183 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b390a1-27cd-4b26-a62f-d4174287f4ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:50.098475 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b390a1-27cd-4b26-a62f-d4174287f4ef admin admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:50.099107 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b390a1-27cd-4b26-a62f-d4174287f4ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 13:00:50.099407 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b390a1-27cd-4b26-a62f-d4174287f4ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:50.099807 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ede170c-5e96-4d2d-9547-2c96730b551b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:50.101268 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b390a1-27cd-4b26-a62f-d4174287f4ef admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:50.101535 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ede170c-5e96-4d2d-9547-2c96730b551b service cinder] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:50.111799 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 612/1248] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:00:49 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:00:50.112595 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ede170c-5e96-4d2d-9547-2c96730b551b service cinder] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:50.121367 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 637/1249] 10.222.0.17 () {58 vars in 1153 bytes} [Fri Oct 14 13:00:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 13:00:50.122364 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b390a1-27cd-4b26-a62f-d4174287f4ef admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:50.122960 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ede170c-5e96-4d2d-9547-2c96730b551b service cinder] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:50.128471 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316e6b7c-50b3-46a1-9abd-c458ab9fd266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:50.129065 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316e6b7c-50b3-46a1-9abd-c458ab9fd266 admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:50.129661 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316e6b7c-50b3-46a1-9abd-c458ab9fd266 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:50.129798 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316e6b7c-50b3-46a1-9abd-c458ab9fd266 admin admin] PATH_INFO: `/v3/users` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:50.130384 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316e6b7c-50b3-46a1-9abd-c458ab9fd266 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:50.131403 dv-cinder-820994-7-smb devstack@keystone.service[81439]: WARNING py.warnings [None req-316e6b7c-50b3-46a1-9abd-c458ab9fd266 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 14 13:00:50.131403 dv-cinder-820994-7-smb devstack@keystone.service[81439]: warnings.warn(msg) Oct 14 13:00:50.131403 dv-cinder-820994-7-smb devstack@keystone.service[81439]: Oct 14 13:00:50.132605 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316e6b7c-50b3-46a1-9abd-c458ab9fd266 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:50.132959 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b390a1-27cd-4b26-a62f-d4174287f4ef admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:50.137904 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b4d702-eaef-4a47-b6db-861d3ac87d42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:50.138501 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b4d702-eaef-4a47-b6db-861d3ac87d42 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:50.138779 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b4d702-eaef-4a47-b6db-861d3ac87d42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:50.139067 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b4d702-eaef-4a47-b6db-861d3ac87d42 admin admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:50.139709 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b4d702-eaef-4a47-b6db-861d3ac87d42 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 13:00:50.140008 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b4d702-eaef-4a47-b6db-861d3ac87d42 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:50.142197 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b4d702-eaef-4a47-b6db-861d3ac87d42 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:50.155444 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 638/1250] 10.222.0.17 () {58 vars in 1153 bytes} [Fri Oct 14 13:00:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 13:00:50.156503 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b4d702-eaef-4a47-b6db-861d3ac87d42 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:50.159129 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 613/1251] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Oct 14 13:00:50 2022] POST /identity/v3/users => generated 303 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:00:50.160009 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316e6b7c-50b3-46a1-9abd-c458ab9fd266 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:50.174506 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316e6b7c-50b3-46a1-9abd-c458ab9fd266 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:50.174873 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b4d702-eaef-4a47-b6db-861d3ac87d42 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:50.179125 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2019de19-9d32-46a3-bfef-5f7a733e3d0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:50.179740 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2019de19-9d32-46a3-bfef-5f7a733e3d0f admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:50.179950 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f407d50f-f78e-4d22-b342-ec50e418c199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:50.180082 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2019de19-9d32-46a3-bfef-5f7a733e3d0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:50.180244 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2019de19-9d32-46a3-bfef-5f7a733e3d0f admin admin] PATH_INFO: `/v3/projects` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:50.180818 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f407d50f-f78e-4d22-b342-ec50e418c199 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:50.180931 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2019de19-9d32-46a3-bfef-5f7a733e3d0f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:50.181274 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f407d50f-f78e-4d22-b342-ec50e418c199 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:50.181637 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f407d50f-f78e-4d22-b342-ec50e418c199 admin admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:50.182406 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f407d50f-f78e-4d22-b342-ec50e418c199 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 13:00:50.182797 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2019de19-9d32-46a3-bfef-5f7a733e3d0f admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:50.182929 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f407d50f-f78e-4d22-b342-ec50e418c199 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:50.184687 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f407d50f-f78e-4d22-b342-ec50e418c199 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:50.198596 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 639/1252] 10.222.0.17 () {58 vars in 1153 bytes} [Fri Oct 14 13:00:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 13:00:50.199272 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f407d50f-f78e-4d22-b342-ec50e418c199 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:50.209501 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f407d50f-f78e-4d22-b342-ec50e418c199 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:50.214472 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724a285c-33a1-44a4-afbe-921311484985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:50.215076 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724a285c-33a1-44a4-afbe-921311484985 admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:50.215355 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724a285c-33a1-44a4-afbe-921311484985 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:50.215630 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724a285c-33a1-44a4-afbe-921311484985 admin admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:50.216256 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724a285c-33a1-44a4-afbe-921311484985 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:50.218469 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724a285c-33a1-44a4-afbe-921311484985 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:50.223843 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 614/1253] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Oct 14 13:00:50 2022] POST /identity/v3/projects => generated 389 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:00:50.225203 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2019de19-9d32-46a3-bfef-5f7a733e3d0f admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:50.241826 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 640/1254] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Oct 14 13:00:50 2022] POST /identity/v3/users => generated 292 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:00:50.242657 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724a285c-33a1-44a4-afbe-921311484985 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:50.252730 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724a285c-33a1-44a4-afbe-921311484985 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:50.297450 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2019de19-9d32-46a3-bfef-5f7a733e3d0f admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:50.303806 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8045813-4a13-44ec-95eb-ae43cd98b51d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:50.304848 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8045813-4a13-44ec-95eb-ae43cd98b51d admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:50.305066 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8045813-4a13-44ec-95eb-ae43cd98b51d admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:50.305374 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8045813-4a13-44ec-95eb-ae43cd98b51d admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:50.306051 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8045813-4a13-44ec-95eb-ae43cd98b51d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:50.309218 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8045813-4a13-44ec-95eb-ae43cd98b51d admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:50.320075 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 615/1255] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:00:50 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:00:50.320877 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8045813-4a13-44ec-95eb-ae43cd98b51d admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:50.331006 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8045813-4a13-44ec-95eb-ae43cd98b51d admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:50.331143 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b29f35-3235-44a0-94b0-9144df6f88ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:50.331683 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b29f35-3235-44a0-94b0-9144df6f88ed admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:50.331966 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b29f35-3235-44a0-94b0-9144df6f88ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:50.332239 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b29f35-3235-44a0-94b0-9144df6f88ed admin admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:50.332879 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b29f35-3235-44a0-94b0-9144df6f88ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:50.334862 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b29f35-3235-44a0-94b0-9144df6f88ed admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:50.337869 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73ad8c6-5d66-42f2-81ac-7dfdce2a8ddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:50.338795 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73ad8c6-5d66-42f2-81ac-7dfdce2a8ddf admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:50.339419 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73ad8c6-5d66-42f2-81ac-7dfdce2a8ddf admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:50.339896 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73ad8c6-5d66-42f2-81ac-7dfdce2a8ddf admin admin] PATH_INFO: `/v3/projects` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:50.340837 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73ad8c6-5d66-42f2-81ac-7dfdce2a8ddf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:50.343154 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73ad8c6-5d66-42f2-81ac-7dfdce2a8ddf admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:50.366586 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 641/1256] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Oct 14 13:00:50 2022] POST /identity/v3/projects => generated 379 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:00:50.367666 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b29f35-3235-44a0-94b0-9144df6f88ed admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:50.386895 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 616/1257] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Oct 14 13:00:50 2022] POST /identity/v3/projects => generated 371 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:00:50.387922 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73ad8c6-5d66-42f2-81ac-7dfdce2a8ddf admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:50.414006 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:00:50.433475 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:00:50.449538 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b29f35-3235-44a0-94b0-9144df6f88ed admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:50.464859 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73ad8c6-5d66-42f2-81ac-7dfdce2a8ddf admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:50.470414 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723549c0-24a9-4bce-9ca4-7cc73a24bee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:50.471026 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723549c0-24a9-4bce-9ca4-7cc73a24bee6 admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:50.471311 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723549c0-24a9-4bce-9ca4-7cc73a24bee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:50.471595 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723549c0-24a9-4bce-9ca4-7cc73a24bee6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:50.472232 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723549c0-24a9-4bce-9ca4-7cc73a24bee6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:50.474165 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723549c0-24a9-4bce-9ca4-7cc73a24bee6 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:50.505851 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 617/1258] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Oct 14 13:00:50 2022] POST /identity/v3/projects => generated 389 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:00:50.506714 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723549c0-24a9-4bce-9ca4-7cc73a24bee6 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:50.514174 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7ce08f-4cdb-43af-9eb5-736cf00098ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:50.514986 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7ce08f-4cdb-43af-9eb5-736cf00098ae admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:50.515342 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7ce08f-4cdb-43af-9eb5-736cf00098ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:50.516366 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7ce08f-4cdb-43af-9eb5-736cf00098ae admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:50.517319 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7ce08f-4cdb-43af-9eb5-736cf00098ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:50.519267 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7ce08f-4cdb-43af-9eb5-736cf00098ae admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:50.530721 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 642/1259] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:00:50 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:00:50.532723 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7ce08f-4cdb-43af-9eb5-736cf00098ae admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:50.545951 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7ce08f-4cdb-43af-9eb5-736cf00098ae admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:50.576701 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723549c0-24a9-4bce-9ca4-7cc73a24bee6 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:50.583481 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ecb6ea-1909-4152-9868-6fd8eb5e0b9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:50.584100 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ecb6ea-1909-4152-9868-6fd8eb5e0b9b admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:50.584386 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ecb6ea-1909-4152-9868-6fd8eb5e0b9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:50.584640 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ecb6ea-1909-4152-9868-6fd8eb5e0b9b admin admin] PATH_INFO: `/v3/users` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:50.585273 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ecb6ea-1909-4152-9868-6fd8eb5e0b9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:50.587990 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ecb6ea-1909-4152-9868-6fd8eb5e0b9b admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:50.615318 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 618/1260] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Oct 14 13:00:50 2022] POST /identity/v3/users => generated 295 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:00:50.617104 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ecb6ea-1909-4152-9868-6fd8eb5e0b9b admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:50.622764 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff63d81-6bc6-46ef-b73f-1ebbc4966bb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:50.623387 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff63d81-6bc6-46ef-b73f-1ebbc4966bb8 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:50.623673 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff63d81-6bc6-46ef-b73f-1ebbc4966bb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:50.623951 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff63d81-6bc6-46ef-b73f-1ebbc4966bb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:50.624598 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff63d81-6bc6-46ef-b73f-1ebbc4966bb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:50.626487 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff63d81-6bc6-46ef-b73f-1ebbc4966bb8 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:50.627900 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ecb6ea-1909-4152-9868-6fd8eb5e0b9b admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:50.632883 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e79242-eb7c-48ae-8bd5-c7b3b380cd87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:50.633559 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e79242-eb7c-48ae-8bd5-c7b3b380cd87 admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:50.633919 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e79242-eb7c-48ae-8bd5-c7b3b380cd87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:50.634306 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e79242-eb7c-48ae-8bd5-c7b3b380cd87 admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:50.635142 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e79242-eb7c-48ae-8bd5-c7b3b380cd87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:50.636989 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e79242-eb7c-48ae-8bd5-c7b3b380cd87 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:50.647569 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 643/1261] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:00:50 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:00:50.648534 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff63d81-6bc6-46ef-b73f-1ebbc4966bb8 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:50.655987 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 619/1262] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:00:50 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:00:50.658222 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e79242-eb7c-48ae-8bd5-c7b3b380cd87 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:50.661974 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff63d81-6bc6-46ef-b73f-1ebbc4966bb8 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:50.669107 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e79242-eb7c-48ae-8bd5-c7b3b380cd87 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:50.669299 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c15bac-d21e-422b-a06b-ef24b71183c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:50.669772 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c15bac-d21e-422b-a06b-ef24b71183c8 admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:50.670823 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c15bac-d21e-422b-a06b-ef24b71183c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:50.671131 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c15bac-d21e-422b-a06b-ef24b71183c8 admin admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:50.671973 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c15bac-d21e-422b-a06b-ef24b71183c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:50.674626 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c15bac-d21e-422b-a06b-ef24b71183c8 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:50.675381 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41436887-986f-434f-9d22-8e7522b79553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:50.675984 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41436887-986f-434f-9d22-8e7522b79553 admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:50.676373 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41436887-986f-434f-9d22-8e7522b79553 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:50.676651 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41436887-986f-434f-9d22-8e7522b79553 admin admin] PATH_INFO: `/v3/users` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:50.677285 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41436887-986f-434f-9d22-8e7522b79553 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:50.679394 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41436887-986f-434f-9d22-8e7522b79553 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:50.707313 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 644/1263] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Oct 14 13:00:50 2022] POST /identity/v3/users => generated 290 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:00:50.707313 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c15bac-d21e-422b-a06b-ef24b71183c8 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:50.723586 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 620/1264] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Oct 14 13:00:50 2022] POST /identity/v3/users => generated 286 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:00:50.723875 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c15bac-d21e-422b-a06b-ef24b71183c8 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:50.724576 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41436887-986f-434f-9d22-8e7522b79553 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:50.731022 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851f9925-53ea-4ac3-9efb-25e362052206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:50.731751 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851f9925-53ea-4ac3-9efb-25e362052206 admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:50.732039 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851f9925-53ea-4ac3-9efb-25e362052206 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:50.732316 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851f9925-53ea-4ac3-9efb-25e362052206 admin admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:50.732944 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851f9925-53ea-4ac3-9efb-25e362052206 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:50.735080 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851f9925-53ea-4ac3-9efb-25e362052206 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:50.740839 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41436887-986f-434f-9d22-8e7522b79553 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:50.747277 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0e76af-27c2-4ebb-b2e0-dc671f2c8a15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:50.748035 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0e76af-27c2-4ebb-b2e0-dc671f2c8a15 admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:50.748317 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0e76af-27c2-4ebb-b2e0-dc671f2c8a15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:50.748840 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0e76af-27c2-4ebb-b2e0-dc671f2c8a15 admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:50.749312 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0e76af-27c2-4ebb-b2e0-dc671f2c8a15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:50.751251 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0e76af-27c2-4ebb-b2e0-dc671f2c8a15 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:50.759052 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 645/1265] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Oct 14 13:00:50 2022] POST /identity/v3/users => generated 295 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:00:50.759708 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851f9925-53ea-4ac3-9efb-25e362052206 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:50.768395 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 621/1266] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:00:50 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:00:50.769428 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0e76af-27c2-4ebb-b2e0-dc671f2c8a15 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:50.771497 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851f9925-53ea-4ac3-9efb-25e362052206 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:50.776554 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129098c0-49b0-48eb-938d-5f7433c4d388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:50.777162 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129098c0-49b0-48eb-938d-5f7433c4d388 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:50.777450 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129098c0-49b0-48eb-938d-5f7433c4d388 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:50.777749 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129098c0-49b0-48eb-938d-5f7433c4d388 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:50.778431 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129098c0-49b0-48eb-938d-5f7433c4d388 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:50.780000 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0e76af-27c2-4ebb-b2e0-dc671f2c8a15 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:50.780112 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129098c0-49b0-48eb-938d-5f7433c4d388 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:50.785855 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e308fc9-7489-44c4-831f-bb8fcd8e478c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:50.786525 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e308fc9-7489-44c4-831f-bb8fcd8e478c admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:50.786804 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e308fc9-7489-44c4-831f-bb8fcd8e478c admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:50.787074 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e308fc9-7489-44c4-831f-bb8fcd8e478c admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:50.788412 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e308fc9-7489-44c4-831f-bb8fcd8e478c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:50.790421 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e308fc9-7489-44c4-831f-bb8fcd8e478c admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:50.792647 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 646/1267] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:00:50 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:00:50.793252 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129098c0-49b0-48eb-938d-5f7433c4d388 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:50.803398 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129098c0-49b0-48eb-938d-5f7433c4d388 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:50.806299 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 622/1268] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:00:50 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:00:50.807253 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e308fc9-7489-44c4-831f-bb8fcd8e478c admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:50.811078 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e25157b-d947-460f-993a-2e8377de8d62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:50.811952 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e25157b-d947-460f-993a-2e8377de8d62 admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:50.812485 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e25157b-d947-460f-993a-2e8377de8d62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:50.813043 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e25157b-d947-460f-993a-2e8377de8d62 admin admin] PATH_INFO: `/v3/projects/4da3c87132b3437c8f900480e2f1af26/users/d3d7326b2e77497b94954638ca939fc1/roles/5e8849303a75425b9eaa2681cc031af1` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:50.819256 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e308fc9-7489-44c4-831f-bb8fcd8e478c admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:50.824229 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd7f37a-af1a-4db5-9b19-aa4dd5e3660b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:50.825917 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd7f37a-af1a-4db5-9b19-aa4dd5e3660b admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:50.826246 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd7f37a-af1a-4db5-9b19-aa4dd5e3660b admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:50.826516 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd7f37a-af1a-4db5-9b19-aa4dd5e3660b admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:50.827198 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd7f37a-af1a-4db5-9b19-aa4dd5e3660b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:50.829657 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd7f37a-af1a-4db5-9b19-aa4dd5e3660b admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:50.832079 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e25157b-d947-460f-993a-2e8377de8d62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4da3c87132b3437c8f900480e2f1af26, user_id=d3d7326b2e77497b94954638ca939fc1, role_id=5e8849303a75425b9eaa2681cc031af1)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:50.835138 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e25157b-d947-460f-993a-2e8377de8d62 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:50.842168 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 623/1269] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:00:50 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:00:50.842770 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd7f37a-af1a-4db5-9b19-aa4dd5e3660b admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:50.854773 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 647/1270] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Oct 14 13:00:50 2022] PUT /identity/v3/projects/4da3c87132b3437c8f900480e2f1af26/users/d3d7326b2e77497b94954638ca939fc1/roles/5e8849303a75425b9eaa2681cc031af1 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:00:50.855120 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd7f37a-af1a-4db5-9b19-aa4dd5e3660b admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:50.855614 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e25157b-d947-460f-993a-2e8377de8d62 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:50.882569 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:00:50.890083 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:00:50.922207 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e25157b-d947-460f-993a-2e8377de8d62 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:50.923001 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926f7120-b48d-4c98-a576-47632b67d378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:50.923626 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926f7120-b48d-4c98-a576-47632b67d378 admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:50.924024 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926f7120-b48d-4c98-a576-47632b67d378 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:50.924304 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926f7120-b48d-4c98-a576-47632b67d378 admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:50.925084 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926f7120-b48d-4c98-a576-47632b67d378 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:50.926718 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926f7120-b48d-4c98-a576-47632b67d378 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:50.926914 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fa7433-4c71-453f-9b16-3971418489d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:50.927523 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fa7433-4c71-453f-9b16-3971418489d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:50.927809 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fa7433-4c71-453f-9b16-3971418489d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:50.928074 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fa7433-4c71-453f-9b16-3971418489d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:50.928708 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fa7433-4c71-453f-9b16-3971418489d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:50.930324 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fa7433-4c71-453f-9b16-3971418489d7 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:50.936941 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 624/1271] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:00:50 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:00:50.938155 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926f7120-b48d-4c98-a576-47632b67d378 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:50.944302 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 648/1272] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:00:50 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:00:50.944302 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fa7433-4c71-453f-9b16-3971418489d7 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:50.948413 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926f7120-b48d-4c98-a576-47632b67d378 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:50.953968 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5cda37-6c51-4762-930b-0f65de056ada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:50.954241 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fa7433-4c71-453f-9b16-3971418489d7 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:50.954680 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5cda37-6c51-4762-930b-0f65de056ada admin admin] REQUEST_METHOD: `PUT` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:50.954950 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5cda37-6c51-4762-930b-0f65de056ada admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:50.955255 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5cda37-6c51-4762-930b-0f65de056ada admin admin] PATH_INFO: `/v3/projects/09fc956544ba4fe69dbc865e02f4f997/users/5e086d4caf514881986ffe12f74dc592/roles/5e8849303a75425b9eaa2681cc031af1` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:50.958874 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af33dc19-0763-4492-a157-a083c745addc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:50.959455 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af33dc19-0763-4492-a157-a083c745addc admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:50.959729 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af33dc19-0763-4492-a157-a083c745addc admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:50.960003 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af33dc19-0763-4492-a157-a083c745addc admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:50.960631 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af33dc19-0763-4492-a157-a083c745addc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:50.962235 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af33dc19-0763-4492-a157-a083c745addc admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:50.971682 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5cda37-6c51-4762-930b-0f65de056ada admin admin] RBAC: Authorizing `identity:create_grant(project_id=09fc956544ba4fe69dbc865e02f4f997, user_id=5e086d4caf514881986ffe12f74dc592, role_id=5e8849303a75425b9eaa2681cc031af1)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:50.972975 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 649/1273] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:00:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:00:50.973773 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af33dc19-0763-4492-a157-a083c745addc admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:50.974775 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5cda37-6c51-4762-930b-0f65de056ada admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:50.984187 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af33dc19-0763-4492-a157-a083c745addc admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:50.989824 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 625/1274] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Oct 14 13:00:50 2022] PUT /identity/v3/projects/09fc956544ba4fe69dbc865e02f4f997/users/5e086d4caf514881986ffe12f74dc592/roles/5e8849303a75425b9eaa2681cc031af1 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:00:50.990984 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5cda37-6c51-4762-930b-0f65de056ada admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:51.043448 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68160a9-0077-4c14-9f80-209942f1907e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:51.044242 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68160a9-0077-4c14-9f80-209942f1907e admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:51.044521 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68160a9-0077-4c14-9f80-209942f1907e admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:51.044792 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68160a9-0077-4c14-9f80-209942f1907e admin admin] PATH_INFO: `/v3/projects/51cb4c6730644130a77f1921a14745a1/users/a1b9ec5c477d4f01aa2ad5f634e5f73a/roles/5e8849303a75425b9eaa2681cc031af1` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:51.055460 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5cda37-6c51-4762-930b-0f65de056ada admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:51.059278 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68160a9-0077-4c14-9f80-209942f1907e admin admin] RBAC: Authorizing `identity:create_grant(project_id=51cb4c6730644130a77f1921a14745a1, user_id=a1b9ec5c477d4f01aa2ad5f634e5f73a, role_id=5e8849303a75425b9eaa2681cc031af1)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:51.060028 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e45f9b1-a193-4103-b9c9-8d77a5a2b50d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:51.060628 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e45f9b1-a193-4103-b9c9-8d77a5a2b50d admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:51.060906 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e45f9b1-a193-4103-b9c9-8d77a5a2b50d admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:51.061243 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e45f9b1-a193-4103-b9c9-8d77a5a2b50d admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:51.061843 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e45f9b1-a193-4103-b9c9-8d77a5a2b50d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:51.061953 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68160a9-0077-4c14-9f80-209942f1907e admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:51.064189 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e45f9b1-a193-4103-b9c9-8d77a5a2b50d admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:51.074543 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 626/1275] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:00:50 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:00:51.075811 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50d9a42-79bd-4176-a331-ddf140ebb80a None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:51.076101 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50d9a42-79bd-4176-a331-ddf140ebb80a None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:51.076333 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 650/1276] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Oct 14 13:00:50 2022] PUT /identity/v3/projects/51cb4c6730644130a77f1921a14745a1/users/a1b9ec5c477d4f01aa2ad5f634e5f73a/roles/5e8849303a75425b9eaa2681cc031af1 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:00:51.076469 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50d9a42-79bd-4176-a331-ddf140ebb80a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:51.077151 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68160a9-0077-4c14-9f80-209942f1907e admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:51.113529 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-e50d9a42-79bd-4176-a331-ddf140ebb80a None None] MFA Rules not processed for user `d3d7326b2e77497b94954638ca939fc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:00:51.114964 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-e50d9a42-79bd-4176-a331-ddf140ebb80a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:51.139135 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68160a9-0077-4c14-9f80-209942f1907e admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:51.144177 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d86b36-6f65-4993-9a2d-7a3fe6a0f0ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:51.144787 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d86b36-6f65-4993-9a2d-7a3fe6a0f0ea admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:51.145093 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d86b36-6f65-4993-9a2d-7a3fe6a0f0ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:51.145388 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d86b36-6f65-4993-9a2d-7a3fe6a0f0ea admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:51.146105 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d86b36-6f65-4993-9a2d-7a3fe6a0f0ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:51.147950 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d86b36-6f65-4993-9a2d-7a3fe6a0f0ea admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:51.161964 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 651/1277] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:00:51 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:00:51.161964 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d86b36-6f65-4993-9a2d-7a3fe6a0f0ea admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:51.169214 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d86b36-6f65-4993-9a2d-7a3fe6a0f0ea admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:51.174239 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e978a2-b175-46ad-903e-96ab17c4e915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:51.174829 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e978a2-b175-46ad-903e-96ab17c4e915 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:51.175113 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e978a2-b175-46ad-903e-96ab17c4e915 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:51.175387 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e978a2-b175-46ad-903e-96ab17c4e915 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:51.176085 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e978a2-b175-46ad-903e-96ab17c4e915 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:51.177734 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e978a2-b175-46ad-903e-96ab17c4e915 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:51.188497 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 652/1278] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:00:51 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:00:51.193206 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e978a2-b175-46ad-903e-96ab17c4e915 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:51.193343 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 627/1279] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:00:51 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:00:51.193343 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56d45c7-c856-457b-9128-47b053c2d08e None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:51.193343 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56d45c7-c856-457b-9128-47b053c2d08e None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:51.193343 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56d45c7-c856-457b-9128-47b053c2d08e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:51.205911 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e978a2-b175-46ad-903e-96ab17c4e915 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:51.210960 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5681879-21d4-4769-913d-11b59d043a9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:51.212451 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5681879-21d4-4769-913d-11b59d043a9e admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:51.212758 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5681879-21d4-4769-913d-11b59d043a9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:51.213036 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5681879-21d4-4769-913d-11b59d043a9e admin admin] PATH_INFO: `/v3/projects/40f6daff348f4fa6a783e398ca257fc7/users/9434562e690740bda182577b25f70774/roles/5e8849303a75425b9eaa2681cc031af1` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:51.220470 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-b56d45c7-c856-457b-9128-47b053c2d08e None None] MFA Rules not processed for user `5e086d4caf514881986ffe12f74dc592`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:00:51.221710 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-b56d45c7-c856-457b-9128-47b053c2d08e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:51.227049 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:00:51.230819 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5681879-21d4-4769-913d-11b59d043a9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=40f6daff348f4fa6a783e398ca257fc7, user_id=9434562e690740bda182577b25f70774, role_id=5e8849303a75425b9eaa2681cc031af1)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:51.234951 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5681879-21d4-4769-913d-11b59d043a9e admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:51.242938 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:00:51.251076 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 653/1280] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Oct 14 13:00:51 2022] PUT /identity/v3/projects/40f6daff348f4fa6a783e398ca257fc7/users/9434562e690740bda182577b25f70774/roles/5e8849303a75425b9eaa2681cc031af1 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:00:51.255714 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5681879-21d4-4769-913d-11b59d043a9e admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:51.292311 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 628/1281] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:00:51 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:00:51.293936 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2441c04a-cfba-4403-be25-03c6b6084311 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:51.294317 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2441c04a-cfba-4403-be25-03c6b6084311 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:51.294655 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2441c04a-cfba-4403-be25-03c6b6084311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:51.315203 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-2441c04a-cfba-4403-be25-03c6b6084311 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:00:51.316718 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-2441c04a-cfba-4403-be25-03c6b6084311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:51.320329 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5681879-21d4-4769-913d-11b59d043a9e admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:51.325003 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626e4d9c-a68a-4a81-b409-148770a0c463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:51.325505 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 629/1282] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:00:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:00:51.325659 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626e4d9c-a68a-4a81-b409-148770a0c463 admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:51.325942 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626e4d9c-a68a-4a81-b409-148770a0c463 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:51.326114 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2441c04a-cfba-4403-be25-03c6b6084311 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:51.326248 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626e4d9c-a68a-4a81-b409-148770a0c463 admin admin] PATH_INFO: `/v3/projects/192d1bb008c54cb39f95b399d026e062/users/c039b370575643338954f6de250d1ea9/roles/5e8849303a75425b9eaa2681cc031af1` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:51.339200 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2441c04a-cfba-4403-be25-03c6b6084311 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:51.343942 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f199db-667b-4b98-8085-8923b9c266b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:51.344327 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626e4d9c-a68a-4a81-b409-148770a0c463 admin admin] RBAC: Authorizing `identity:create_grant(project_id=192d1bb008c54cb39f95b399d026e062, user_id=c039b370575643338954f6de250d1ea9, role_id=5e8849303a75425b9eaa2681cc031af1)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:51.344660 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f199db-667b-4b98-8085-8923b9c266b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:51.344937 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f199db-667b-4b98-8085-8923b9c266b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:51.345209 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f199db-667b-4b98-8085-8923b9c266b4 admin admin] PATH_INFO: `/v3/projects/af5c5078c6d44b96b690ddb84340a8ba/users/0ec28d6b21de48559c31abff946c0a4d/roles/5e8849303a75425b9eaa2681cc031af1` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:51.347034 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626e4d9c-a68a-4a81-b409-148770a0c463 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:51.360797 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f199db-667b-4b98-8085-8923b9c266b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af5c5078c6d44b96b690ddb84340a8ba, user_id=0ec28d6b21de48559c31abff946c0a4d, role_id=5e8849303a75425b9eaa2681cc031af1)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:51.362526 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 654/1283] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Oct 14 13:00:51 2022] PUT /identity/v3/projects/192d1bb008c54cb39f95b399d026e062/users/c039b370575643338954f6de250d1ea9/roles/5e8849303a75425b9eaa2681cc031af1 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:00:51.363318 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626e4d9c-a68a-4a81-b409-148770a0c463 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:51.363570 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f199db-667b-4b98-8085-8923b9c266b4 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:51.378572 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 630/1284] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Oct 14 13:00:51 2022] PUT /identity/v3/projects/af5c5078c6d44b96b690ddb84340a8ba/users/0ec28d6b21de48559c31abff946c0a4d/roles/5e8849303a75425b9eaa2681cc031af1 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:00:51.379920 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256ba915-4875-4306-93c1-01b550fb8cc5 None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:51.380272 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256ba915-4875-4306-93c1-01b550fb8cc5 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:51.380554 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256ba915-4875-4306-93c1-01b550fb8cc5 None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:51.381855 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 631/1285] 10.222.0.17 () {54 vars in 961 bytes} [Fri Oct 14 13:00:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 13:00:51.387546 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2c6206-3c83-4f9f-9261-3e8abf1c2055 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:51.387930 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2c6206-3c83-4f9f-9261-3e8abf1c2055 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:51.388174 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2c6206-3c83-4f9f-9261-3e8abf1c2055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:51.408062 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-1a2c6206-3c83-4f9f-9261-3e8abf1c2055 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:00:51.409327 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-1a2c6206-3c83-4f9f-9261-3e8abf1c2055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:51.438071 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626e4d9c-a68a-4a81-b409-148770a0c463 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:51.479352 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 632/1286] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:00:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:00:51.480194 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2c6206-3c83-4f9f-9261-3e8abf1c2055 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:51.490052 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2c6206-3c83-4f9f-9261-3e8abf1c2055 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:51.494734 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75355f74-57ef-4ba8-aa66-9ea36e819c8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:51.495319 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75355f74-57ef-4ba8-aa66-9ea36e819c8b admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:51.495596 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75355f74-57ef-4ba8-aa66-9ea36e819c8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:51.495865 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75355f74-57ef-4ba8-aa66-9ea36e819c8b admin admin] PATH_INFO: `/v3/projects` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:51.496491 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75355f74-57ef-4ba8-aa66-9ea36e819c8b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:51.498411 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75355f74-57ef-4ba8-aa66-9ea36e819c8b admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:51.499965 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b4381f-fd5e-4c45-ad10-c9060f875727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:51.501518 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b4381f-fd5e-4c45-ad10-c9060f875727 admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:51.501811 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b4381f-fd5e-4c45-ad10-c9060f875727 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:51.502093 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b4381f-fd5e-4c45-ad10-c9060f875727 admin admin] PATH_INFO: `/v3/projects/a57419b4c6f44fd9886da9105b9e13b4/users/54a6ec88e95b469c89d78cb3d4b3bc7f/roles/5e8849303a75425b9eaa2681cc031af1` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:51.516924 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b4381f-fd5e-4c45-ad10-c9060f875727 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a57419b4c6f44fd9886da9105b9e13b4, user_id=54a6ec88e95b469c89d78cb3d4b3bc7f, role_id=5e8849303a75425b9eaa2681cc031af1)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:51.519862 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b4381f-fd5e-4c45-ad10-c9060f875727 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:51.529558 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 633/1287] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Oct 14 13:00:51 2022] POST /identity/v3/projects => generated 403 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:00:51.529558 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75355f74-57ef-4ba8-aa66-9ea36e819c8b admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:51.537938 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 655/1288] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Oct 14 13:00:51 2022] PUT /identity/v3/projects/a57419b4c6f44fd9886da9105b9e13b4/users/54a6ec88e95b469c89d78cb3d4b3bc7f/roles/5e8849303a75425b9eaa2681cc031af1 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:00:51.539512 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0285b75-af65-4e65-87a4-df1a2866015e None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:51.539853 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0285b75-af65-4e65-87a4-df1a2866015e None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:51.540215 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0285b75-af65-4e65-87a4-df1a2866015e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:51.551430 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:00:51.566034 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-b0285b75-af65-4e65-87a4-df1a2866015e None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:00:51.567218 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-b0285b75-af65-4e65-87a4-df1a2866015e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:51.588505 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75355f74-57ef-4ba8-aa66-9ea36e819c8b admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:51.607890 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:00:51.628998 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 656/1289] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:00:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:00:51.630077 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26e978f-4057-4e00-bf63-a6d8736cfe80 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:51.630427 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26e978f-4057-4e00-bf63-a6d8736cfe80 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:51.630669 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26e978f-4057-4e00-bf63-a6d8736cfe80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:51.642981 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675435b8-6ab4-4e08-b7ba-50b17a25c05a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d483292f3a4794848fcacfba5b107e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:51.643600 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675435b8-6ab4-4e08-b7ba-50b17a25c05a service neutron] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:51.643883 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675435b8-6ab4-4e08-b7ba-50b17a25c05a service neutron] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:51.644184 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675435b8-6ab4-4e08-b7ba-50b17a25c05a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:51.653548 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675435b8-6ab4-4e08-b7ba-50b17a25c05a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:51.655037 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675435b8-6ab4-4e08-b7ba-50b17a25c05a service neutron] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:51.665719 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 634/1290] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:00:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:00:51.667030 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7516e7cb-108c-4af5-bd08-65f7b218ccca None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:51.667351 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7516e7cb-108c-4af5-bd08-65f7b218ccca None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:51.667653 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7516e7cb-108c-4af5-bd08-65f7b218ccca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:51.671525 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-b26e978f-4057-4e00-bf63-a6d8736cfe80 None None] MFA Rules not processed for user `931f4e32c8764514b5efed31b0785be7`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:00:51.673298 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-b26e978f-4057-4e00-bf63-a6d8736cfe80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:51.698182 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-7516e7cb-108c-4af5-bd08-65f7b218ccca None None] MFA Rules not processed for user `0ec28d6b21de48559c31abff946c0a4d`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:00:51.699476 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-7516e7cb-108c-4af5-bd08-65f7b218ccca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:51.752084 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 657/1291] 10.222.0.17 () {58 vars in 1058 bytes} [Fri Oct 14 13:00:51 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:00:51.753213 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26e978f-4057-4e00-bf63-a6d8736cfe80 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:51.764381 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26e978f-4057-4e00-bf63-a6d8736cfe80 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:51.770932 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd8d3ae-e247-429b-9e37-cc57168f45f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d483292f3a4794848fcacfba5b107e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:51.771753 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd8d3ae-e247-429b-9e37-cc57168f45f5 service neutron] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:51.772309 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd8d3ae-e247-429b-9e37-cc57168f45f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:51.772681 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd8d3ae-e247-429b-9e37-cc57168f45f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:51.782446 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 635/1292] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:00:51 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:00:51.784887 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd8d3ae-e247-429b-9e37-cc57168f45f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:51.786838 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd8d3ae-e247-429b-9e37-cc57168f45f5 service neutron] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:51.787203 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7516e7cb-108c-4af5-bd08-65f7b218ccca None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:51.799484 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 658/1293] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:00:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:00:51.800894 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dab89b-02fe-4ab5-afa5-7c63fe73d527 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:51.801252 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dab89b-02fe-4ab5-afa5-7c63fe73d527 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:51.801591 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dab89b-02fe-4ab5-afa5-7c63fe73d527 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:51.802245 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7516e7cb-108c-4af5-bd08-65f7b218ccca None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:51.808830 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a75f34-a3d0-4812-81fc-62cd82aa0899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:51.809566 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a75f34-a3d0-4812-81fc-62cd82aa0899 admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:51.810002 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a75f34-a3d0-4812-81fc-62cd82aa0899 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:51.810687 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a75f34-a3d0-4812-81fc-62cd82aa0899 admin admin] PATH_INFO: `/v3/users` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:51.811722 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a75f34-a3d0-4812-81fc-62cd82aa0899 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:51.814049 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a75f34-a3d0-4812-81fc-62cd82aa0899 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:51.824647 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-a8dab89b-02fe-4ab5-afa5-7c63fe73d527 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:00:51.826226 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-a8dab89b-02fe-4ab5-afa5-7c63fe73d527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:51.846634 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 659/1294] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:00:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:00:51.847497 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dab89b-02fe-4ab5-afa5-7c63fe73d527 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:51.857016 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-a8dab89b-02fe-4ab5-afa5-7c63fe73d527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:51.865563 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 636/1295] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Oct 14 13:00:51 2022] POST /identity/v3/users => generated 308 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:00:51.865563 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a75f34-a3d0-4812-81fc-62cd82aa0899 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:51.872468 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dab89b-02fe-4ab5-afa5-7c63fe73d527 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:51.877311 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c1e514-abde-4329-95c2-f2f47eb7a6bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d483292f3a4794848fcacfba5b107e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:51.878011 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c1e514-abde-4329-95c2-f2f47eb7a6bc service neutron] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:51.878391 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c1e514-abde-4329-95c2-f2f47eb7a6bc service neutron] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:51.878729 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c1e514-abde-4329-95c2-f2f47eb7a6bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:51.889007 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c1e514-abde-4329-95c2-f2f47eb7a6bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:51.889691 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a75f34-a3d0-4812-81fc-62cd82aa0899 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:51.891295 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c1e514-abde-4329-95c2-f2f47eb7a6bc service neutron] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:51.898984 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c04f73-b133-47b3-bb91-4ce64e215cdb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '931f4e32c8764514b5efed31b0785be7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:51.899824 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c04f73-b133-47b3-bb91-4ce64e215cdb service nova] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:51.900161 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c04f73-b133-47b3-bb91-4ce64e215cdb service nova] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:51.900416 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c04f73-b133-47b3-bb91-4ce64e215cdb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:51.913718 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 660/1296] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:00:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:00:51.914734 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c1e514-abde-4329-95c2-f2f47eb7a6bc service neutron] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:51.934496 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c1e514-abde-4329-95c2-f2f47eb7a6bc service neutron] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:51.940916 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4d5c30-97ca-43d6-a597-ce142f470855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:51.941529 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4d5c30-97ca-43d6-a597-ce142f470855 admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:51.941806 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4d5c30-97ca-43d6-a597-ce142f470855 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:51.942399 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4d5c30-97ca-43d6-a597-ce142f470855 admin admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:51.943281 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4d5c30-97ca-43d6-a597-ce142f470855 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:51.945408 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4d5c30-97ca-43d6-a597-ce142f470855 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:51.982784 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 661/1297] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Oct 14 13:00:51 2022] POST /identity/v3/projects => generated 371 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:00:51.983864 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4d5c30-97ca-43d6-a597-ce142f470855 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:52.025052 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:00:52.056939 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c04f73-b133-47b3-bb91-4ce64e215cdb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:52.063630 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c04f73-b133-47b3-bb91-4ce64e215cdb service nova] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:52.066144 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4d5c30-97ca-43d6-a597-ce142f470855 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:52.072252 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61627db-853d-4a46-bf94-f808f89ff0be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d483292f3a4794848fcacfba5b107e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:52.073003 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61627db-853d-4a46-bf94-f808f89ff0be service neutron] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:52.073308 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61627db-853d-4a46-bf94-f808f89ff0be service neutron] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:52.073643 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61627db-853d-4a46-bf94-f808f89ff0be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:52.091779 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 637/1298] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:00:51 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:00:52.097505 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c04f73-b133-47b3-bb91-4ce64e215cdb service nova] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:52.127738 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c04f73-b133-47b3-bb91-4ce64e215cdb service nova] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:52.209347 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:00:52.211005 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61627db-853d-4a46-bf94-f808f89ff0be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:52.213637 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61627db-853d-4a46-bf94-f808f89ff0be service neutron] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:52.226972 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 662/1299] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:00:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:00:52.228045 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61627db-853d-4a46-bf94-f808f89ff0be service neutron] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:52.240457 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61627db-853d-4a46-bf94-f808f89ff0be service neutron] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:52.246604 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9059ae3-565e-451f-84b8-6f8b1c7b7f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:52.247324 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9059ae3-565e-451f-84b8-6f8b1c7b7f25 admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:52.247617 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9059ae3-565e-451f-84b8-6f8b1c7b7f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:52.247897 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9059ae3-565e-451f-84b8-6f8b1c7b7f25 admin admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:52.248692 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9059ae3-565e-451f-84b8-6f8b1c7b7f25 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:52.252006 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9059ae3-565e-451f-84b8-6f8b1c7b7f25 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:52.272193 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28efb06-66c8-4c24-8898-e4e6e5045203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:52.273815 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28efb06-66c8-4c24-8898-e4e6e5045203 admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:52.275232 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28efb06-66c8-4c24-8898-e4e6e5045203 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:52.275976 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28efb06-66c8-4c24-8898-e4e6e5045203 admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:52.277107 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 663/1300] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Oct 14 13:00:52 2022] POST /identity/v3/users => generated 292 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:00:52.277663 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28efb06-66c8-4c24-8898-e4e6e5045203 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:52.278550 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56db1b0-af06-4746-ba67-5868c27ec14d None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:52.278998 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56db1b0-af06-4746-ba67-5868c27ec14d None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:52.279335 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56db1b0-af06-4746-ba67-5868c27ec14d None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:52.280851 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 664/1301] 10.222.0.17 () {54 vars in 961 bytes} [Fri Oct 14 13:00:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 13:00:52.281794 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56db1b0-af06-4746-ba67-5868c27ec14d None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:52.282590 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28efb06-66c8-4c24-8898-e4e6e5045203 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:52.298965 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56db1b0-af06-4746-ba67-5868c27ec14d None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:52.304101 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60fe3a6-3a8e-457e-addf-a3cd94b891a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:52.304919 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60fe3a6-3a8e-457e-addf-a3cd94b891a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:52.305273 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60fe3a6-3a8e-457e-addf-a3cd94b891a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:52.305635 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60fe3a6-3a8e-457e-addf-a3cd94b891a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:52.306406 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60fe3a6-3a8e-457e-addf-a3cd94b891a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:52.308272 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60fe3a6-3a8e-457e-addf-a3cd94b891a2 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:52.315776 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 638/1302] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:00:52 2022] GET /identity/v3/roles => generated 1420 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:00:52.317722 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba10f6a6-503f-4823-b462-760f5084fcd2 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:52.318577 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba10f6a6-503f-4823-b462-760f5084fcd2 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:52.318883 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba10f6a6-503f-4823-b462-760f5084fcd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:52.321922 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 665/1303] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:00:52 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:00:52.322947 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60fe3a6-3a8e-457e-addf-a3cd94b891a2 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:52.340749 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60fe3a6-3a8e-457e-addf-a3cd94b891a2 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:52.349577 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45603e1-5670-4484-8b4f-9979efe57f9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:52.351072 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45603e1-5670-4484-8b4f-9979efe57f9f admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:52.351710 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45603e1-5670-4484-8b4f-9979efe57f9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:52.352205 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45603e1-5670-4484-8b4f-9979efe57f9f admin admin] PATH_INFO: `/v3/projects/2f35a0759b36499ca0a4d94b748cc789/users/163e74000f4f4d4e87e093ca56f9f9be/roles/7f6e29e390bc41f7a9af17659a2e95d1` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:52.375542 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45603e1-5670-4484-8b4f-9979efe57f9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f35a0759b36499ca0a4d94b748cc789, user_id=163e74000f4f4d4e87e093ca56f9f9be, role_id=7f6e29e390bc41f7a9af17659a2e95d1)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:52.379708 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45603e1-5670-4484-8b4f-9979efe57f9f admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:52.385702 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-ba10f6a6-503f-4823-b462-760f5084fcd2 None None] MFA Rules not processed for user `931f4e32c8764514b5efed31b0785be7`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:00:52.387592 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-ba10f6a6-503f-4823-b462-760f5084fcd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:52.405572 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 666/1304] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Oct 14 13:00:52 2022] PUT /identity/v3/projects/2f35a0759b36499ca0a4d94b748cc789/users/163e74000f4f4d4e87e093ca56f9f9be/roles/7f6e29e390bc41f7a9af17659a2e95d1 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:00:52.408249 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45603e1-5670-4484-8b4f-9979efe57f9f admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:52.508554 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 639/1305] 10.222.0.17 () {58 vars in 1058 bytes} [Fri Oct 14 13:00:52 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:00:52.513999 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba10f6a6-503f-4823-b462-760f5084fcd2 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:52.544874 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba10f6a6-503f-4823-b462-760f5084fcd2 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:52.563663 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45603e1-5670-4484-8b4f-9979efe57f9f admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:52.580664 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f58f173-228f-4d10-b798-3775646c82e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:52.581596 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f58f173-228f-4d10-b798-3775646c82e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:52.581989 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f58f173-228f-4d10-b798-3775646c82e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:52.582390 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f58f173-228f-4d10-b798-3775646c82e5 admin admin] PATH_INFO: `/v3/projects/a38261dcabd44b65831b9a4d60f26159/users/2936c4e88540487f96d8ae1447dc4d4c/roles/7f6e29e390bc41f7a9af17659a2e95d1` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:52.619389 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f58f173-228f-4d10-b798-3775646c82e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a38261dcabd44b65831b9a4d60f26159, user_id=2936c4e88540487f96d8ae1447dc4d4c, role_id=7f6e29e390bc41f7a9af17659a2e95d1)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:52.622240 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f58f173-228f-4d10-b798-3775646c82e5 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:52.647221 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 667/1306] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Oct 14 13:00:52 2022] PUT /identity/v3/projects/a38261dcabd44b65831b9a4d60f26159/users/2936c4e88540487f96d8ae1447dc4d4c/roles/7f6e29e390bc41f7a9af17659a2e95d1 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:00:52.648746 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6413df4-9a12-4c5d-a2f1-c40603430d34 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:52.650428 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6413df4-9a12-4c5d-a2f1-c40603430d34 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:52.650828 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6413df4-9a12-4c5d-a2f1-c40603430d34 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:52.655661 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 668/1307] 10.222.0.17 () {54 vars in 912 bytes} [Fri Oct 14 13:00:52 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 13:00:52.657097 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6413df4-9a12-4c5d-a2f1-c40603430d34 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:52.674866 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c627d8cd-6f5e-413e-8a1f-49820ea86d64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:52.675901 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c627d8cd-6f5e-413e-8a1f-49820ea86d64 admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:52.676330 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c627d8cd-6f5e-413e-8a1f-49820ea86d64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:52.676829 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c627d8cd-6f5e-413e-8a1f-49820ea86d64 admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:52.678553 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c627d8cd-6f5e-413e-8a1f-49820ea86d64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:52.679736 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:00:52.682953 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c627d8cd-6f5e-413e-8a1f-49820ea86d64 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:52.701286 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 640/1308] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:00:52 2022] GET /identity/v3/roles => generated 1420 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:00:52.703168 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5566f0bd-7511-43d9-a093-279876714b25 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:52.703766 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5566f0bd-7511-43d9-a093-279876714b25 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:52.704252 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5566f0bd-7511-43d9-a093-279876714b25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:52.773587 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-5566f0bd-7511-43d9-a093-279876714b25 None None] MFA Rules not processed for user `931f4e32c8764514b5efed31b0785be7`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:00:52.780343 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-5566f0bd-7511-43d9-a093-279876714b25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:52.793000 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6413df4-9a12-4c5d-a2f1-c40603430d34 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:52.804953 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8445deb6-3be8-4d7f-b899-b538b5b0028c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:52.805747 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8445deb6-3be8-4d7f-b899-b538b5b0028c admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:52.806163 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8445deb6-3be8-4d7f-b899-b538b5b0028c admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:52.806819 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8445deb6-3be8-4d7f-b899-b538b5b0028c admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:52.807308 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8445deb6-3be8-4d7f-b899-b538b5b0028c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:52.809572 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8445deb6-3be8-4d7f-b899-b538b5b0028c admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:52.831956 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 669/1309] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:00:52 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:00:52.831956 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8445deb6-3be8-4d7f-b899-b538b5b0028c admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:52.856148 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8445deb6-3be8-4d7f-b899-b538b5b0028c admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:52.862586 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277de4b9-2e3f-40e8-b97c-2185ac34aa31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:52.863920 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277de4b9-2e3f-40e8-b97c-2185ac34aa31 admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:52.863920 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277de4b9-2e3f-40e8-b97c-2185ac34aa31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:52.863920 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277de4b9-2e3f-40e8-b97c-2185ac34aa31 admin admin] PATH_INFO: `/v3/projects/2f35a0759b36499ca0a4d94b748cc789/users/163e74000f4f4d4e87e093ca56f9f9be/roles/7f6e29e390bc41f7a9af17659a2e95d1` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:52.866478 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277de4b9-2e3f-40e8-b97c-2185ac34aa31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f35a0759b36499ca0a4d94b748cc789, user_id=163e74000f4f4d4e87e093ca56f9f9be, role_id=7f6e29e390bc41f7a9af17659a2e95d1)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:52.869382 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277de4b9-2e3f-40e8-b97c-2185ac34aa31 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:52.881445 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 670/1310] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Oct 14 13:00:52 2022] PUT /identity/v3/projects/2f35a0759b36499ca0a4d94b748cc789/users/163e74000f4f4d4e87e093ca56f9f9be/roles/7f6e29e390bc41f7a9af17659a2e95d1 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:00:52.882762 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f252cd-1d8a-4a8a-9735-f194b943b67b None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:52.883048 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f252cd-1d8a-4a8a-9735-f194b943b67b None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:52.883325 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f252cd-1d8a-4a8a-9735-f194b943b67b None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:52.884572 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 671/1311] 10.222.0.17 () {54 vars in 912 bytes} [Fri Oct 14 13:00:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 13:00:52.889359 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f252cd-1d8a-4a8a-9735-f194b943b67b None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:52.905306 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:00:52.938178 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 641/1312] 10.222.0.17 () {58 vars in 1009 bytes} [Fri Oct 14 13:00:52 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:00:52.939450 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe6d698-0659-4586-9bbf-0ebfae851264 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:52.939819 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe6d698-0659-4586-9bbf-0ebfae851264 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:52.940161 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe6d698-0659-4586-9bbf-0ebfae851264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:52.995057 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-0fe6d698-0659-4586-9bbf-0ebfae851264 None None] MFA Rules not processed for user `931f4e32c8764514b5efed31b0785be7`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:00:52.996568 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-0fe6d698-0659-4586-9bbf-0ebfae851264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:53.012051 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f252cd-1d8a-4a8a-9735-f194b943b67b None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:53.024100 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0008b5f2-16fd-432c-9410-36b46dcf7e21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:53.024873 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0008b5f2-16fd-432c-9410-36b46dcf7e21 admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:53.025535 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0008b5f2-16fd-432c-9410-36b46dcf7e21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:53.025920 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0008b5f2-16fd-432c-9410-36b46dcf7e21 admin admin] PATH_INFO: `/v3/projects/a38261dcabd44b65831b9a4d60f26159/users/2936c4e88540487f96d8ae1447dc4d4c/roles/7f6e29e390bc41f7a9af17659a2e95d1` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:53.030869 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0008b5f2-16fd-432c-9410-36b46dcf7e21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a38261dcabd44b65831b9a4d60f26159, user_id=2936c4e88540487f96d8ae1447dc4d4c, role_id=7f6e29e390bc41f7a9af17659a2e95d1)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:53.036985 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0008b5f2-16fd-432c-9410-36b46dcf7e21 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:53.064028 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 672/1313] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Oct 14 13:00:52 2022] PUT /identity/v3/projects/a38261dcabd44b65831b9a4d60f26159/users/2936c4e88540487f96d8ae1447dc4d4c/roles/7f6e29e390bc41f7a9af17659a2e95d1 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:00:53.065075 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c225f89-4181-4d23-8057-9dfdd4ae0133 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:53.065364 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c225f89-4181-4d23-8057-9dfdd4ae0133 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:53.065643 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c225f89-4181-4d23-8057-9dfdd4ae0133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:53.122340 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 642/1314] 10.222.0.17 () {58 vars in 1009 bytes} [Fri Oct 14 13:00:52 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:00:53.124030 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe6d698-0659-4586-9bbf-0ebfae851264 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:53.141802 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-2c225f89-4181-4d23-8057-9dfdd4ae0133 None None] MFA Rules not processed for user `163e74000f4f4d4e87e093ca56f9f9be`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:00:53.143267 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-2c225f89-4181-4d23-8057-9dfdd4ae0133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:53.199588 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe6d698-0659-4586-9bbf-0ebfae851264 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:53.279872 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffda140-d79f-414f-8f31-aa31fd1aa8ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c3c564b8c548e4beef1cbfba2ad343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:53.281744 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffda140-d79f-414f-8f31-aa31fd1aa8ad service cinder] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:53.282052 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffda140-d79f-414f-8f31-aa31fd1aa8ad service cinder] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:53.282412 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffda140-d79f-414f-8f31-aa31fd1aa8ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:53.312077 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 673/1315] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:00:53 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:00:53.317938 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780755b1-983a-4abd-b53e-3073279dae06 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:53.318526 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780755b1-983a-4abd-b53e-3073279dae06 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:53.318526 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780755b1-983a-4abd-b53e-3073279dae06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:53.347995 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:00:53.359651 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-780755b1-983a-4abd-b53e-3073279dae06 None None] MFA Rules not processed for user `2936c4e88540487f96d8ae1447dc4d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:00:53.362087 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-780755b1-983a-4abd-b53e-3073279dae06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:53.398907 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:00:53.438754 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffda140-d79f-414f-8f31-aa31fd1aa8ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:53.441932 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 674/1316] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:00:53 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:00:53.443302 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780755b1-983a-4abd-b53e-3073279dae06 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:53.444541 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffda140-d79f-414f-8f31-aa31fd1aa8ad service cinder] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:53.467152 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780755b1-983a-4abd-b53e-3073279dae06 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:53.469938 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 643/1317] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:00:53 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:00:53.485135 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184886ab-c9c9-4eb1-b51f-edd80b93b9d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c3c564b8c548e4beef1cbfba2ad343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:53.486336 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184886ab-c9c9-4eb1-b51f-edd80b93b9d1 service cinder] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:53.487591 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184886ab-c9c9-4eb1-b51f-edd80b93b9d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:53.489451 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184886ab-c9c9-4eb1-b51f-edd80b93b9d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:53.504147 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184886ab-c9c9-4eb1-b51f-edd80b93b9d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:53.506265 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184886ab-c9c9-4eb1-b51f-edd80b93b9d1 service cinder] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:53.520437 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 675/1318] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:00:53 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:00:53.575851 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffda140-d79f-414f-8f31-aa31fd1aa8ad service cinder] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:53.588252 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffda140-d79f-414f-8f31-aa31fd1aa8ad service cinder] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:53.599409 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdadc83-4d5f-4fa9-b3b6-422a678a4f7c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c3c564b8c548e4beef1cbfba2ad343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:53.600456 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdadc83-4d5f-4fa9-b3b6-422a678a4f7c service cinder] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:53.602195 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdadc83-4d5f-4fa9-b3b6-422a678a4f7c service cinder] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:53.602195 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdadc83-4d5f-4fa9-b3b6-422a678a4f7c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:53.624139 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdadc83-4d5f-4fa9-b3b6-422a678a4f7c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:53.627172 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdadc83-4d5f-4fa9-b3b6-422a678a4f7c service cinder] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:53.650303 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 644/1319] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:00:53 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:00:53.793137 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184886ab-c9c9-4eb1-b51f-edd80b93b9d1 service cinder] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:53.807000 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184886ab-c9c9-4eb1-b51f-edd80b93b9d1 service cinder] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:53.818177 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2a96a2-7184-40dd-af27-d949ea54a716 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c3c564b8c548e4beef1cbfba2ad343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:53.818982 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2a96a2-7184-40dd-af27-d949ea54a716 service cinder] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:53.819366 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2a96a2-7184-40dd-af27-d949ea54a716 service cinder] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:53.819745 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2a96a2-7184-40dd-af27-d949ea54a716 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:53.844374 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2a96a2-7184-40dd-af27-d949ea54a716 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:53.846374 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2a96a2-7184-40dd-af27-d949ea54a716 service cinder] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:53.872950 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 676/1320] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:00:53 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:00:54.659252 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdadc83-4d5f-4fa9-b3b6-422a678a4f7c service cinder] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:55.124242 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdadc83-4d5f-4fa9-b3b6-422a678a4f7c service cinder] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:55.138540 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfe475d-8842-4f2d-b7ee-a9979274acf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:55.139204 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfe475d-8842-4f2d-b7ee-a9979274acf8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:55.139484 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfe475d-8842-4f2d-b7ee-a9979274acf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:55.139761 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfe475d-8842-4f2d-b7ee-a9979274acf8 admin admin] PATH_INFO: `/v3/users/5e086d4caf514881986ffe12f74dc592` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:55.145115 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfe475d-8842-4f2d-b7ee-a9979274acf8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e086d4caf514881986ffe12f74dc592)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:55.147189 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfe475d-8842-4f2d-b7ee-a9979274acf8 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:55.254762 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-acfe475d-8842-4f2d-b7ee-a9979274acf8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e086d4caf514881986ffe12f74dc592'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:55.269351 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-acfe475d-8842-4f2d-b7ee-a9979274acf8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e086d4caf514881986ffe12f74dc592'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:55.271685 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-acfe475d-8842-4f2d-b7ee-a9979274acf8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e086d4caf514881986ffe12f74dc592'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:55.290002 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-acfe475d-8842-4f2d-b7ee-a9979274acf8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e086d4caf514881986ffe12f74dc592'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:55.310531 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-acfe475d-8842-4f2d-b7ee-a9979274acf8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e086d4caf514881986ffe12f74dc592'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:55.319847 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 645/1321] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Oct 14 13:00:54 2022] DELETE /identity/v3/users/5e086d4caf514881986ffe12f74dc592 => generated 0 bytes in 662 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:00:55.324993 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14765d78-45ca-4f59-820b-7ef3a43deb50 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:55.325844 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14765d78-45ca-4f59-820b-7ef3a43deb50 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:55.325844 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14765d78-45ca-4f59-820b-7ef3a43deb50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:55.364791 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-14765d78-45ca-4f59-820b-7ef3a43deb50 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:00:55.367210 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-14765d78-45ca-4f59-820b-7ef3a43deb50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:55.411228 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfe475d-8842-4f2d-b7ee-a9979274acf8 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:55.414323 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-acfe475d-8842-4f2d-b7ee-a9979274acf8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:55.502059 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:00:55.512007 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 677/1322] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:00:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:00:55.532178 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14765d78-45ca-4f59-820b-7ef3a43deb50 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:55.534998 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-14765d78-45ca-4f59-820b-7ef3a43deb50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:55.561106 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfe475d-8842-4f2d-b7ee-a9979274acf8 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:55.574748 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6ba31d-b933-4649-b7a8-ceed2c630cd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:55.575443 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6ba31d-b933-4649-b7a8-ceed2c630cd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:55.575724 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6ba31d-b933-4649-b7a8-ceed2c630cd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:55.576000 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6ba31d-b933-4649-b7a8-ceed2c630cd7 admin admin] PATH_INFO: `/v3/users/0ec28d6b21de48559c31abff946c0a4d` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:55.585158 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6ba31d-b933-4649-b7a8-ceed2c630cd7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ec28d6b21de48559c31abff946c0a4d)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:55.593825 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6ba31d-b933-4649-b7a8-ceed2c630cd7 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:55.694705 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-9d6ba31d-b933-4649-b7a8-ceed2c630cd7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ec28d6b21de48559c31abff946c0a4d'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:55.704259 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-9d6ba31d-b933-4649-b7a8-ceed2c630cd7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ec28d6b21de48559c31abff946c0a4d'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:55.705520 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-9d6ba31d-b933-4649-b7a8-ceed2c630cd7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ec28d6b21de48559c31abff946c0a4d'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:55.714964 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14765d78-45ca-4f59-820b-7ef3a43deb50 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:55.719162 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-9d6ba31d-b933-4649-b7a8-ceed2c630cd7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ec28d6b21de48559c31abff946c0a4d'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:55.734424 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13552a70-7d10-4e98-9c80-ebc35535bd65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d483292f3a4794848fcacfba5b107e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:55.735661 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13552a70-7d10-4e98-9c80-ebc35535bd65 service neutron] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:55.736132 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13552a70-7d10-4e98-9c80-ebc35535bd65 service neutron] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:55.736809 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13552a70-7d10-4e98-9c80-ebc35535bd65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:55.739935 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-13552a70-7d10-4e98-9c80-ebc35535bd65 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:55.772446 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-9d6ba31d-b933-4649-b7a8-ceed2c630cd7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ec28d6b21de48559c31abff946c0a4d'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:55.798152 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 646/1323] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Oct 14 13:00:55 2022] DELETE /identity/v3/users/0ec28d6b21de48559c31abff946c0a4d => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:00:55.804948 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e82ea8-f0d8-44d1-9b7e-15b4acd506bc None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:55.807277 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13552a70-7d10-4e98-9c80-ebc35535bd65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:55.809410 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e82ea8-f0d8-44d1-9b7e-15b4acd506bc None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:55.809710 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e82ea8-f0d8-44d1-9b7e-15b4acd506bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:55.813225 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13552a70-7d10-4e98-9c80-ebc35535bd65 service neutron] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:55.849182 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 678/1324] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:00:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:00:55.885337 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-f1e82ea8-f0d8-44d1-9b7e-15b4acd506bc None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:00:55.886744 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-f1e82ea8-f0d8-44d1-9b7e-15b4acd506bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:56.024598 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 647/1325] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:00:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:00:56.043687 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13552a70-7d10-4e98-9c80-ebc35535bd65 service neutron] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:56.046044 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-13552a70-7d10-4e98-9c80-ebc35535bd65 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:56.068728 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13552a70-7d10-4e98-9c80-ebc35535bd65 service neutron] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:56.098932 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:00:56.225099 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13197d52-4104-4bbc-855f-219ecba603cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d483292f3a4794848fcacfba5b107e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:56.225748 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13197d52-4104-4bbc-855f-219ecba603cc service neutron] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:56.226342 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13197d52-4104-4bbc-855f-219ecba603cc service neutron] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:56.226679 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13197d52-4104-4bbc-855f-219ecba603cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:56.248693 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13197d52-4104-4bbc-855f-219ecba603cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:56.250856 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13197d52-4104-4bbc-855f-219ecba603cc service neutron] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:56.279699 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 679/1326] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:00:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:00:57.407766 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e82ea8-f0d8-44d1-9b7e-15b4acd506bc None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:57.410484 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-f1e82ea8-f0d8-44d1-9b7e-15b4acd506bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:57.428696 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e82ea8-f0d8-44d1-9b7e-15b4acd506bc None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:57.435934 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0800ae4-5762-420e-8a38-99d9ff0dc93f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:57.436889 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0800ae4-5762-420e-8a38-99d9ff0dc93f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:57.437582 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0800ae4-5762-420e-8a38-99d9ff0dc93f admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:57.438148 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0800ae4-5762-420e-8a38-99d9ff0dc93f admin admin] PATH_INFO: `/v3/projects/09fc956544ba4fe69dbc865e02f4f997` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:57.444606 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0800ae4-5762-420e-8a38-99d9ff0dc93f admin admin] RBAC: Authorizing `identity:delete_project(project_id=09fc956544ba4fe69dbc865e02f4f997)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:57.446741 dv-cinder-820994-7-smb devstack@keystone.service[81439]: WARNING py.warnings [None req-a0800ae4-5762-420e-8a38-99d9ff0dc93f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 14 13:00:57.446741 dv-cinder-820994-7-smb devstack@keystone.service[81439]: warnings.warn(msg) Oct 14 13:00:57.446741 dv-cinder-820994-7-smb devstack@keystone.service[81439]: Oct 14 13:00:57.449929 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0800ae4-5762-420e-8a38-99d9ff0dc93f admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:57.509182 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13197d52-4104-4bbc-855f-219ecba603cc service neutron] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:57.511024 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-13197d52-4104-4bbc-855f-219ecba603cc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:57.535291 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13197d52-4104-4bbc-855f-219ecba603cc service neutron] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:57.550882 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c554eecd-7014-4c96-b355-f8d04824317c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:57.551833 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c554eecd-7014-4c96-b355-f8d04824317c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:57.552120 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c554eecd-7014-4c96-b355-f8d04824317c admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:57.552462 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c554eecd-7014-4c96-b355-f8d04824317c admin admin] PATH_INFO: `/v3/users/d3d7326b2e77497b94954638ca939fc1` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:57.555508 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c554eecd-7014-4c96-b355-f8d04824317c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3d7326b2e77497b94954638ca939fc1)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:57.558383 dv-cinder-820994-7-smb devstack@keystone.service[81438]: WARNING py.warnings [None req-c554eecd-7014-4c96-b355-f8d04824317c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 14 13:00:57.558383 dv-cinder-820994-7-smb devstack@keystone.service[81438]: warnings.warn(msg) Oct 14 13:00:57.558383 dv-cinder-820994-7-smb devstack@keystone.service[81438]: Oct 14 13:00:57.564666 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c554eecd-7014-4c96-b355-f8d04824317c admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:57.668944 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-a0800ae4-5762-420e-8a38-99d9ff0dc93f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09fc956544ba4fe69dbc865e02f4f997', 'request_id': 'req-a0800ae4-5762-420e-8a38-99d9ff0dc93f'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:57.714328 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-a0800ae4-5762-420e-8a38-99d9ff0dc93f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09fc956544ba4fe69dbc865e02f4f997', 'request_id': 'req-a0800ae4-5762-420e-8a38-99d9ff0dc93f'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:57.744038 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-c554eecd-7014-4c96-b355-f8d04824317c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3d7326b2e77497b94954638ca939fc1'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:57.757694 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:00:57.807268 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-a0800ae4-5762-420e-8a38-99d9ff0dc93f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09fc956544ba4fe69dbc865e02f4f997', 'request_id': 'req-a0800ae4-5762-420e-8a38-99d9ff0dc93f'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:57.812958 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-c554eecd-7014-4c96-b355-f8d04824317c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3d7326b2e77497b94954638ca939fc1'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:57.816840 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-c554eecd-7014-4c96-b355-f8d04824317c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3d7326b2e77497b94954638ca939fc1'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:57.838593 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-c554eecd-7014-4c96-b355-f8d04824317c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3d7326b2e77497b94954638ca939fc1'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:57.850471 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-a0800ae4-5762-420e-8a38-99d9ff0dc93f admin admin] The token cache is being invalidate because project 09fc956544ba4fe69dbc865e02f4f997 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:00:57.851371 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-a0800ae4-5762-420e-8a38-99d9ff0dc93f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:57.853574 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-a0800ae4-5762-420e-8a38-99d9ff0dc93f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:57.860705 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 648/1327] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Oct 14 13:00:57 2022] DELETE /identity/v3/projects/09fc956544ba4fe69dbc865e02f4f997 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:00:57.864772 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0800ae4-5762-420e-8a38-99d9ff0dc93f admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:57.867221 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-a0800ae4-5762-420e-8a38-99d9ff0dc93f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:57.895398 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-c554eecd-7014-4c96-b355-f8d04824317c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3d7326b2e77497b94954638ca939fc1'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:57.921359 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 680/1328] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Oct 14 13:00:57 2022] DELETE /identity/v3/users/d3d7326b2e77497b94954638ca939fc1 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:00:57.926732 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f825ff-d265-4908-8996-c6ce80711019 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:57.927255 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f825ff-d265-4908-8996-c6ce80711019 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:57.927885 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f825ff-d265-4908-8996-c6ce80711019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:58.008290 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-a2f825ff-d265-4908-8996-c6ce80711019 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:00:58.011936 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-a2f825ff-d265-4908-8996-c6ce80711019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:58.123855 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0800ae4-5762-420e-8a38-99d9ff0dc93f admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:58.191511 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 681/1329] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:00:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:00:58.193446 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f825ff-d265-4908-8996-c6ce80711019 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:58.196193 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-a2f825ff-d265-4908-8996-c6ce80711019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:58.220455 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f825ff-d265-4908-8996-c6ce80711019 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:58.232212 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6533a05-af72-4ff8-846a-6c9bf974222d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:58.233171 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6533a05-af72-4ff8-846a-6c9bf974222d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:58.236329 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6533a05-af72-4ff8-846a-6c9bf974222d admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:58.238991 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6533a05-af72-4ff8-846a-6c9bf974222d admin admin] PATH_INFO: `/v3/projects/af5c5078c6d44b96b690ddb84340a8ba` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:58.244146 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6533a05-af72-4ff8-846a-6c9bf974222d admin admin] RBAC: Authorizing `identity:delete_project(project_id=af5c5078c6d44b96b690ddb84340a8ba)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:58.252646 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6533a05-af72-4ff8-846a-6c9bf974222d admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:58.375885 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:00:58.408289 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545f8688-8980-4907-a617-92d593059448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:58.409194 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545f8688-8980-4907-a617-92d593059448 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:58.409855 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545f8688-8980-4907-a617-92d593059448 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:58.410829 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545f8688-8980-4907-a617-92d593059448 admin admin] PATH_INFO: `/v3/users/163e74000f4f4d4e87e093ca56f9f9be` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:58.413241 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545f8688-8980-4907-a617-92d593059448 admin admin] RBAC: Authorizing `identity:delete_user(user_id=163e74000f4f4d4e87e093ca56f9f9be)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:58.438293 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545f8688-8980-4907-a617-92d593059448 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:58.454993 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-d6533a05-af72-4ff8-846a-6c9bf974222d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af5c5078c6d44b96b690ddb84340a8ba', 'request_id': 'req-d6533a05-af72-4ff8-846a-6c9bf974222d'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:58.493557 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-d6533a05-af72-4ff8-846a-6c9bf974222d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af5c5078c6d44b96b690ddb84340a8ba', 'request_id': 'req-d6533a05-af72-4ff8-846a-6c9bf974222d'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:58.512605 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-d6533a05-af72-4ff8-846a-6c9bf974222d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af5c5078c6d44b96b690ddb84340a8ba', 'request_id': 'req-d6533a05-af72-4ff8-846a-6c9bf974222d'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:58.562593 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-545f8688-8980-4907-a617-92d593059448 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '163e74000f4f4d4e87e093ca56f9f9be'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:58.586740 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-d6533a05-af72-4ff8-846a-6c9bf974222d admin admin] The token cache is being invalidate because project af5c5078c6d44b96b690ddb84340a8ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:00:58.587028 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-d6533a05-af72-4ff8-846a-6c9bf974222d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:58.590913 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-d6533a05-af72-4ff8-846a-6c9bf974222d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:58.602497 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 682/1330] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Oct 14 13:00:58 2022] DELETE /identity/v3/projects/af5c5078c6d44b96b690ddb84340a8ba => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:00:58.603802 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6533a05-af72-4ff8-846a-6c9bf974222d admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:58.611872 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-d6533a05-af72-4ff8-846a-6c9bf974222d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:58.619206 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-545f8688-8980-4907-a617-92d593059448 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '163e74000f4f4d4e87e093ca56f9f9be'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:58.624119 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-545f8688-8980-4907-a617-92d593059448 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '163e74000f4f4d4e87e093ca56f9f9be'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:58.642316 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-545f8688-8980-4907-a617-92d593059448 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '163e74000f4f4d4e87e093ca56f9f9be'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:58.700205 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-545f8688-8980-4907-a617-92d593059448 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '163e74000f4f4d4e87e093ca56f9f9be'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:58.727570 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 649/1331] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Oct 14 13:00:57 2022] DELETE /identity/v3/users/163e74000f4f4d4e87e093ca56f9f9be => generated 0 bytes in 863 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 13:00:58.728646 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545f8688-8980-4907-a617-92d593059448 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:00:58.732315 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-545f8688-8980-4907-a617-92d593059448 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:58.805649 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6533a05-af72-4ff8-846a-6c9bf974222d admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:58.814479 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:00:58.930467 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545f8688-8980-4907-a617-92d593059448 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:00:58.950792 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c3310b-6864-4161-8c34-b0cce56b5f9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:58.951594 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c3310b-6864-4161-8c34-b0cce56b5f9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:58.951886 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c3310b-6864-4161-8c34-b0cce56b5f9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:58.952269 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c3310b-6864-4161-8c34-b0cce56b5f9c admin admin] PATH_INFO: `/v3/users/2936c4e88540487f96d8ae1447dc4d4c` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:58.955375 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c3310b-6864-4161-8c34-b0cce56b5f9c admin admin] RBAC: Authorizing `identity:delete_user(user_id=2936c4e88540487f96d8ae1447dc4d4c)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:58.956356 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612bb0e7-89d5-4c9c-a94f-0239c67bf40f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d483292f3a4794848fcacfba5b107e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:00:58.957109 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612bb0e7-89d5-4c9c-a94f-0239c67bf40f service neutron] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:00:58.957359 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c3310b-6864-4161-8c34-b0cce56b5f9c admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:58.961575 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612bb0e7-89d5-4c9c-a94f-0239c67bf40f service neutron] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:00:58.961898 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612bb0e7-89d5-4c9c-a94f-0239c67bf40f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:00:58.967285 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-612bb0e7-89d5-4c9c-a94f-0239c67bf40f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:00:58.998082 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612bb0e7-89d5-4c9c-a94f-0239c67bf40f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:00:58.999651 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612bb0e7-89d5-4c9c-a94f-0239c67bf40f service neutron] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:00:59.013791 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 683/1332] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:00:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:00:59.079548 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-c3c3310b-6864-4161-8c34-b0cce56b5f9c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2936c4e88540487f96d8ae1447dc4d4c'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:59.103427 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-c3c3310b-6864-4161-8c34-b0cce56b5f9c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2936c4e88540487f96d8ae1447dc4d4c'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:59.105394 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-c3c3310b-6864-4161-8c34-b0cce56b5f9c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2936c4e88540487f96d8ae1447dc4d4c'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:59.122482 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-c3c3310b-6864-4161-8c34-b0cce56b5f9c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2936c4e88540487f96d8ae1447dc4d4c'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:59.152922 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-c3c3310b-6864-4161-8c34-b0cce56b5f9c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2936c4e88540487f96d8ae1447dc4d4c'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:00:59.168439 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 650/1333] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Oct 14 13:00:58 2022] DELETE /identity/v3/users/2936c4e88540487f96d8ae1447dc4d4c => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:01:00.996249 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612bb0e7-89d5-4c9c-a94f-0239c67bf40f service neutron] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:00.998385 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-612bb0e7-89d5-4c9c-a94f-0239c67bf40f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:01.025423 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612bb0e7-89d5-4c9c-a94f-0239c67bf40f service neutron] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:01.179466 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22464320-390a-464a-a287-11b160826edf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:01.182932 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22464320-390a-464a-a287-11b160826edf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:01.183217 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22464320-390a-464a-a287-11b160826edf admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:01.183498 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22464320-390a-464a-a287-11b160826edf admin admin] PATH_INFO: `/v3/projects/4da3c87132b3437c8f900480e2f1af26` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:01.186429 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22464320-390a-464a-a287-11b160826edf admin admin] RBAC: Authorizing `identity:delete_project(project_id=4da3c87132b3437c8f900480e2f1af26)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:01.191812 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22464320-390a-464a-a287-11b160826edf admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:01.225755 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:01:01.351263 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-22464320-390a-464a-a287-11b160826edf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4da3c87132b3437c8f900480e2f1af26', 'request_id': 'req-22464320-390a-464a-a287-11b160826edf'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:01.386869 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-22464320-390a-464a-a287-11b160826edf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4da3c87132b3437c8f900480e2f1af26', 'request_id': 'req-22464320-390a-464a-a287-11b160826edf'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:01.420906 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-22464320-390a-464a-a287-11b160826edf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4da3c87132b3437c8f900480e2f1af26', 'request_id': 'req-22464320-390a-464a-a287-11b160826edf'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:01.439919 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c3310b-6864-4161-8c34-b0cce56b5f9c admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:01.442075 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-c3c3310b-6864-4161-8c34-b0cce56b5f9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:01.518027 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-22464320-390a-464a-a287-11b160826edf admin admin] The token cache is being invalidate because project 4da3c87132b3437c8f900480e2f1af26 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:01:01.519762 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-22464320-390a-464a-a287-11b160826edf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:01.525102 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-22464320-390a-464a-a287-11b160826edf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:01.536560 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 684/1334] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Oct 14 13:01:00 2022] DELETE /identity/v3/projects/4da3c87132b3437c8f900480e2f1af26 => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:01:01.537763 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c3310b-6864-4161-8c34-b0cce56b5f9c admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:01.541573 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de39e89-c60c-40ab-a694-df6f43e9932b None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:01.541852 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de39e89-c60c-40ab-a694-df6f43e9932b None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:01.543079 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de39e89-c60c-40ab-a694-df6f43e9932b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:01.618517 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-7de39e89-c60c-40ab-a694-df6f43e9932b None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:01:01.619781 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-7de39e89-c60c-40ab-a694-df6f43e9932b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:01.699012 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fe508e-31d3-4a10-af20-5129b06e45b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:01.702892 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fe508e-31d3-4a10-af20-5129b06e45b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:01.703285 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fe508e-31d3-4a10-af20-5129b06e45b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:01.703563 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fe508e-31d3-4a10-af20-5129b06e45b2 admin admin] PATH_INFO: `/v3/projects/2f35a0759b36499ca0a4d94b748cc789` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:01.708707 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fe508e-31d3-4a10-af20-5129b06e45b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f35a0759b36499ca0a4d94b748cc789)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:01.710731 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fe508e-31d3-4a10-af20-5129b06e45b2 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:01.812535 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 685/1335] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:01:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:01:01.822504 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f92091-048e-4ca2-b142-373c7b9d5826 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:01.822813 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f92091-048e-4ca2-b142-373c7b9d5826 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:01.823149 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f92091-048e-4ca2-b142-373c7b9d5826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:01.846193 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:01:01.853311 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-46f92091-048e-4ca2-b142-373c7b9d5826 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:01:01.855265 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-46f92091-048e-4ca2-b142-373c7b9d5826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:01.872484 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-44fe508e-31d3-4a10-af20-5129b06e45b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f35a0759b36499ca0a4d94b748cc789', 'request_id': 'req-44fe508e-31d3-4a10-af20-5129b06e45b2'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:01.895915 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-44fe508e-31d3-4a10-af20-5129b06e45b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f35a0759b36499ca0a4d94b748cc789', 'request_id': 'req-44fe508e-31d3-4a10-af20-5129b06e45b2'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:01.912382 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-44fe508e-31d3-4a10-af20-5129b06e45b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f35a0759b36499ca0a4d94b748cc789', 'request_id': 'req-44fe508e-31d3-4a10-af20-5129b06e45b2'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:01.951298 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-44fe508e-31d3-4a10-af20-5129b06e45b2 admin admin] The token cache is being invalidate because project 2f35a0759b36499ca0a4d94b748cc789 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:01:01.954391 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-44fe508e-31d3-4a10-af20-5129b06e45b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:01.962618 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-44fe508e-31d3-4a10-af20-5129b06e45b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:01.966490 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 651/1336] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Oct 14 13:01:01 2022] DELETE /identity/v3/projects/2f35a0759b36499ca0a4d94b748cc789 => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 13:01:01.972115 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422303b1-8555-494c-8ac4-50259af8ac4f None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:01.972407 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422303b1-8555-494c-8ac4-50259af8ac4f None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:01.972685 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422303b1-8555-494c-8ac4-50259af8ac4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:01.976562 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 686/1337] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:01:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:01:01.982806 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f92091-048e-4ca2-b142-373c7b9d5826 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:02.009026 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f92091-048e-4ca2-b142-373c7b9d5826 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:02.023255 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-422303b1-8555-494c-8ac4-50259af8ac4f None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:01:02.025131 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-422303b1-8555-494c-8ac4-50259af8ac4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:02.031100 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bebd6ef-ac03-4f0b-b8f6-75e9f8706450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:02.031976 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bebd6ef-ac03-4f0b-b8f6-75e9f8706450 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:02.032274 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bebd6ef-ac03-4f0b-b8f6-75e9f8706450 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:02.032811 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bebd6ef-ac03-4f0b-b8f6-75e9f8706450 admin admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:02.033581 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bebd6ef-ac03-4f0b-b8f6-75e9f8706450 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 13:01:02.033895 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bebd6ef-ac03-4f0b-b8f6-75e9f8706450 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:02.037054 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bebd6ef-ac03-4f0b-b8f6-75e9f8706450 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:02.053101 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 652/1338] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:01:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:01:02.062253 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d66f299-69f6-493b-94cf-d967f83d8e1c None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:02.062652 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d66f299-69f6-493b-94cf-d967f83d8e1c None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:02.063039 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d66f299-69f6-493b-94cf-d967f83d8e1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:02.067598 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 687/1339] 10.222.0.17 () {58 vars in 1153 bytes} [Fri Oct 14 13:01:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 13:01:02.071837 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bebd6ef-ac03-4f0b-b8f6-75e9f8706450 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:02.101118 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-4d66f299-69f6-493b-94cf-d967f83d8e1c None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:01:02.103243 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bebd6ef-ac03-4f0b-b8f6-75e9f8706450 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:02.106579 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-4d66f299-69f6-493b-94cf-d967f83d8e1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:02.118678 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfeaacba-9496-49a7-8337-18a8546fb37d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:02.119300 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeaacba-9496-49a7-8337-18a8546fb37d admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:02.119580 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeaacba-9496-49a7-8337-18a8546fb37d admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:02.119853 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeaacba-9496-49a7-8337-18a8546fb37d admin admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:02.120598 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfeaacba-9496-49a7-8337-18a8546fb37d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:02.124132 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfeaacba-9496-49a7-8337-18a8546fb37d admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:02.146347 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 653/1340] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:01:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:01:02.147394 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d66f299-69f6-493b-94cf-d967f83d8e1c None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:02.170401 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d66f299-69f6-493b-94cf-d967f83d8e1c None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:02.186241 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5351ce4c-44ac-407a-9e95-2fef2bca63c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:02.187550 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5351ce4c-44ac-407a-9e95-2fef2bca63c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:02.187941 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5351ce4c-44ac-407a-9e95-2fef2bca63c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:02.188432 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5351ce4c-44ac-407a-9e95-2fef2bca63c1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:02.188882 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 688/1341] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Oct 14 13:01:02 2022] POST /identity/v3/projects => generated 405 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 13:01:02.189256 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5351ce4c-44ac-407a-9e95-2fef2bca63c1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 13:01:02.189773 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5351ce4c-44ac-407a-9e95-2fef2bca63c1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:02.191376 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5351ce4c-44ac-407a-9e95-2fef2bca63c1 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:02.200697 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfeaacba-9496-49a7-8337-18a8546fb37d admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:02.228655 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:01:02.229112 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 654/1342] 10.222.0.17 () {58 vars in 1153 bytes} [Fri Oct 14 13:01:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 13:01:02.230107 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5351ce4c-44ac-407a-9e95-2fef2bca63c1 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:02.253353 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5351ce4c-44ac-407a-9e95-2fef2bca63c1 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:02.402013 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfeaacba-9496-49a7-8337-18a8546fb37d admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:02.426944 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02396d1-e9fb-4a35-90c4-59b30e828863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:02.427584 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02396d1-e9fb-4a35-90c4-59b30e828863 admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:02.427865 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02396d1-e9fb-4a35-90c4-59b30e828863 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:02.428134 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02396d1-e9fb-4a35-90c4-59b30e828863 admin admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:02.428775 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02396d1-e9fb-4a35-90c4-59b30e828863 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:02.430772 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02396d1-e9fb-4a35-90c4-59b30e828863 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:02.472549 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e437c5dc-7d25-486b-98c8-45549489aa16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:02.473941 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e437c5dc-7d25-486b-98c8-45549489aa16 admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:02.476268 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e437c5dc-7d25-486b-98c8-45549489aa16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:02.476831 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e437c5dc-7d25-486b-98c8-45549489aa16 admin admin] PATH_INFO: `/v3/projects` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:02.477811 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e437c5dc-7d25-486b-98c8-45549489aa16 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:02.487809 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e437c5dc-7d25-486b-98c8-45549489aa16 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:02.506247 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 689/1343] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Oct 14 13:01:02 2022] POST /identity/v3/users => generated 303 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:01:02.508447 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02396d1-e9fb-4a35-90c4-59b30e828863 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:02.536329 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02396d1-e9fb-4a35-90c4-59b30e828863 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:02.558209 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd94ffe-12df-45e5-b37f-eeec43fd477e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:02.558877 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd94ffe-12df-45e5-b37f-eeec43fd477e admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:02.559161 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd94ffe-12df-45e5-b37f-eeec43fd477e admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:02.559436 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd94ffe-12df-45e5-b37f-eeec43fd477e admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:02.560092 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd94ffe-12df-45e5-b37f-eeec43fd477e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:02.561743 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd94ffe-12df-45e5-b37f-eeec43fd477e admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:02.568591 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 655/1344] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Oct 14 13:01:02 2022] POST /identity/v3/projects => generated 375 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:01:02.570074 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e437c5dc-7d25-486b-98c8-45549489aa16 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:02.589688 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 690/1345] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:01:02 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:01:02.598189 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd94ffe-12df-45e5-b37f-eeec43fd477e admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:02.619668 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd94ffe-12df-45e5-b37f-eeec43fd477e admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:02.741060 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e437c5dc-7d25-486b-98c8-45549489aa16 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:02.749813 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b43a4e-7f97-47cc-8907-50158bef85a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:02.750719 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b43a4e-7f97-47cc-8907-50158bef85a6 admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:02.751162 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b43a4e-7f97-47cc-8907-50158bef85a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:02.751617 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b43a4e-7f97-47cc-8907-50158bef85a6 admin admin] PATH_INFO: `/v3/users` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:02.752457 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b43a4e-7f97-47cc-8907-50158bef85a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:02.754696 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b43a4e-7f97-47cc-8907-50158bef85a6 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:02.783035 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f649afe-8279-44dd-877e-c6c50a11ee03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:02.783997 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f649afe-8279-44dd-877e-c6c50a11ee03 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:02.784533 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f649afe-8279-44dd-877e-c6c50a11ee03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:02.785026 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f649afe-8279-44dd-877e-c6c50a11ee03 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:02.798282 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f649afe-8279-44dd-877e-c6c50a11ee03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:02.800534 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f649afe-8279-44dd-877e-c6c50a11ee03 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:02.813088 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 656/1346] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Oct 14 13:01:02 2022] POST /identity/v3/users => generated 288 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:01:02.814005 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b43a4e-7f97-47cc-8907-50158bef85a6 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:02.820202 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-06b43a4e-7f97-47cc-8907-50158bef85a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:02.833570 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 691/1347] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:01:02 2022] GET /identity/v3/roles => generated 1420 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:01:02.838064 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f649afe-8279-44dd-877e-c6c50a11ee03 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:02.842796 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b43a4e-7f97-47cc-8907-50158bef85a6 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:02.854220 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f649afe-8279-44dd-877e-c6c50a11ee03 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:02.855047 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106ea0dc-974b-4455-a941-80ca4b1f3e52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:02.855702 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106ea0dc-974b-4455-a941-80ca4b1f3e52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:02.855982 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106ea0dc-974b-4455-a941-80ca4b1f3e52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:02.856257 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106ea0dc-974b-4455-a941-80ca4b1f3e52 admin admin] PATH_INFO: `/v3/projects/a38261dcabd44b65831b9a4d60f26159` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:02.861281 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106ea0dc-974b-4455-a941-80ca4b1f3e52 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a38261dcabd44b65831b9a4d60f26159)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:02.862959 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106ea0dc-974b-4455-a941-80ca4b1f3e52 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:02.874357 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:01:02.882965 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec0d895-be7e-4918-ae22-dc96678dcc5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:02.883876 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec0d895-be7e-4918-ae22-dc96678dcc5f admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:02.884261 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec0d895-be7e-4918-ae22-dc96678dcc5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:02.884724 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec0d895-be7e-4918-ae22-dc96678dcc5f admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:02.886555 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec0d895-be7e-4918-ae22-dc96678dcc5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:02.889064 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec0d895-be7e-4918-ae22-dc96678dcc5f admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:02.905002 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 692/1348] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:01:02 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:01:02.906944 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec0d895-be7e-4918-ae22-dc96678dcc5f admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:02.929556 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec0d895-be7e-4918-ae22-dc96678dcc5f admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:02.947245 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33568a75-3248-4bfc-9092-2042975ccd5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:02.956067 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33568a75-3248-4bfc-9092-2042975ccd5d admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:02.956644 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33568a75-3248-4bfc-9092-2042975ccd5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:02.957942 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33568a75-3248-4bfc-9092-2042975ccd5d admin admin] PATH_INFO: `/v3/projects/231d3ca5af264c608e40702ddd7df172/users/ac6f9d410e524c40acedd10d5a9430ba/roles/5e8849303a75425b9eaa2681cc031af1` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:02.964406 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-106ea0dc-974b-4455-a941-80ca4b1f3e52 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a38261dcabd44b65831b9a4d60f26159', 'request_id': 'req-106ea0dc-974b-4455-a941-80ca4b1f3e52'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:02.976892 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-106ea0dc-974b-4455-a941-80ca4b1f3e52 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a38261dcabd44b65831b9a4d60f26159', 'request_id': 'req-106ea0dc-974b-4455-a941-80ca4b1f3e52'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:02.995365 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33568a75-3248-4bfc-9092-2042975ccd5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=231d3ca5af264c608e40702ddd7df172, user_id=ac6f9d410e524c40acedd10d5a9430ba, role_id=5e8849303a75425b9eaa2681cc031af1)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:02.998489 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-106ea0dc-974b-4455-a941-80ca4b1f3e52 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a38261dcabd44b65831b9a4d60f26159', 'request_id': 'req-106ea0dc-974b-4455-a941-80ca4b1f3e52'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:03.009275 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33568a75-3248-4bfc-9092-2042975ccd5d admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:03.023586 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-106ea0dc-974b-4455-a941-80ca4b1f3e52 admin admin] The token cache is being invalidate because project a38261dcabd44b65831b9a4d60f26159 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:01:03.023883 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-106ea0dc-974b-4455-a941-80ca4b1f3e52 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:03.024621 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-106ea0dc-974b-4455-a941-80ca4b1f3e52 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:03.026204 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 657/1349] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Oct 14 13:01:02 2022] DELETE /identity/v3/projects/a38261dcabd44b65831b9a4d60f26159 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:01:03.027054 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106ea0dc-974b-4455-a941-80ca4b1f3e52 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:03.031400 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-106ea0dc-974b-4455-a941-80ca4b1f3e52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:03.063965 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 693/1350] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Oct 14 13:01:02 2022] PUT /identity/v3/projects/231d3ca5af264c608e40702ddd7df172/users/ac6f9d410e524c40acedd10d5a9430ba/roles/5e8849303a75425b9eaa2681cc031af1 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:01:03.071606 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b76573-5a57-4b67-8a7f-32427ad18e43 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:03.071896 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b76573-5a57-4b67-8a7f-32427ad18e43 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:03.072175 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b76573-5a57-4b67-8a7f-32427ad18e43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:03.102174 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-42b76573-5a57-4b67-8a7f-32427ad18e43 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:01:03.105644 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-42b76573-5a57-4b67-8a7f-32427ad18e43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:03.186318 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106ea0dc-974b-4455-a941-80ca4b1f3e52 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:03.236985 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:01:03.309899 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 694/1351] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:01:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:01:03.311501 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdb43a5-0c9d-48c8-b3cd-bba27389259b None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:03.311859 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdb43a5-0c9d-48c8-b3cd-bba27389259b None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:03.312796 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdb43a5-0c9d-48c8-b3cd-bba27389259b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:03.366212 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-2cdb43a5-0c9d-48c8-b3cd-bba27389259b None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:01:03.367503 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-2cdb43a5-0c9d-48c8-b3cd-bba27389259b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:03.379947 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02c0824-8d9c-4fcf-8798-5561ed52907b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:03.380595 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02c0824-8d9c-4fcf-8798-5561ed52907b admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:03.380879 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02c0824-8d9c-4fcf-8798-5561ed52907b admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:03.381150 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02c0824-8d9c-4fcf-8798-5561ed52907b admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:03.384886 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02c0824-8d9c-4fcf-8798-5561ed52907b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:03.384886 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02c0824-8d9c-4fcf-8798-5561ed52907b admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:03.386723 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 695/1352] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:01:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:01:03.388673 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b6c569-b4ac-448c-81fc-7d427736d864 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:03.389193 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b6c569-b4ac-448c-81fc-7d427736d864 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:03.389687 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b6c569-b4ac-448c-81fc-7d427736d864 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:03.417188 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 658/1353] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:01:03 2022] GET /identity/v3/roles => generated 1420 bytes in 390 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:01:03.418792 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc40cd9-6f6a-4584-b9e3-501cc32e3d72 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:03.419085 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc40cd9-6f6a-4584-b9e3-501cc32e3d72 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:03.419366 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc40cd9-6f6a-4584-b9e3-501cc32e3d72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:03.442201 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-a9b6c569-b4ac-448c-81fc-7d427736d864 None None] MFA Rules not processed for user `a1b9ec5c477d4f01aa2ad5f634e5f73a`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:01:03.446596 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-a9b6c569-b4ac-448c-81fc-7d427736d864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:03.477355 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-1dc40cd9-6f6a-4584-b9e3-501cc32e3d72 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:01:03.478745 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-1dc40cd9-6f6a-4584-b9e3-501cc32e3d72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:03.503783 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 659/1354] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:01:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:01:03.508222 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc40cd9-6f6a-4584-b9e3-501cc32e3d72 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:03.524006 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc40cd9-6f6a-4584-b9e3-501cc32e3d72 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:03.537096 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38152b1c-c17a-4677-a179-75cdda18ced9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:03.537799 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38152b1c-c17a-4677-a179-75cdda18ced9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:03.538061 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38152b1c-c17a-4677-a179-75cdda18ced9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:03.538376 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38152b1c-c17a-4677-a179-75cdda18ced9 admin admin] PATH_INFO: `/v3/projects/2f77c558e7014f638c40f32989c20492/users/f40545d3e6194632ab657901b6a57d41/roles/5e8849303a75425b9eaa2681cc031af1` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:03.569936 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38152b1c-c17a-4677-a179-75cdda18ced9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f77c558e7014f638c40f32989c20492, user_id=f40545d3e6194632ab657901b6a57d41, role_id=5e8849303a75425b9eaa2681cc031af1)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:03.572691 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38152b1c-c17a-4677-a179-75cdda18ced9 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:03.602277 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 660/1355] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Oct 14 13:01:03 2022] PUT /identity/v3/projects/2f77c558e7014f638c40f32989c20492/users/f40545d3e6194632ab657901b6a57d41/roles/5e8849303a75425b9eaa2681cc031af1 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:01:03.613142 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38152b1c-c17a-4677-a179-75cdda18ced9 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:03.641661 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:01:03.658310 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 696/1356] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:01:03 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:01:03.660698 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db442a1-fd68-4eed-8b63-97a4acdfdd1c None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:03.661096 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db442a1-fd68-4eed-8b63-97a4acdfdd1c None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:03.662424 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db442a1-fd68-4eed-8b63-97a4acdfdd1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:03.723372 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-9db442a1-fd68-4eed-8b63-97a4acdfdd1c None None] MFA Rules not processed for user `f40545d3e6194632ab657901b6a57d41`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:01:03.725476 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-9db442a1-fd68-4eed-8b63-97a4acdfdd1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:03.807195 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38152b1c-c17a-4677-a179-75cdda18ced9 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:03.824028 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39c08da-f2ee-47a5-b8f1-25ffbbc709b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:03.825169 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39c08da-f2ee-47a5-b8f1-25ffbbc709b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:03.825464 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39c08da-f2ee-47a5-b8f1-25ffbbc709b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:03.825743 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39c08da-f2ee-47a5-b8f1-25ffbbc709b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:03.826710 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39c08da-f2ee-47a5-b8f1-25ffbbc709b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 13:01:03.827071 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39c08da-f2ee-47a5-b8f1-25ffbbc709b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:03.830416 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39c08da-f2ee-47a5-b8f1-25ffbbc709b7 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:03.860885 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 661/1357] 10.222.0.17 () {58 vars in 1153 bytes} [Fri Oct 14 13:01:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 13:01:03.861107 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 697/1358] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:01:03 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:01:03.861212 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39c08da-f2ee-47a5-b8f1-25ffbbc709b7 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:03.861305 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db442a1-fd68-4eed-8b63-97a4acdfdd1c None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:03.861305 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-9db442a1-fd68-4eed-8b63-97a4acdfdd1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:03.861470 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-b39c08da-f2ee-47a5-b8f1-25ffbbc709b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:03.971713 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39c08da-f2ee-47a5-b8f1-25ffbbc709b7 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:03.982514 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa8bac2-e04d-40d9-b4e7-8c554a22345d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d483292f3a4794848fcacfba5b107e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:03.985525 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa8bac2-e04d-40d9-b4e7-8c554a22345d service neutron] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:03.986345 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa8bac2-e04d-40d9-b4e7-8c554a22345d service neutron] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:03.988306 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa8bac2-e04d-40d9-b4e7-8c554a22345d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:03.989918 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:01:04.013049 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa8bac2-e04d-40d9-b4e7-8c554a22345d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:04.015027 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa8bac2-e04d-40d9-b4e7-8c554a22345d service neutron] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:04.019144 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db442a1-fd68-4eed-8b63-97a4acdfdd1c None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:04.035539 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e1de03-61b1-4cba-8bc2-8ca1b38a46ac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '931f4e32c8764514b5efed31b0785be7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:04.037752 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e1de03-61b1-4cba-8bc2-8ca1b38a46ac service nova] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:04.038051 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e1de03-61b1-4cba-8bc2-8ca1b38a46ac service nova] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:04.038349 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e1de03-61b1-4cba-8bc2-8ca1b38a46ac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:04.052920 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 662/1359] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:01:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:01:04.053832 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa8bac2-e04d-40d9-b4e7-8c554a22345d service neutron] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:04.059062 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-ffa8bac2-e04d-40d9-b4e7-8c554a22345d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:04.093467 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa8bac2-e04d-40d9-b4e7-8c554a22345d service neutron] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:04.110243 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466545dd-f56f-42d6-b96a-4280e869b2d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:04.111000 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466545dd-f56f-42d6-b96a-4280e869b2d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:04.111352 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466545dd-f56f-42d6-b96a-4280e869b2d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:04.111706 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466545dd-f56f-42d6-b96a-4280e869b2d0 admin admin] PATH_INFO: `/v3/users/50d96957c6794ac1bbc86765295a03eb` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:04.114220 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466545dd-f56f-42d6-b96a-4280e869b2d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=50d96957c6794ac1bbc86765295a03eb)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:04.119759 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466545dd-f56f-42d6-b96a-4280e869b2d0 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:04.189457 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e1de03-61b1-4cba-8bc2-8ca1b38a46ac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:04.192010 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e1de03-61b1-4cba-8bc2-8ca1b38a46ac service nova] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:04.216047 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 698/1360] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:01:03 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:01:04.217294 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e1de03-61b1-4cba-8bc2-8ca1b38a46ac service nova] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:04.243397 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e1de03-61b1-4cba-8bc2-8ca1b38a46ac service nova] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:04.258011 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-466545dd-f56f-42d6-b96a-4280e869b2d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50d96957c6794ac1bbc86765295a03eb'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:04.258314 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df80f1a7-24b1-40d3-9cdc-7a271d1620fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:04.258819 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df80f1a7-24b1-40d3-9cdc-7a271d1620fc admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:04.259169 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df80f1a7-24b1-40d3-9cdc-7a271d1620fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:04.259511 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df80f1a7-24b1-40d3-9cdc-7a271d1620fc admin admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:04.260225 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df80f1a7-24b1-40d3-9cdc-7a271d1620fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:04.262509 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df80f1a7-24b1-40d3-9cdc-7a271d1620fc admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:04.282727 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-466545dd-f56f-42d6-b96a-4280e869b2d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50d96957c6794ac1bbc86765295a03eb'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:04.284251 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-466545dd-f56f-42d6-b96a-4280e869b2d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50d96957c6794ac1bbc86765295a03eb'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:04.305100 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-466545dd-f56f-42d6-b96a-4280e869b2d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50d96957c6794ac1bbc86765295a03eb'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:04.317713 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 699/1361] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Oct 14 13:01:04 2022] POST /identity/v3/projects => generated 363 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:01:04.324363 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df80f1a7-24b1-40d3-9cdc-7a271d1620fc admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:04.324564 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-466545dd-f56f-42d6-b96a-4280e869b2d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50d96957c6794ac1bbc86765295a03eb'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:04.326175 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-df80f1a7-24b1-40d3-9cdc-7a271d1620fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:04.338797 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 663/1362] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Oct 14 13:01:04 2022] DELETE /identity/v3/users/50d96957c6794ac1bbc86765295a03eb => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:01:04.342938 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466545dd-f56f-42d6-b96a-4280e869b2d0 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:04.345856 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-466545dd-f56f-42d6-b96a-4280e869b2d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:04.383325 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:01:04.464879 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df80f1a7-24b1-40d3-9cdc-7a271d1620fc admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:04.471915 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466545dd-f56f-42d6-b96a-4280e869b2d0 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:04.475005 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6323e75-7f88-4389-94d4-30af08554e64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:04.475005 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6323e75-7f88-4389-94d4-30af08554e64 admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:04.475279 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6323e75-7f88-4389-94d4-30af08554e64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:04.475649 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6323e75-7f88-4389-94d4-30af08554e64 admin admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:04.476714 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6323e75-7f88-4389-94d4-30af08554e64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:04.478578 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6323e75-7f88-4389-94d4-30af08554e64 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:04.495444 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3845166a-3c59-4d0c-bba0-73c88b944e5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:04.497690 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3845166a-3c59-4d0c-bba0-73c88b944e5f admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:04.498923 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3845166a-3c59-4d0c-bba0-73c88b944e5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:04.500634 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3845166a-3c59-4d0c-bba0-73c88b944e5f admin admin] PATH_INFO: `/v3/users` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:04.502549 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3845166a-3c59-4d0c-bba0-73c88b944e5f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:04.509115 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3845166a-3c59-4d0c-bba0-73c88b944e5f admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:04.547227 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 700/1363] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Oct 14 13:01:04 2022] POST /identity/v3/projects => generated 375 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:01:04.549427 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992a3f30-cab5-4c00-849c-e4ab81d41323 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:04.549566 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992a3f30-cab5-4c00-849c-e4ab81d41323 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:04.552558 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992a3f30-cab5-4c00-849c-e4ab81d41323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:04.568030 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 664/1364] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Oct 14 13:01:04 2022] POST /identity/v3/users => generated 282 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:01:04.570438 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3845166a-3c59-4d0c-bba0-73c88b944e5f admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:04.599361 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3845166a-3c59-4d0c-bba0-73c88b944e5f admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:04.600196 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-992a3f30-cab5-4c00-849c-e4ab81d41323 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:01:04.601555 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-992a3f30-cab5-4c00-849c-e4ab81d41323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:04.711590 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:01:04.728622 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 701/1365] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:01:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:01:04.729745 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992a3f30-cab5-4c00-849c-e4ab81d41323 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:04.751210 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992a3f30-cab5-4c00-849c-e4ab81d41323 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:04.754451 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f6fb11-63cb-46ef-b288-7d627eccddc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:04.755221 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f6fb11-63cb-46ef-b288-7d627eccddc8 admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:04.755499 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f6fb11-63cb-46ef-b288-7d627eccddc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:04.755820 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f6fb11-63cb-46ef-b288-7d627eccddc8 admin admin] PATH_INFO: `/v3/users` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:04.756584 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f6fb11-63cb-46ef-b288-7d627eccddc8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:04.758580 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f6fb11-63cb-46ef-b288-7d627eccddc8 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:04.764054 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11222555-f7fe-4022-ab08-9ee4e0ba91e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:04.764584 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11222555-f7fe-4022-ab08-9ee4e0ba91e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:04.765686 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11222555-f7fe-4022-ab08-9ee4e0ba91e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:04.766185 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11222555-f7fe-4022-ab08-9ee4e0ba91e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:04.767046 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11222555-f7fe-4022-ab08-9ee4e0ba91e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:04.773134 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11222555-f7fe-4022-ab08-9ee4e0ba91e2 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:04.803582 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 665/1366] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Oct 14 13:01:04 2022] POST /identity/v3/users => generated 294 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:01:04.804473 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f6fb11-63cb-46ef-b288-7d627eccddc8 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:04.807460 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 702/1367] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:01:04 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:01:04.808323 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11222555-f7fe-4022-ab08-9ee4e0ba91e2 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:04.825352 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11222555-f7fe-4022-ab08-9ee4e0ba91e2 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:04.826658 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f6fb11-63cb-46ef-b288-7d627eccddc8 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:04.837624 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e59a31-4419-4e30-8c45-4783ec37c905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:04.838523 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e59a31-4419-4e30-8c45-4783ec37c905 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:04.838837 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e59a31-4419-4e30-8c45-4783ec37c905 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:04.839297 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e59a31-4419-4e30-8c45-4783ec37c905 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:04.840056 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e59a31-4419-4e30-8c45-4783ec37c905 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:04.840983 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d33368-a9f6-4290-afee-caa3294c7deb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:04.841754 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d33368-a9f6-4290-afee-caa3294c7deb admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:04.841867 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d33368-a9f6-4290-afee-caa3294c7deb admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:04.842163 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d33368-a9f6-4290-afee-caa3294c7deb admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:04.842811 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d33368-a9f6-4290-afee-caa3294c7deb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:04.844539 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e59a31-4419-4e30-8c45-4783ec37c905 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:04.845016 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d33368-a9f6-4290-afee-caa3294c7deb admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:04.873914 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 666/1369] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:01:04 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:01:04.874925 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 703/1369] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:01:04 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:01:04.875616 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d33368-a9f6-4290-afee-caa3294c7deb admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:04.875938 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e59a31-4419-4e30-8c45-4783ec37c905 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:04.884966 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-f4d33368-a9f6-4290-afee-caa3294c7deb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:04.904824 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e59a31-4419-4e30-8c45-4783ec37c905 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:04.910289 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592d1bf5-f299-4f6b-b7db-43a3cd51b85c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:04.911762 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592d1bf5-f299-4f6b-b7db-43a3cd51b85c admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:04.911991 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592d1bf5-f299-4f6b-b7db-43a3cd51b85c admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:04.912914 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592d1bf5-f299-4f6b-b7db-43a3cd51b85c admin admin] PATH_INFO: `/v3/projects/32f566c5839b4b6fbfc602f9d0d1b2b7/users/8709ccc24555453c8d249372dddeaaa8/roles/5e8849303a75425b9eaa2681cc031af1` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:04.944957 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592d1bf5-f299-4f6b-b7db-43a3cd51b85c admin admin] RBAC: Authorizing `identity:create_grant(project_id=32f566c5839b4b6fbfc602f9d0d1b2b7, user_id=8709ccc24555453c8d249372dddeaaa8, role_id=5e8849303a75425b9eaa2681cc031af1)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:04.947990 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592d1bf5-f299-4f6b-b7db-43a3cd51b85c admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:04.977643 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 704/1370] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Oct 14 13:01:04 2022] PUT /identity/v3/projects/32f566c5839b4b6fbfc602f9d0d1b2b7/users/8709ccc24555453c8d249372dddeaaa8/roles/5e8849303a75425b9eaa2681cc031af1 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:01:04.978640 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592d1bf5-f299-4f6b-b7db-43a3cd51b85c admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:05.039522 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d33368-a9f6-4290-afee-caa3294c7deb admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:05.132779 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592d1bf5-f299-4f6b-b7db-43a3cd51b85c admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:05.141484 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787c9f03-9863-48b0-a26f-49ab74ea5063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:05.141921 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787c9f03-9863-48b0-a26f-49ab74ea5063 admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:05.143362 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:01:05.143822 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787c9f03-9863-48b0-a26f-49ab74ea5063 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:05.144260 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787c9f03-9863-48b0-a26f-49ab74ea5063 admin admin] PATH_INFO: `/v3/projects/f0246a29bfce40648461ac33bf619ba3/users/8cfdd55a58f248a0bb47dc10fd0e5543/roles/7f6e29e390bc41f7a9af17659a2e95d1` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:05.170762 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c9beeb-8b00-42ca-bac5-f4f0bd80b30e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d483292f3a4794848fcacfba5b107e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:05.171929 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c9beeb-8b00-42ca-bac5-f4f0bd80b30e service neutron] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:05.172411 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c9beeb-8b00-42ca-bac5-f4f0bd80b30e service neutron] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:05.172697 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c9beeb-8b00-42ca-bac5-f4f0bd80b30e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:05.192253 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787c9f03-9863-48b0-a26f-49ab74ea5063 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0246a29bfce40648461ac33bf619ba3, user_id=8cfdd55a58f248a0bb47dc10fd0e5543, role_id=7f6e29e390bc41f7a9af17659a2e95d1)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:05.195301 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787c9f03-9863-48b0-a26f-49ab74ea5063 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:05.195471 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c9beeb-8b00-42ca-bac5-f4f0bd80b30e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:05.196932 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c9beeb-8b00-42ca-bac5-f4f0bd80b30e service neutron] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:05.215994 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 667/1371] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:01:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:01:05.218564 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 705/1372] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Oct 14 13:01:04 2022] PUT /identity/v3/projects/f0246a29bfce40648461ac33bf619ba3/users/8cfdd55a58f248a0bb47dc10fd0e5543/roles/7f6e29e390bc41f7a9af17659a2e95d1 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:01:05.222012 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9683b88c-e4b6-43cc-bae5-67c8b8ee2ab8 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:05.222328 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9683b88c-e4b6-43cc-bae5-67c8b8ee2ab8 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:05.222740 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9683b88c-e4b6-43cc-bae5-67c8b8ee2ab8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:05.227700 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787c9f03-9863-48b0-a26f-49ab74ea5063 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:05.299979 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-9683b88c-e4b6-43cc-bae5-67c8b8ee2ab8 None None] MFA Rules not processed for user `8709ccc24555453c8d249372dddeaaa8`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:01:05.305161 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-9683b88c-e4b6-43cc-bae5-67c8b8ee2ab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:05.402073 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787c9f03-9863-48b0-a26f-49ab74ea5063 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:05.414250 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5ac524-4200-4561-90b9-b8c9c4443232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:05.414891 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5ac524-4200-4561-90b9-b8c9c4443232 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:05.415169 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5ac524-4200-4561-90b9-b8c9c4443232 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:05.415445 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5ac524-4200-4561-90b9-b8c9c4443232 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:05.417253 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5ac524-4200-4561-90b9-b8c9c4443232 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:05.420902 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5ac524-4200-4561-90b9-b8c9c4443232 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:05.454471 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 706/1373] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:01:05 2022] GET /identity/v3/roles => generated 1420 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:01:05.458526 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5ac524-4200-4561-90b9-b8c9c4443232 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:05.474417 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 668/1374] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:01:05 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:01:05.480391 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9683b88c-e4b6-43cc-bae5-67c8b8ee2ab8 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:05.486809 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5ac524-4200-4561-90b9-b8c9c4443232 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:05.500355 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b858f9-9887-4651-9b7d-e31730249299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:05.501037 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b858f9-9887-4651-9b7d-e31730249299 admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:05.501312 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b858f9-9887-4651-9b7d-e31730249299 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:05.501582 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b858f9-9887-4651-9b7d-e31730249299 admin admin] PATH_INFO: `/v3/projects/f0246a29bfce40648461ac33bf619ba3/users/8cfdd55a58f248a0bb47dc10fd0e5543/roles/7f6e29e390bc41f7a9af17659a2e95d1` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:05.507799 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9683b88c-e4b6-43cc-bae5-67c8b8ee2ab8 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:05.511387 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b858f9-9887-4651-9b7d-e31730249299 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0246a29bfce40648461ac33bf619ba3, user_id=8cfdd55a58f248a0bb47dc10fd0e5543, role_id=7f6e29e390bc41f7a9af17659a2e95d1)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:05.519825 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b858f9-9887-4651-9b7d-e31730249299 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:05.523794 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aeb29be-7f0d-4b90-871a-a3cad7e45b13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:05.524522 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeb29be-7f0d-4b90-871a-a3cad7e45b13 admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:05.524806 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeb29be-7f0d-4b90-871a-a3cad7e45b13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:05.525080 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeb29be-7f0d-4b90-871a-a3cad7e45b13 admin admin] PATH_INFO: `/v3/projects` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:05.526417 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aeb29be-7f0d-4b90-871a-a3cad7e45b13 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:05.532673 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aeb29be-7f0d-4b90-871a-a3cad7e45b13 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:05.554598 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 707/1375] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Oct 14 13:01:05 2022] PUT /identity/v3/projects/f0246a29bfce40648461ac33bf619ba3/users/8cfdd55a58f248a0bb47dc10fd0e5543/roles/7f6e29e390bc41f7a9af17659a2e95d1 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:01:05.568636 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1110ba-0885-466f-8c49-2a3bcf6dff4c None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:05.568926 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1110ba-0885-466f-8c49-2a3bcf6dff4c None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:05.569204 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1110ba-0885-466f-8c49-2a3bcf6dff4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:05.631885 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 669/1376] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Oct 14 13:01:05 2022] POST /identity/v3/projects => generated 363 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:01:05.639707 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aeb29be-7f0d-4b90-871a-a3cad7e45b13 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:05.666763 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-ff1110ba-0885-466f-8c49-2a3bcf6dff4c None None] MFA Rules not processed for user `8cfdd55a58f248a0bb47dc10fd0e5543`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:01:05.672265 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-ff1110ba-0885-466f-8c49-2a3bcf6dff4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:05.704287 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:01:05.816031 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aeb29be-7f0d-4b90-871a-a3cad7e45b13 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:05.836542 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f72605-ff37-4f68-9e5e-630f494ba31e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:05.837173 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f72605-ff37-4f68-9e5e-630f494ba31e admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:05.837450 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f72605-ff37-4f68-9e5e-630f494ba31e admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:05.837720 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f72605-ff37-4f68-9e5e-630f494ba31e admin admin] PATH_INFO: `/v3/users` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:05.838398 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f72605-ff37-4f68-9e5e-630f494ba31e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:05.840356 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f72605-ff37-4f68-9e5e-630f494ba31e admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:05.863995 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 708/1377] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:01:05 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:01:05.878242 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1110ba-0885-466f-8c49-2a3bcf6dff4c None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:05.881061 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-ff1110ba-0885-466f-8c49-2a3bcf6dff4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:05.896177 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 670/1378] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Oct 14 13:01:05 2022] POST /identity/v3/users => generated 288 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:01:05.900963 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f72605-ff37-4f68-9e5e-630f494ba31e admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:05.923727 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f72605-ff37-4f68-9e5e-630f494ba31e admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:05.939222 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334e20f0-cc72-4a39-b430-216948dc4666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:05.940040 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334e20f0-cc72-4a39-b430-216948dc4666 admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:05.940428 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334e20f0-cc72-4a39-b430-216948dc4666 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:05.940862 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334e20f0-cc72-4a39-b430-216948dc4666 admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:05.941632 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334e20f0-cc72-4a39-b430-216948dc4666 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:05.943434 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334e20f0-cc72-4a39-b430-216948dc4666 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:05.972074 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 671/1379] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:01:05 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:01:05.976315 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334e20f0-cc72-4a39-b430-216948dc4666 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:05.997578 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334e20f0-cc72-4a39-b430-216948dc4666 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:06.011963 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e24eccc-9c18-48e9-b051-c6c178eaf1ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:06.016082 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e24eccc-9c18-48e9-b051-c6c178eaf1ed admin admin] REQUEST_METHOD: `PUT` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:06.018640 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e24eccc-9c18-48e9-b051-c6c178eaf1ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:06.019046 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e24eccc-9c18-48e9-b051-c6c178eaf1ed admin admin] PATH_INFO: `/v3/projects/faa6cdabf4b34b6681d5ac1077eb080f/users/b613d6c9fc104acc971e469c5360dcf5/roles/7f6e29e390bc41f7a9af17659a2e95d1` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:06.025556 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1110ba-0885-466f-8c49-2a3bcf6dff4c None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:06.040274 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06530ebb-85d4-4373-b570-3d5a13ec94f9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c3c564b8c548e4beef1cbfba2ad343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:06.044147 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06530ebb-85d4-4373-b570-3d5a13ec94f9 service cinder] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:06.046284 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06530ebb-85d4-4373-b570-3d5a13ec94f9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:06.046692 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06530ebb-85d4-4373-b570-3d5a13ec94f9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:06.050157 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-06530ebb-85d4-4373-b570-3d5a13ec94f9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:06.074211 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e24eccc-9c18-48e9-b051-c6c178eaf1ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=faa6cdabf4b34b6681d5ac1077eb080f, user_id=b613d6c9fc104acc971e469c5360dcf5, role_id=7f6e29e390bc41f7a9af17659a2e95d1)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:06.077982 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e24eccc-9c18-48e9-b051-c6c178eaf1ed admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:06.115017 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 672/1380] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Oct 14 13:01:05 2022] PUT /identity/v3/projects/faa6cdabf4b34b6681d5ac1077eb080f/users/b613d6c9fc104acc971e469c5360dcf5/roles/7f6e29e390bc41f7a9af17659a2e95d1 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:01:06.119294 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e24eccc-9c18-48e9-b051-c6c178eaf1ed admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:06.143120 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:01:06.161064 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06530ebb-85d4-4373-b570-3d5a13ec94f9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:06.164731 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06530ebb-85d4-4373-b570-3d5a13ec94f9 service cinder] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:06.181518 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 709/1381] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:01:05 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:01:06.308945 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e24eccc-9c18-48e9-b051-c6c178eaf1ed admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:06.321289 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de49d369-fd72-42ba-b541-5c43fbaf1022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:06.321933 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de49d369-fd72-42ba-b541-5c43fbaf1022 admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:06.322244 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de49d369-fd72-42ba-b541-5c43fbaf1022 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:06.322530 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de49d369-fd72-42ba-b541-5c43fbaf1022 admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:06.323179 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de49d369-fd72-42ba-b541-5c43fbaf1022 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:06.324864 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de49d369-fd72-42ba-b541-5c43fbaf1022 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:06.362270 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 673/1382] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:01:06 2022] GET /identity/v3/roles => generated 1420 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:01:06.366851 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06530ebb-85d4-4373-b570-3d5a13ec94f9 service cinder] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:06.383288 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06530ebb-85d4-4373-b570-3d5a13ec94f9 service cinder] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:06.398469 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750646f4-7e51-4555-85dd-30e81c2dd1df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:06.399164 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750646f4-7e51-4555-85dd-30e81c2dd1df admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:06.399451 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750646f4-7e51-4555-85dd-30e81c2dd1df admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:06.399732 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750646f4-7e51-4555-85dd-30e81c2dd1df admin admin] PATH_INFO: `/v3/projects/faa6cdabf4b34b6681d5ac1077eb080f/users/b613d6c9fc104acc971e469c5360dcf5/roles/7f6e29e390bc41f7a9af17659a2e95d1` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:06.406767 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750646f4-7e51-4555-85dd-30e81c2dd1df admin admin] RBAC: Authorizing `identity:create_grant(project_id=faa6cdabf4b34b6681d5ac1077eb080f, user_id=b613d6c9fc104acc971e469c5360dcf5, role_id=7f6e29e390bc41f7a9af17659a2e95d1)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:06.414985 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750646f4-7e51-4555-85dd-30e81c2dd1df admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:06.447811 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 710/1383] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Oct 14 13:01:06 2022] PUT /identity/v3/projects/faa6cdabf4b34b6681d5ac1077eb080f/users/b613d6c9fc104acc971e469c5360dcf5/roles/7f6e29e390bc41f7a9af17659a2e95d1 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:01:06.458646 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fca7c7-fade-4d1b-b897-fb53fb4cb5de None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:06.459493 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fca7c7-fade-4d1b-b897-fb53fb4cb5de None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:06.460360 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fca7c7-fade-4d1b-b897-fb53fb4cb5de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:06.528816 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-04fca7c7-fade-4d1b-b897-fb53fb4cb5de None None] MFA Rules not processed for user `b613d6c9fc104acc971e469c5360dcf5`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:01:06.533131 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-04fca7c7-fade-4d1b-b897-fb53fb4cb5de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:06.717458 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 674/1384] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:01:06 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:01:06.728672 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750646f4-7e51-4555-85dd-30e81c2dd1df admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:06.732328 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-750646f4-7e51-4555-85dd-30e81c2dd1df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:06.863763 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:01:06.871431 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750646f4-7e51-4555-85dd-30e81c2dd1df admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:06.879586 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45e056c-509a-464c-8984-e939d9b27add service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c3c564b8c548e4beef1cbfba2ad343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:06.880199 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45e056c-509a-464c-8984-e939d9b27add service cinder] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:06.880483 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45e056c-509a-464c-8984-e939d9b27add service cinder] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:06.880759 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45e056c-509a-464c-8984-e939d9b27add service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:06.898307 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45e056c-509a-464c-8984-e939d9b27add service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:06.899873 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45e056c-509a-464c-8984-e939d9b27add service cinder] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:06.912929 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 711/1385] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:01:06 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:01:07.062588 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fca7c7-fade-4d1b-b897-fb53fb4cb5de None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:07.074257 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fca7c7-fade-4d1b-b897-fb53fb4cb5de None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:07.096925 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cef9963-3990-4209-aba5-f4a5bf2044cf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c3c564b8c548e4beef1cbfba2ad343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:07.097810 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cef9963-3990-4209-aba5-f4a5bf2044cf service cinder] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:07.098359 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cef9963-3990-4209-aba5-f4a5bf2044cf service cinder] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:07.098871 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cef9963-3990-4209-aba5-f4a5bf2044cf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:07.270386 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cef9963-3990-4209-aba5-f4a5bf2044cf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:07.278334 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cef9963-3990-4209-aba5-f4a5bf2044cf service cinder] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:07.324599 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 675/1386] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:01:07 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:01:07.842766 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45e056c-509a-464c-8984-e939d9b27add service cinder] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:07.844125 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-b45e056c-509a-464c-8984-e939d9b27add service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:08.033938 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45e056c-509a-464c-8984-e939d9b27add service cinder] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:08.064767 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cfff1c-d347-44e1-9cb1-f892ee8de22a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:08.065675 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cfff1c-d347-44e1-9cb1-f892ee8de22a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:08.066420 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cfff1c-d347-44e1-9cb1-f892ee8de22a admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:08.066420 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cfff1c-d347-44e1-9cb1-f892ee8de22a admin admin] PATH_INFO: `/v3/projects/4ccbceb7ff4d4c1dbc1f514286a15640` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:08.070139 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cfff1c-d347-44e1-9cb1-f892ee8de22a admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ccbceb7ff4d4c1dbc1f514286a15640)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:08.072324 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cfff1c-d347-44e1-9cb1-f892ee8de22a admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:08.197980 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478d0c2d-177a-41b0-8af6-41b8d6c5e714 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:08.198573 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478d0c2d-177a-41b0-8af6-41b8d6c5e714 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:08.198760 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478d0c2d-177a-41b0-8af6-41b8d6c5e714 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:08.238050 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-22cfff1c-d347-44e1-9cb1-f892ee8de22a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ccbceb7ff4d4c1dbc1f514286a15640', 'request_id': 'req-22cfff1c-d347-44e1-9cb1-f892ee8de22a'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:08.259607 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-22cfff1c-d347-44e1-9cb1-f892ee8de22a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ccbceb7ff4d4c1dbc1f514286a15640', 'request_id': 'req-22cfff1c-d347-44e1-9cb1-f892ee8de22a'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:08.289619 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-22cfff1c-d347-44e1-9cb1-f892ee8de22a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ccbceb7ff4d4c1dbc1f514286a15640', 'request_id': 'req-22cfff1c-d347-44e1-9cb1-f892ee8de22a'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:08.292031 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-478d0c2d-177a-41b0-8af6-41b8d6c5e714 None None] MFA Rules not processed for user `9434562e690740bda182577b25f70774`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:01:08.295561 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-478d0c2d-177a-41b0-8af6-41b8d6c5e714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:08.327080 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-22cfff1c-d347-44e1-9cb1-f892ee8de22a admin admin] The token cache is being invalidate because project 4ccbceb7ff4d4c1dbc1f514286a15640 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:01:08.327723 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-22cfff1c-d347-44e1-9cb1-f892ee8de22a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:08.329630 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-22cfff1c-d347-44e1-9cb1-f892ee8de22a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:08.339644 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 712/1387] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Oct 14 13:01:07 2022] DELETE /identity/v3/projects/4ccbceb7ff4d4c1dbc1f514286a15640 => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:01:08.341860 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc95dab-327b-4330-9077-959a9fb7a43c None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:08.341860 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc95dab-327b-4330-9077-959a9fb7a43c None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:08.344181 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc95dab-327b-4330-9077-959a9fb7a43c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:08.349423 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:01:08.432299 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-4bc95dab-327b-4330-9077-959a9fb7a43c None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:01:08.439808 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-4bc95dab-327b-4330-9077-959a9fb7a43c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:08.585199 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 676/1388] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:01:08 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 388 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 13:01:08.611044 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478d0c2d-177a-41b0-8af6-41b8d6c5e714 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:08.614087 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-478d0c2d-177a-41b0-8af6-41b8d6c5e714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:08.674153 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 713/1389] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:01:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 333 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:01:08.685392 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadfa173-2b93-4292-b7f8-de51e25fba0a None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:08.688232 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadfa173-2b93-4292-b7f8-de51e25fba0a None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:08.688516 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadfa173-2b93-4292-b7f8-de51e25fba0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:08.758405 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-dadfa173-2b93-4292-b7f8-de51e25fba0a None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:01:08.759683 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-dadfa173-2b93-4292-b7f8-de51e25fba0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:08.791011 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 714/1390] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:01:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:01:08.795294 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadfa173-2b93-4292-b7f8-de51e25fba0a None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:08.842343 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadfa173-2b93-4292-b7f8-de51e25fba0a None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:08.875944 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1170e4-ff2b-461b-a3bf-bbf76decf9a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:08.875944 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1170e4-ff2b-461b-a3bf-bbf76decf9a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:08.875944 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1170e4-ff2b-461b-a3bf-bbf76decf9a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:08.875944 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1170e4-ff2b-461b-a3bf-bbf76decf9a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:08.877114 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1170e4-ff2b-461b-a3bf-bbf76decf9a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 13:01:08.877114 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1170e4-ff2b-461b-a3bf-bbf76decf9a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:08.877114 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1170e4-ff2b-461b-a3bf-bbf76decf9a2 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:08.896767 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:01:08.915869 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478d0c2d-177a-41b0-8af6-41b8d6c5e714 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:08.916302 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 715/1391] 10.222.0.17 () {58 vars in 1153 bytes} [Fri Oct 14 13:01:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 13:01:08.918626 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52faecdf-c790-4a70-8332-05bb65744e1b None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:08.918913 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52faecdf-c790-4a70-8332-05bb65744e1b None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:08.919209 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52faecdf-c790-4a70-8332-05bb65744e1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:08.942894 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3cb4ce-4b9b-49dd-adee-56644dab5973 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '931f4e32c8764514b5efed31b0785be7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:08.982594 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3cb4ce-4b9b-49dd-adee-56644dab5973 service nova] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:08.982594 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3cb4ce-4b9b-49dd-adee-56644dab5973 service nova] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:08.982594 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3cb4ce-4b9b-49dd-adee-56644dab5973 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:09.007912 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3cb4ce-4b9b-49dd-adee-56644dab5973 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:09.013039 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3cb4ce-4b9b-49dd-adee-56644dab5973 service nova] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:09.039927 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 677/1392] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:01:08 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:01:09.041966 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3cb4ce-4b9b-49dd-adee-56644dab5973 service nova] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:09.072551 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3cb4ce-4b9b-49dd-adee-56644dab5973 service nova] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:09.078022 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bf61a7-1efc-4f4f-b036-1a55740e5eea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:09.079052 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bf61a7-1efc-4f4f-b036-1a55740e5eea admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:09.079843 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bf61a7-1efc-4f4f-b036-1a55740e5eea admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:09.080343 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bf61a7-1efc-4f4f-b036-1a55740e5eea admin admin] PATH_INFO: `/v3/projects` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:09.081153 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bf61a7-1efc-4f4f-b036-1a55740e5eea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:09.087529 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bf61a7-1efc-4f4f-b036-1a55740e5eea admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:09.176750 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 678/1393] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Oct 14 13:01:09 2022] POST /identity/v3/projects => generated 391 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:01:09.188210 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3531afce-eba3-45cc-9948-dc3c3ae8fd0a None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:09.188672 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3531afce-eba3-45cc-9948-dc3c3ae8fd0a None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:09.189040 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3531afce-eba3-45cc-9948-dc3c3ae8fd0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:09.260883 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-3531afce-eba3-45cc-9948-dc3c3ae8fd0a None None] MFA Rules not processed for user `ac6f9d410e524c40acedd10d5a9430ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:01:09.262321 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-3531afce-eba3-45cc-9948-dc3c3ae8fd0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:09.292030 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-52faecdf-c790-4a70-8332-05bb65744e1b None None] MFA Rules not processed for user `c039b370575643338954f6de250d1ea9`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:01:09.297250 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-52faecdf-c790-4a70-8332-05bb65744e1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:09.419521 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 679/1394] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:01:09 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:01:09.420429 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3531afce-eba3-45cc-9948-dc3c3ae8fd0a None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:09.443923 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:01:09.541272 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 716/1395] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:01:08 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 609 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:01:09.555111 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52faecdf-c790-4a70-8332-05bb65744e1b None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:09.559136 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-52faecdf-c790-4a70-8332-05bb65744e1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:09.597982 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3531afce-eba3-45cc-9948-dc3c3ae8fd0a None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:09.608064 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e8f809-c054-49f1-aeb2-74f4cd0952d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:09.609327 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e8f809-c054-49f1-aeb2-74f4cd0952d2 admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:09.609585 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e8f809-c054-49f1-aeb2-74f4cd0952d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:09.609868 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e8f809-c054-49f1-aeb2-74f4cd0952d2 admin admin] PATH_INFO: `/v3/users` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:09.610632 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e8f809-c054-49f1-aeb2-74f4cd0952d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:09.612602 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e8f809-c054-49f1-aeb2-74f4cd0952d2 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:09.661009 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 680/1396] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Oct 14 13:01:09 2022] POST /identity/v3/users => generated 296 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:01:09.661930 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969ac5f3-3b72-4c18-b0b8-37c398dfd59b None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:09.662255 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969ac5f3-3b72-4c18-b0b8-37c398dfd59b None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:09.662531 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969ac5f3-3b72-4c18-b0b8-37c398dfd59b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:09.729461 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-969ac5f3-3b72-4c18-b0b8-37c398dfd59b None None] MFA Rules not processed for user `c039b370575643338954f6de250d1ea9`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:01:09.737804 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-969ac5f3-3b72-4c18-b0b8-37c398dfd59b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:09.768626 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 681/1397] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:01:09 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:01:09.768626 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7377d3-7d8b-4714-ac3b-fab0b1592734 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:09.768626 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7377d3-7d8b-4714-ac3b-fab0b1592734 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:09.768626 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7377d3-7d8b-4714-ac3b-fab0b1592734 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:09.777224 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52faecdf-c790-4a70-8332-05bb65744e1b None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:09.794918 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242ff103-3a0a-48c6-ac87-e206a62d00d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:09.795962 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242ff103-3a0a-48c6-ac87-e206a62d00d3 admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:09.796936 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242ff103-3a0a-48c6-ac87-e206a62d00d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:09.797336 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242ff103-3a0a-48c6-ac87-e206a62d00d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:09.800718 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242ff103-3a0a-48c6-ac87-e206a62d00d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:09.805860 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242ff103-3a0a-48c6-ac87-e206a62d00d3 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:09.862304 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-8f7377d3-7d8b-4714-ac3b-fab0b1592734 None None] MFA Rules not processed for user `54a6ec88e95b469c89d78cb3d4b3bc7f`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:01:09.865228 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-8f7377d3-7d8b-4714-ac3b-fab0b1592734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:09.891736 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 717/1398] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Oct 14 13:01:09 2022] POST /identity/v3/projects => generated 403 bytes in 350 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:01:09.895171 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242ff103-3a0a-48c6-ac87-e206a62d00d3 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:10.074348 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 682/1399] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:01:09 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:01:10.088056 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7377d3-7d8b-4714-ac3b-fab0b1592734 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:10.091027 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-8f7377d3-7d8b-4714-ac3b-fab0b1592734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:10.117685 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242ff103-3a0a-48c6-ac87-e206a62d00d3 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:10.134560 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400aeadb-a6b2-4261-a5cb-c81b4d56ef6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:10.136471 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400aeadb-a6b2-4261-a5cb-c81b4d56ef6f admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:10.137222 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400aeadb-a6b2-4261-a5cb-c81b4d56ef6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:10.137728 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400aeadb-a6b2-4261-a5cb-c81b4d56ef6f admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:10.141130 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400aeadb-a6b2-4261-a5cb-c81b4d56ef6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:10.146026 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400aeadb-a6b2-4261-a5cb-c81b4d56ef6f admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:10.170728 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 718/1400] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:01:09 2022] GET /identity/v3/roles => generated 1420 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:01:10.173631 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400aeadb-a6b2-4261-a5cb-c81b4d56ef6f admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:10.198628 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400aeadb-a6b2-4261-a5cb-c81b4d56ef6f admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:10.212012 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3ca07d-1bf3-4166-8bff-bd85c71d0576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:10.212755 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3ca07d-1bf3-4166-8bff-bd85c71d0576 admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:10.213146 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3ca07d-1bf3-4166-8bff-bd85c71d0576 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:10.213524 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3ca07d-1bf3-4166-8bff-bd85c71d0576 admin admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:10.214521 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3ca07d-1bf3-4166-8bff-bd85c71d0576 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:10.216876 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3ca07d-1bf3-4166-8bff-bd85c71d0576 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:10.245022 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:01:10.271497 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 719/1401] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Oct 14 13:01:10 2022] POST /identity/v3/users => generated 308 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:01:10.271497 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3ca07d-1bf3-4166-8bff-bd85c71d0576 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:10.276961 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-5c3ca07d-1bf3-4166-8bff-bd85c71d0576 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:10.280283 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7377d3-7d8b-4714-ac3b-fab0b1592734 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:10.323023 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:01:10.443052 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3ca07d-1bf3-4166-8bff-bd85c71d0576 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:10.447661 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b54b08-fadb-4c07-b30e-4ab107c1cc66 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '931f4e32c8764514b5efed31b0785be7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:10.449403 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b54b08-fadb-4c07-b30e-4ab107c1cc66 service nova] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:10.451274 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b54b08-fadb-4c07-b30e-4ab107c1cc66 service nova] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:10.451883 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b54b08-fadb-4c07-b30e-4ab107c1cc66 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:10.452711 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12da758-6977-4252-80cc-6dc8814395b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c3c564b8c548e4beef1cbfba2ad343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:10.454706 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12da758-6977-4252-80cc-6dc8814395b5 service cinder] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:10.456466 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12da758-6977-4252-80cc-6dc8814395b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:10.457588 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12da758-6977-4252-80cc-6dc8814395b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:10.462004 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-e12da758-6977-4252-80cc-6dc8814395b5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:10.593273 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b54b08-fadb-4c07-b30e-4ab107c1cc66 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:10.595144 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b54b08-fadb-4c07-b30e-4ab107c1cc66 service nova] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:10.614868 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 683/1402] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:01:10 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 540 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:01:10.616925 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9f4ec0-bc2e-4209-ac87-34dc1cfec1c0 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:10.617184 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9f4ec0-bc2e-4209-ac87-34dc1cfec1c0 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:10.617509 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9f4ec0-bc2e-4209-ac87-34dc1cfec1c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:10.657465 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12da758-6977-4252-80cc-6dc8814395b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:10.660193 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12da758-6977-4252-80cc-6dc8814395b5 service cinder] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:10.675568 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-de9f4ec0-bc2e-4209-ac87-34dc1cfec1c0 None None] MFA Rules not processed for user `54a6ec88e95b469c89d78cb3d4b3bc7f`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:01:10.677410 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-de9f4ec0-bc2e-4209-ac87-34dc1cfec1c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:10.684815 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 720/1403] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:01:10 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:01:10.687582 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12da758-6977-4252-80cc-6dc8814395b5 service cinder] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:10.715953 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12da758-6977-4252-80cc-6dc8814395b5 service cinder] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:10.728323 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1c05ac-1564-4baf-88a7-586c443557fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:10.729119 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1c05ac-1564-4baf-88a7-586c443557fb admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:10.729533 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1c05ac-1564-4baf-88a7-586c443557fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:10.729924 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1c05ac-1564-4baf-88a7-586c443557fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:10.730790 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1c05ac-1564-4baf-88a7-586c443557fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:10.735624 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1c05ac-1564-4baf-88a7-586c443557fb admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:10.777380 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 721/1404] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:01:10 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:01:10.782983 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1c05ac-1564-4baf-88a7-586c443557fb admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:10.796550 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1c05ac-1564-4baf-88a7-586c443557fb admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:10.802385 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84761534-a550-45df-9ec4-e55e1c8d4095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:10.803140 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84761534-a550-45df-9ec4-e55e1c8d4095 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:10.803535 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84761534-a550-45df-9ec4-e55e1c8d4095 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:10.803924 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84761534-a550-45df-9ec4-e55e1c8d4095 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:10.806110 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84761534-a550-45df-9ec4-e55e1c8d4095 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:10.808403 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84761534-a550-45df-9ec4-e55e1c8d4095 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:10.809607 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 684/1405] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:01:10 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:01:10.811671 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77360989-3726-44fe-a24e-48cbbc8983a8 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:10.812267 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77360989-3726-44fe-a24e-48cbbc8983a8 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:10.812677 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77360989-3726-44fe-a24e-48cbbc8983a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:10.828433 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 722/1406] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:01:10 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:01:10.829518 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84761534-a550-45df-9ec4-e55e1c8d4095 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:10.846847 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84761534-a550-45df-9ec4-e55e1c8d4095 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:10.869385 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0544422-8b22-403f-93ee-79eb97055aea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:10.870687 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0544422-8b22-403f-93ee-79eb97055aea admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:10.870970 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0544422-8b22-403f-93ee-79eb97055aea admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:10.871249 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0544422-8b22-403f-93ee-79eb97055aea admin admin] PATH_INFO: `/v3/projects/1012b97156d1400eb6b251f712e58ba2/users/c7365c54089f4191ba09cb11824a4b38/roles/5e8849303a75425b9eaa2681cc031af1` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:10.878872 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-77360989-3726-44fe-a24e-48cbbc8983a8 None None] MFA Rules not processed for user `a1b9ec5c477d4f01aa2ad5f634e5f73a`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:01:10.880117 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-77360989-3726-44fe-a24e-48cbbc8983a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:10.897329 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0544422-8b22-403f-93ee-79eb97055aea admin admin] RBAC: Authorizing `identity:create_grant(project_id=1012b97156d1400eb6b251f712e58ba2, user_id=c7365c54089f4191ba09cb11824a4b38, role_id=5e8849303a75425b9eaa2681cc031af1)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:10.902327 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0544422-8b22-403f-93ee-79eb97055aea admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:10.938347 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 723/1407] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Oct 14 13:01:10 2022] PUT /identity/v3/projects/1012b97156d1400eb6b251f712e58ba2/users/c7365c54089f4191ba09cb11824a4b38/roles/5e8849303a75425b9eaa2681cc031af1 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:01:10.939413 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0544422-8b22-403f-93ee-79eb97055aea admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:11.049746 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 685/1408] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:01:10 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:01:11.049746 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77360989-3726-44fe-a24e-48cbbc8983a8 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:11.107589 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77360989-3726-44fe-a24e-48cbbc8983a8 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:11.116525 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:01:11.144210 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:01:11.154728 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0544422-8b22-403f-93ee-79eb97055aea admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:11.170158 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea521584-2e64-4c2c-8bd4-29d4351f6e57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:11.171434 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea521584-2e64-4c2c-8bd4-29d4351f6e57 admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:11.171719 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea521584-2e64-4c2c-8bd4-29d4351f6e57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:11.172152 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea521584-2e64-4c2c-8bd4-29d4351f6e57 admin admin] PATH_INFO: `/v3/projects/bd261c710da04c618bc6a77364937a61/users/d0e10d94f3fa4a63a8ffd04f9640428d/roles/7f6e29e390bc41f7a9af17659a2e95d1` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:11.206433 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea521584-2e64-4c2c-8bd4-29d4351f6e57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd261c710da04c618bc6a77364937a61, user_id=d0e10d94f3fa4a63a8ffd04f9640428d, role_id=7f6e29e390bc41f7a9af17659a2e95d1)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:11.209026 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea521584-2e64-4c2c-8bd4-29d4351f6e57 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:11.242014 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 724/1409] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Oct 14 13:01:10 2022] PUT /identity/v3/projects/bd261c710da04c618bc6a77364937a61/users/d0e10d94f3fa4a63a8ffd04f9640428d/roles/7f6e29e390bc41f7a9af17659a2e95d1 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:01:11.246704 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95fe561-7c5e-4c8d-965c-0a5e305516b3 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:11.246922 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95fe561-7c5e-4c8d-965c-0a5e305516b3 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:11.247204 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95fe561-7c5e-4c8d-965c-0a5e305516b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:11.277390 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986ddb2d-5c62-4bd4-ae02-06f4f641b3de service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '931f4e32c8764514b5efed31b0785be7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:11.278188 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986ddb2d-5c62-4bd4-ae02-06f4f641b3de service nova] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:11.278571 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986ddb2d-5c62-4bd4-ae02-06f4f641b3de service nova] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:11.278954 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986ddb2d-5c62-4bd4-ae02-06f4f641b3de service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:11.323309 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-c95fe561-7c5e-4c8d-965c-0a5e305516b3 None None] MFA Rules not processed for user `c7365c54089f4191ba09cb11824a4b38`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:01:11.326559 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-c95fe561-7c5e-4c8d-965c-0a5e305516b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:11.396593 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986ddb2d-5c62-4bd4-ae02-06f4f641b3de service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:11.399729 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986ddb2d-5c62-4bd4-ae02-06f4f641b3de service nova] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:11.431846 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 686/1410] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:01:11 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:01:11.432829 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986ddb2d-5c62-4bd4-ae02-06f4f641b3de service nova] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:11.464416 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986ddb2d-5c62-4bd4-ae02-06f4f641b3de service nova] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:11.520899 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 725/1411] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:01:11 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:01:11.527261 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95fe561-7c5e-4c8d-965c-0a5e305516b3 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:11.622423 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4023dc6c-6272-49d6-b616-63a143760e8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:11.623141 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4023dc6c-6272-49d6-b616-63a143760e8a admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:11.623502 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4023dc6c-6272-49d6-b616-63a143760e8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:11.624958 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4023dc6c-6272-49d6-b616-63a143760e8a admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:11.627438 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4023dc6c-6272-49d6-b616-63a143760e8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:11.629215 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4023dc6c-6272-49d6-b616-63a143760e8a admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:11.649344 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 687/1412] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:01:11 2022] GET /identity/v3/roles => generated 1420 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:01:11.652836 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4023dc6c-6272-49d6-b616-63a143760e8a admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:11.666894 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4023dc6c-6272-49d6-b616-63a143760e8a admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:11.676866 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8778ad-1213-43e0-b4db-eb790fe30b7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:11.678115 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8778ad-1213-43e0-b4db-eb790fe30b7f admin admin] REQUEST_METHOD: `PUT` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:11.678604 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8778ad-1213-43e0-b4db-eb790fe30b7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:11.679061 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8778ad-1213-43e0-b4db-eb790fe30b7f admin admin] PATH_INFO: `/v3/projects/bd261c710da04c618bc6a77364937a61/users/d0e10d94f3fa4a63a8ffd04f9640428d/roles/7f6e29e390bc41f7a9af17659a2e95d1` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:11.681681 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8778ad-1213-43e0-b4db-eb790fe30b7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd261c710da04c618bc6a77364937a61, user_id=d0e10d94f3fa4a63a8ffd04f9640428d, role_id=7f6e29e390bc41f7a9af17659a2e95d1)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:11.699443 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95fe561-7c5e-4c8d-965c-0a5e305516b3 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:11.704078 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8778ad-1213-43e0-b4db-eb790fe30b7f admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:11.709001 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d359a8e-d418-49a1-992d-ebf6d8838dd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:11.709645 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d359a8e-d418-49a1-992d-ebf6d8838dd2 admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:11.709925 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d359a8e-d418-49a1-992d-ebf6d8838dd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:11.710230 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d359a8e-d418-49a1-992d-ebf6d8838dd2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:11.710946 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d359a8e-d418-49a1-992d-ebf6d8838dd2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:11.715142 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d359a8e-d418-49a1-992d-ebf6d8838dd2 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:11.732621 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 688/1413] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Oct 14 13:01:11 2022] PUT /identity/v3/projects/bd261c710da04c618bc6a77364937a61/users/d0e10d94f3fa4a63a8ffd04f9640428d/roles/7f6e29e390bc41f7a9af17659a2e95d1 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 13:01:11.755019 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237d185c-1411-461d-95ae-184103c9f1fe None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:11.755637 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237d185c-1411-461d-95ae-184103c9f1fe None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:11.756589 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237d185c-1411-461d-95ae-184103c9f1fe None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:11.758866 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 689/1414] 10.222.0.17 () {54 vars in 912 bytes} [Fri Oct 14 13:01:11 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 13:01:11.767391 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6933bb1-f25c-4804-a7a6-f860468537be None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:11.767850 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6933bb1-f25c-4804-a7a6-f860468537be None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:11.768192 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6933bb1-f25c-4804-a7a6-f860468537be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:11.782938 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 726/1415] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Oct 14 13:01:11 2022] POST /identity/v3/projects => generated 393 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:01:11.786435 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d359a8e-d418-49a1-992d-ebf6d8838dd2 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:11.852688 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-b6933bb1-f25c-4804-a7a6-f860468537be None None] MFA Rules not processed for user `b2d483292f3a4794848fcacfba5b107e`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:01:11.856665 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-b6933bb1-f25c-4804-a7a6-f860468537be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:11.881602 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:01:11.921972 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:01:11.932970 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d359a8e-d418-49a1-992d-ebf6d8838dd2 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:11.947323 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258c905d-5d9f-4e53-ba2e-79464510288e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:11.948301 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258c905d-5d9f-4e53-ba2e-79464510288e admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:11.949244 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258c905d-5d9f-4e53-ba2e-79464510288e admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:11.949664 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258c905d-5d9f-4e53-ba2e-79464510288e admin admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:11.952011 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258c905d-5d9f-4e53-ba2e-79464510288e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:11.957039 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258c905d-5d9f-4e53-ba2e-79464510288e admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:11.996872 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 690/1416] 10.222.0.17 () {58 vars in 1009 bytes} [Fri Oct 14 13:01:11 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 13:01:12.002805 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6933bb1-f25c-4804-a7a6-f860468537be None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:12.003004 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 727/1417] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Oct 14 13:01:11 2022] POST /identity/v3/users => generated 303 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 13:01:12.015369 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258c905d-5d9f-4e53-ba2e-79464510288e admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:12.017286 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-258c905d-5d9f-4e53-ba2e-79464510288e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:12.033223 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6933bb1-f25c-4804-a7a6-f860468537be None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:12.039528 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258c905d-5d9f-4e53-ba2e-79464510288e admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:12.042955 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddd5bbc-843b-4a29-b5e3-69cac2b631c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:12.043934 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddd5bbc-843b-4a29-b5e3-69cac2b631c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:12.044505 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddd5bbc-843b-4a29-b5e3-69cac2b631c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:12.044851 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddd5bbc-843b-4a29-b5e3-69cac2b631c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:12.049928 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3263eac4-3b74-40bf-9170-804233b9b82e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d483292f3a4794848fcacfba5b107e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:12.053045 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3263eac4-3b74-40bf-9170-804233b9b82e service neutron] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:12.054330 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3263eac4-3b74-40bf-9170-804233b9b82e service neutron] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:12.055628 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3263eac4-3b74-40bf-9170-804233b9b82e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:12.059740 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddd5bbc-843b-4a29-b5e3-69cac2b631c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:12.071032 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddd5bbc-843b-4a29-b5e3-69cac2b631c9 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:12.076010 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3263eac4-3b74-40bf-9170-804233b9b82e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:12.078552 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3263eac4-3b74-40bf-9170-804233b9b82e service neutron] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:12.088035 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 728/1418] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:01:12 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 14 13:01:12.104266 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 691/1419] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:01:12 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:01:12.108213 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3263eac4-3b74-40bf-9170-804233b9b82e service neutron] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:12.121949 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3263eac4-3b74-40bf-9170-804233b9b82e service neutron] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:12.128451 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0ec174-2d3a-4bdb-9f95-731163176af9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:12.131969 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0ec174-2d3a-4bdb-9f95-731163176af9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:12.132375 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0ec174-2d3a-4bdb-9f95-731163176af9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:12.132768 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0ec174-2d3a-4bdb-9f95-731163176af9 admin admin] PATH_INFO: `/v3/projects/d1ecffec30504ffc81f39870277d0ad3/users/cc50e9e43c434f33ba27ae3810b05b82/roles/7f6e29e390bc41f7a9af17659a2e95d1` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:12.155998 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0ec174-2d3a-4bdb-9f95-731163176af9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1ecffec30504ffc81f39870277d0ad3, user_id=cc50e9e43c434f33ba27ae3810b05b82, role_id=7f6e29e390bc41f7a9af17659a2e95d1)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:12.159448 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0ec174-2d3a-4bdb-9f95-731163176af9 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:12.180892 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 729/1420] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Oct 14 13:01:12 2022] PUT /identity/v3/projects/d1ecffec30504ffc81f39870277d0ad3/users/cc50e9e43c434f33ba27ae3810b05b82/roles/7f6e29e390bc41f7a9af17659a2e95d1 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:01:12.184799 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddd5bbc-843b-4a29-b5e3-69cac2b631c9 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:12.196059 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddd5bbc-843b-4a29-b5e3-69cac2b631c9 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:12.393467 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04a23d9-273c-4181-a2d7-dc6f77ff1ce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:12.394959 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04a23d9-273c-4181-a2d7-dc6f77ff1ce4 admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:12.395359 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04a23d9-273c-4181-a2d7-dc6f77ff1ce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:12.395739 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04a23d9-273c-4181-a2d7-dc6f77ff1ce4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:12.396900 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04a23d9-273c-4181-a2d7-dc6f77ff1ce4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:12.398907 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04a23d9-273c-4181-a2d7-dc6f77ff1ce4 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:12.416569 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 692/1421] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:01:12 2022] GET /identity/v3/roles => generated 1420 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:01:12.417154 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0ec174-2d3a-4bdb-9f95-731163176af9 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:12.434195 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0ec174-2d3a-4bdb-9f95-731163176af9 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:12.450101 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be956d2-e601-4353-aafb-4ca3c1cec468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:12.450854 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be956d2-e601-4353-aafb-4ca3c1cec468 admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:12.451129 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be956d2-e601-4353-aafb-4ca3c1cec468 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:12.451424 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be956d2-e601-4353-aafb-4ca3c1cec468 admin admin] PATH_INFO: `/v3/projects/d1ecffec30504ffc81f39870277d0ad3/users/cc50e9e43c434f33ba27ae3810b05b82/roles/7f6e29e390bc41f7a9af17659a2e95d1` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:12.453948 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be956d2-e601-4353-aafb-4ca3c1cec468 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1ecffec30504ffc81f39870277d0ad3, user_id=cc50e9e43c434f33ba27ae3810b05b82, role_id=7f6e29e390bc41f7a9af17659a2e95d1)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:12.456735 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be956d2-e601-4353-aafb-4ca3c1cec468 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:12.487627 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 730/1422] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Oct 14 13:01:12 2022] PUT /identity/v3/projects/d1ecffec30504ffc81f39870277d0ad3/users/cc50e9e43c434f33ba27ae3810b05b82/roles/7f6e29e390bc41f7a9af17659a2e95d1 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:01:12.501996 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d441c2-0400-4752-a382-eec25bb57759 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:12.502475 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d441c2-0400-4752-a382-eec25bb57759 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:12.502870 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d441c2-0400-4752-a382-eec25bb57759 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:12.564003 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-d1d441c2-0400-4752-a382-eec25bb57759 None None] MFA Rules not processed for user `cc50e9e43c434f33ba27ae3810b05b82`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:01:12.565984 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-d1d441c2-0400-4752-a382-eec25bb57759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:12.784699 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5dd18f-c9ec-426c-8226-f6abe5dbbcc3 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:12.785061 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5dd18f-c9ec-426c-8226-f6abe5dbbcc3 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:12.785559 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5dd18f-c9ec-426c-8226-f6abe5dbbcc3 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:12.791390 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 731/1423] 10.222.0.17 () {54 vars in 912 bytes} [Fri Oct 14 13:01:12 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 13:01:12.814421 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d63c54-5b4e-4f2d-a855-4ff482c86be9 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:12.814706 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d63c54-5b4e-4f2d-a855-4ff482c86be9 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:12.814980 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d63c54-5b4e-4f2d-a855-4ff482c86be9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:12.825119 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 693/1424] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:01:12 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:01:12.857846 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-24d63c54-5b4e-4f2d-a855-4ff482c86be9 None None] MFA Rules not processed for user `b2d483292f3a4794848fcacfba5b107e`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:01:12.859614 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-24d63c54-5b4e-4f2d-a855-4ff482c86be9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:12.887900 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d441c2-0400-4752-a382-eec25bb57759 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:12.890864 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-d1d441c2-0400-4752-a382-eec25bb57759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:13.039393 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:01:13.040648 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 732/1425] 10.222.0.17 () {58 vars in 1009 bytes} [Fri Oct 14 13:01:12 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 13:01:13.121596 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d441c2-0400-4752-a382-eec25bb57759 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:13.136805 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ab4499-026c-4e60-8d49-567cf3f1aaf3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c3c564b8c548e4beef1cbfba2ad343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:13.137645 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ab4499-026c-4e60-8d49-567cf3f1aaf3 service cinder] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:13.145217 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ab4499-026c-4e60-8d49-567cf3f1aaf3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:13.145743 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ab4499-026c-4e60-8d49-567cf3f1aaf3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:13.173548 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d63c54-5b4e-4f2d-a855-4ff482c86be9 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:13.175031 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-24d63c54-5b4e-4f2d-a855-4ff482c86be9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:13.179959 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ab4499-026c-4e60-8d49-567cf3f1aaf3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:13.184553 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ab4499-026c-4e60-8d49-567cf3f1aaf3 service cinder] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:13.229002 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 694/1426] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:01:12 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 14 13:01:13.400485 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ab4499-026c-4e60-8d49-567cf3f1aaf3 service cinder] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:13.402782 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-c6ab4499-026c-4e60-8d49-567cf3f1aaf3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:13.436960 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ab4499-026c-4e60-8d49-567cf3f1aaf3 service cinder] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:13.456292 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87429164-484b-47b0-8443-964f9d6347f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d483292f3a4794848fcacfba5b107e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:13.457282 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87429164-484b-47b0-8443-964f9d6347f8 service neutron] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:13.457761 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87429164-484b-47b0-8443-964f9d6347f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:13.458265 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87429164-484b-47b0-8443-964f9d6347f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:13.483281 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87429164-484b-47b0-8443-964f9d6347f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:13.485070 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87429164-484b-47b0-8443-964f9d6347f8 service neutron] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:13.487447 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d63c54-5b4e-4f2d-a855-4ff482c86be9 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:13.499267 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ea0a01-77bf-4b41-8dbe-23843656a9cd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a5e5c35ed8b4abc877ba8d8c490dacd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:13.499939 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ea0a01-77bf-4b41-8dbe-23843656a9cd service placement] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:13.500221 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ea0a01-77bf-4b41-8dbe-23843656a9cd service placement] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:13.500525 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ea0a01-77bf-4b41-8dbe-23843656a9cd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:13.508822 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-e6ea0a01-77bf-4b41-8dbe-23843656a9cd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:13.513598 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 695/1427] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:01:13 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:01:13.515179 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87429164-484b-47b0-8443-964f9d6347f8 service neutron] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:13.542461 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87429164-484b-47b0-8443-964f9d6347f8 service neutron] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:13.550453 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91831cb0-01a4-44cf-a6ad-afd8157ed6e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c3c564b8c548e4beef1cbfba2ad343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:13.551221 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91831cb0-01a4-44cf-a6ad-afd8157ed6e2 service cinder] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:13.551604 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91831cb0-01a4-44cf-a6ad-afd8157ed6e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:13.551982 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91831cb0-01a4-44cf-a6ad-afd8157ed6e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:13.554916 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ea0a01-77bf-4b41-8dbe-23843656a9cd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:13.556579 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ea0a01-77bf-4b41-8dbe-23843656a9cd service placement] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:13.603946 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 733/1428] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:01:13 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:01:13.739226 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91831cb0-01a4-44cf-a6ad-afd8157ed6e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:13.740912 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91831cb0-01a4-44cf-a6ad-afd8157ed6e2 service cinder] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:13.775339 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 696/1429] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:01:13 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:01:14.180296 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f9cb86-312e-48b5-96d2-6e53fda68858 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:14.180907 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f9cb86-312e-48b5-96d2-6e53fda68858 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:14.181094 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f9cb86-312e-48b5-96d2-6e53fda68858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:14.267831 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-d1f9cb86-312e-48b5-96d2-6e53fda68858 None None] MFA Rules not processed for user `9434562e690740bda182577b25f70774`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:01:14.276821 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-d1f9cb86-312e-48b5-96d2-6e53fda68858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:14.440180 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:01:14.546247 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 734/1430] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:01:14 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 366 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:01:15.302952 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbec57df-ab6b-43bb-9aba-95af062c8d2d None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:15.303438 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbec57df-ab6b-43bb-9aba-95af062c8d2d None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:15.303578 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbec57df-ab6b-43bb-9aba-95af062c8d2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:15.408471 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-dbec57df-ab6b-43bb-9aba-95af062c8d2d None None] MFA Rules not processed for user `d0e10d94f3fa4a63a8ffd04f9640428d`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:01:15.409853 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-dbec57df-ab6b-43bb-9aba-95af062c8d2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:15.746475 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 697/1431] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:01:15 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 439 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:01:16.164697 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da012a8-6e29-42d3-ae95-25b5a350e3f2 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:16.165298 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da012a8-6e29-42d3-ae95-25b5a350e3f2 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:16.165427 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da012a8-6e29-42d3-ae95-25b5a350e3f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:16.250823 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-1da012a8-6e29-42d3-ae95-25b5a350e3f2 None None] MFA Rules not processed for user `54a6ec88e95b469c89d78cb3d4b3bc7f`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:01:16.257509 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-1da012a8-6e29-42d3-ae95-25b5a350e3f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:16.541422 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 735/1432] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:01:16 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 378 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:01:17.835720 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbec57df-ab6b-43bb-9aba-95af062c8d2d None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:17.839395 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-dbec57df-ab6b-43bb-9aba-95af062c8d2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:17.981854 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:01:18.028609 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbec57df-ab6b-43bb-9aba-95af062c8d2d None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:18.042400 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeb4996-43c9-4527-a8e4-ca029e0fb06f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:18.043553 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeb4996-43c9-4527-a8e4-ca029e0fb06f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:18.046489 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeb4996-43c9-4527-a8e4-ca029e0fb06f admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:18.047005 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeb4996-43c9-4527-a8e4-ca029e0fb06f admin admin] PATH_INFO: `/v3/users/8709ccc24555453c8d249372dddeaaa8` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:18.051269 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aeb4996-43c9-4527-a8e4-ca029e0fb06f admin admin] RBAC: Authorizing `identity:delete_user(user_id=8709ccc24555453c8d249372dddeaaa8)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:18.056849 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aeb4996-43c9-4527-a8e4-ca029e0fb06f admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:18.181234 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-4aeb4996-43c9-4527-a8e4-ca029e0fb06f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8709ccc24555453c8d249372dddeaaa8'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:18.198153 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-4aeb4996-43c9-4527-a8e4-ca029e0fb06f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8709ccc24555453c8d249372dddeaaa8'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:18.199106 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-4aeb4996-43c9-4527-a8e4-ca029e0fb06f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8709ccc24555453c8d249372dddeaaa8'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:18.209574 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-4aeb4996-43c9-4527-a8e4-ca029e0fb06f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8709ccc24555453c8d249372dddeaaa8'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:18.229538 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-4aeb4996-43c9-4527-a8e4-ca029e0fb06f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8709ccc24555453c8d249372dddeaaa8'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:18.247558 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 698/1433] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Oct 14 13:01:17 2022] DELETE /identity/v3/users/8709ccc24555453c8d249372dddeaaa8 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:01:18.252530 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3987b7-246f-4304-b452-8f4d41ba05cd None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:18.253059 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3987b7-246f-4304-b452-8f4d41ba05cd None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:18.253154 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3987b7-246f-4304-b452-8f4d41ba05cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:18.280406 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bc5c55-631d-479c-a004-25a5470ad466 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:18.280744 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bc5c55-631d-479c-a004-25a5470ad466 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:18.282600 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bc5c55-631d-479c-a004-25a5470ad466 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:18.308166 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-de3987b7-246f-4304-b452-8f4d41ba05cd None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:01:18.328770 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-de3987b7-246f-4304-b452-8f4d41ba05cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:18.506004 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-14bc5c55-631d-479c-a004-25a5470ad466 None None] MFA Rules not processed for user `b83a5a78f3e7486293907cb3012c0ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:01:18.508551 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-14bc5c55-631d-479c-a004-25a5470ad466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:18.633877 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 736/1434] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:01:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 382 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:01:18.765587 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 699/1435] 10.222.0.17 () {58 vars in 1009 bytes} [Fri Oct 14 13:01:18 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 486 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:01:18.856838 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3987b7-246f-4304-b452-8f4d41ba05cd None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:18.859737 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-de3987b7-246f-4304-b452-8f4d41ba05cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:19.044587 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0bc31a-0f01-4fd2-b3ea-099de0b8b0e6 None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:19.045088 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0bc31a-0f01-4fd2-b3ea-099de0b8b0e6 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:19.045186 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0bc31a-0f01-4fd2-b3ea-099de0b8b0e6 None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:19.047545 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 700/1436] 10.222.0.17 () {54 vars in 921 bytes} [Fri Oct 14 13:01:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 13:01:19.137333 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0bc31a-0f01-4fd2-b3ea-099de0b8b0e6 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:19.139734 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-9e0bc31a-0f01-4fd2-b3ea-099de0b8b0e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:19.239122 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3987b7-246f-4304-b452-8f4d41ba05cd None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:19.260209 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dff7c9f-a3dd-48c9-a4a0-947e76f4de27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d483292f3a4794848fcacfba5b107e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:19.261756 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dff7c9f-a3dd-48c9-a4a0-947e76f4de27 service neutron] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:19.265118 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dff7c9f-a3dd-48c9-a4a0-947e76f4de27 service neutron] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:19.265622 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dff7c9f-a3dd-48c9-a4a0-947e76f4de27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:19.335630 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dff7c9f-a3dd-48c9-a4a0-947e76f4de27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:19.339127 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dff7c9f-a3dd-48c9-a4a0-947e76f4de27 service neutron] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:19.347428 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:01:19.381036 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 737/1437] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:01:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 518 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:01:19.383085 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da6cc8f-49ea-48ba-9648-f82dcfb17b3b None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:19.383579 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da6cc8f-49ea-48ba-9648-f82dcfb17b3b None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:19.384208 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da6cc8f-49ea-48ba-9648-f82dcfb17b3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:19.478436 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-4da6cc8f-49ea-48ba-9648-f82dcfb17b3b None None] MFA Rules not processed for user `0a5e5c35ed8b4abc877ba8d8c490dacd`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:01:19.482567 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-4da6cc8f-49ea-48ba-9648-f82dcfb17b3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:19.548222 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:01:19.567250 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0bc31a-0f01-4fd2-b3ea-099de0b8b0e6 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:19.580706 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed65c798-e570-4c24-a4e7-78352bfda150 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c9fc57b1ec4d00b9f392877f277284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:19.581594 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed65c798-e570-4c24-a4e7-78352bfda150 service swift] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:19.582138 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed65c798-e570-4c24-a4e7-78352bfda150 service swift] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:19.582485 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed65c798-e570-4c24-a4e7-78352bfda150 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:19.595122 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed65c798-e570-4c24-a4e7-78352bfda150 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:19.598371 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed65c798-e570-4c24-a4e7-78352bfda150 service swift] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:19.609865 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 701/1438] 10.222.0.17 () {60 vars in 1384 bytes} [Fri Oct 14 13:01:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 473 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 14 13:01:19.728495 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 738/1439] 10.222.0.17 () {58 vars in 1018 bytes} [Fri Oct 14 13:01:19 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 346 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:01:19.877395 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed65c798-e570-4c24-a4e7-78352bfda150 service swift] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:19.879528 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-ed65c798-e570-4c24-a4e7-78352bfda150 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:19.911871 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed65c798-e570-4c24-a4e7-78352bfda150 service swift] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:19.918395 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018f9761-0e61-463b-ae07-1bcd0aed6536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:19.919204 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018f9761-0e61-463b-ae07-1bcd0aed6536 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:19.919831 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018f9761-0e61-463b-ae07-1bcd0aed6536 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:19.920824 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018f9761-0e61-463b-ae07-1bcd0aed6536 admin admin] PATH_INFO: `/v3/users/c7365c54089f4191ba09cb11824a4b38` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:19.923583 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018f9761-0e61-463b-ae07-1bcd0aed6536 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7365c54089f4191ba09cb11824a4b38)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:19.930041 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018f9761-0e61-463b-ae07-1bcd0aed6536 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:20.047555 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-018f9761-0e61-463b-ae07-1bcd0aed6536 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7365c54089f4191ba09cb11824a4b38'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:20.073622 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-018f9761-0e61-463b-ae07-1bcd0aed6536 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7365c54089f4191ba09cb11824a4b38'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:20.079912 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-018f9761-0e61-463b-ae07-1bcd0aed6536 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7365c54089f4191ba09cb11824a4b38'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:20.108766 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-018f9761-0e61-463b-ae07-1bcd0aed6536 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7365c54089f4191ba09cb11824a4b38'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:20.115389 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed840a2-d040-4037-9924-61f1a79a6153 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:20.115673 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed840a2-d040-4037-9924-61f1a79a6153 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:20.115949 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed840a2-d040-4037-9924-61f1a79a6153 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:20.117743 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 739/1440] 10.222.0.17 () {54 vars in 961 bytes} [Fri Oct 14 13:01:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 13:01:20.132728 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5a374e-16e6-4cdd-9a20-ca0437966d72 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:20.133018 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5a374e-16e6-4cdd-9a20-ca0437966d72 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:20.133283 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5a374e-16e6-4cdd-9a20-ca0437966d72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:20.151721 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-018f9761-0e61-463b-ae07-1bcd0aed6536 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7365c54089f4191ba09cb11824a4b38'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:20.174633 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 702/1441] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Oct 14 13:01:19 2022] DELETE /identity/v3/users/c7365c54089f4191ba09cb11824a4b38 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:01:20.179746 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8853a304-f466-44ea-be01-6a6687bfb402 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:20.180408 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8853a304-f466-44ea-be01-6a6687bfb402 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:20.180924 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8853a304-f466-44ea-be01-6a6687bfb402 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:20.190077 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-2c5a374e-16e6-4cdd-9a20-ca0437966d72 None None] MFA Rules not processed for user `0a5e5c35ed8b4abc877ba8d8c490dacd`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:01:20.193392 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-2c5a374e-16e6-4cdd-9a20-ca0437966d72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:20.225160 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-8853a304-f466-44ea-be01-6a6687bfb402 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:01:20.230908 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-8853a304-f466-44ea-be01-6a6687bfb402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:20.462257 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 703/1442] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:01:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 13:01:20.462257 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd476141-1239-49a2-ae5a-9fb369440d51 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:20.462257 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd476141-1239-49a2-ae5a-9fb369440d51 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:20.462257 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd476141-1239-49a2-ae5a-9fb369440d51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:20.546988 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-fd476141-1239-49a2-ae5a-9fb369440d51 None None] MFA Rules not processed for user `b2d483292f3a4794848fcacfba5b107e`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:01:20.558402 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-fd476141-1239-49a2-ae5a-9fb369440d51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:20.577291 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 740/1443] 10.222.0.17 () {58 vars in 1058 bytes} [Fri Oct 14 13:01:20 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 445 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 13:01:20.593285 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5a374e-16e6-4cdd-9a20-ca0437966d72 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:20.596259 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:01:20.598900 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-2c5a374e-16e6-4cdd-9a20-ca0437966d72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:20.689285 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 704/1444] 10.222.0.33 () {58 vars in 1015 bytes} [Fri Oct 14 13:01:20 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:01:20.690365 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd476141-1239-49a2-ae5a-9fb369440d51 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:20.707057 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd476141-1239-49a2-ae5a-9fb369440d51 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:20.714398 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb850727-2f39-4f6c-b1ff-79c23c769897 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a5e5c35ed8b4abc877ba8d8c490dacd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:20.715769 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb850727-2f39-4f6c-b1ff-79c23c769897 service placement] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:20.716530 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb850727-2f39-4f6c-b1ff-79c23c769897 service placement] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:20.717020 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb850727-2f39-4f6c-b1ff-79c23c769897 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:20.719557 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-bb850727-2f39-4f6c-b1ff-79c23c769897 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:20.737504 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb850727-2f39-4f6c-b1ff-79c23c769897 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:20.740181 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb850727-2f39-4f6c-b1ff-79c23c769897 service placement] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:20.756553 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 705/1445] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:01:20 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:01:20.837442 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5a374e-16e6-4cdd-9a20-ca0437966d72 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:20.844483 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b764ca47-e672-4c6c-928b-b2d7f7c50e36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d483292f3a4794848fcacfba5b107e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:20.845386 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b764ca47-e672-4c6c-928b-b2d7f7c50e36 service neutron] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:20.845817 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b764ca47-e672-4c6c-928b-b2d7f7c50e36 service neutron] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:20.846287 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b764ca47-e672-4c6c-928b-b2d7f7c50e36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:20.857308 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b764ca47-e672-4c6c-928b-b2d7f7c50e36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:20.859666 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b764ca47-e672-4c6c-928b-b2d7f7c50e36 service neutron] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:20.915236 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 741/1446] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:01:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:01:21.265265 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb850727-2f39-4f6c-b1ff-79c23c769897 service placement] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:21.286890 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb850727-2f39-4f6c-b1ff-79c23c769897 service placement] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:21.305144 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adb9a49-95ad-4af0-9895-c1cf4be4327a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d483292f3a4794848fcacfba5b107e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:21.305748 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adb9a49-95ad-4af0-9895-c1cf4be4327a service neutron] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:21.306023 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adb9a49-95ad-4af0-9895-c1cf4be4327a service neutron] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:21.306378 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adb9a49-95ad-4af0-9895-c1cf4be4327a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:21.335984 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adb9a49-95ad-4af0-9895-c1cf4be4327a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:21.352739 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adb9a49-95ad-4af0-9895-c1cf4be4327a service neutron] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:21.393305 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 706/1447] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:01:21 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:01:22.421380 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b764ca47-e672-4c6c-928b-b2d7f7c50e36 service neutron] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:22.424840 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-b764ca47-e672-4c6c-928b-b2d7f7c50e36 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:22.447259 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b764ca47-e672-4c6c-928b-b2d7f7c50e36 service neutron] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:22.492027 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91728c16-c8ac-4039-aaa6-965c4c36f6d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:22.493090 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91728c16-c8ac-4039-aaa6-965c4c36f6d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:22.493558 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91728c16-c8ac-4039-aaa6-965c4c36f6d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:22.494025 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91728c16-c8ac-4039-aaa6-965c4c36f6d8 admin admin] PATH_INFO: `/v3/projects/32f566c5839b4b6fbfc602f9d0d1b2b7` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:22.495543 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91728c16-c8ac-4039-aaa6-965c4c36f6d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=32f566c5839b4b6fbfc602f9d0d1b2b7)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:22.497667 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91728c16-c8ac-4039-aaa6-965c4c36f6d8 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:22.590998 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-91728c16-c8ac-4039-aaa6-965c4c36f6d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32f566c5839b4b6fbfc602f9d0d1b2b7', 'request_id': 'req-91728c16-c8ac-4039-aaa6-965c4c36f6d8'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:22.598460 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:01:22.600386 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-91728c16-c8ac-4039-aaa6-965c4c36f6d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32f566c5839b4b6fbfc602f9d0d1b2b7', 'request_id': 'req-91728c16-c8ac-4039-aaa6-965c4c36f6d8'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:22.609671 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-91728c16-c8ac-4039-aaa6-965c4c36f6d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32f566c5839b4b6fbfc602f9d0d1b2b7', 'request_id': 'req-91728c16-c8ac-4039-aaa6-965c4c36f6d8'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:22.654280 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-91728c16-c8ac-4039-aaa6-965c4c36f6d8 admin admin] The token cache is being invalidate because project 32f566c5839b4b6fbfc602f9d0d1b2b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:01:22.656002 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-91728c16-c8ac-4039-aaa6-965c4c36f6d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:22.657185 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-91728c16-c8ac-4039-aaa6-965c4c36f6d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:22.659666 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 742/1448] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Oct 14 13:01:22 2022] DELETE /identity/v3/projects/32f566c5839b4b6fbfc602f9d0d1b2b7 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:01:22.663439 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adb9a49-95ad-4af0-9895-c1cf4be4327a service neutron] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:22.750277 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adb9a49-95ad-4af0-9895-c1cf4be4327a service neutron] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:22.898279 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33defae3-1669-4dca-849b-747879ae6720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:22.899207 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33defae3-1669-4dca-849b-747879ae6720 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:22.899506 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33defae3-1669-4dca-849b-747879ae6720 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:22.899801 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33defae3-1669-4dca-849b-747879ae6720 admin admin] PATH_INFO: `/v3/users/b613d6c9fc104acc971e469c5360dcf5` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:22.901048 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33defae3-1669-4dca-849b-747879ae6720 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b613d6c9fc104acc971e469c5360dcf5)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:22.903069 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33defae3-1669-4dca-849b-747879ae6720 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:23.020013 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-33defae3-1669-4dca-849b-747879ae6720 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b613d6c9fc104acc971e469c5360dcf5'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:23.035336 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-33defae3-1669-4dca-849b-747879ae6720 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b613d6c9fc104acc971e469c5360dcf5'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:23.038722 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-33defae3-1669-4dca-849b-747879ae6720 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b613d6c9fc104acc971e469c5360dcf5'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:23.065139 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-33defae3-1669-4dca-849b-747879ae6720 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b613d6c9fc104acc971e469c5360dcf5'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:23.104028 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-33defae3-1669-4dca-849b-747879ae6720 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b613d6c9fc104acc971e469c5360dcf5'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:23.119184 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 707/1449] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Oct 14 13:01:22 2022] DELETE /identity/v3/users/b613d6c9fc104acc971e469c5360dcf5 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:01:24.945823 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91728c16-c8ac-4039-aaa6-965c4c36f6d8 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:24.947291 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-91728c16-c8ac-4039-aaa6-965c4c36f6d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:24.988216 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91728c16-c8ac-4039-aaa6-965c4c36f6d8 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:25.237974 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511f2d5c-867b-486b-bfe3-b51a7e188891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:25.238760 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511f2d5c-867b-486b-bfe3-b51a7e188891 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:25.239052 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511f2d5c-867b-486b-bfe3-b51a7e188891 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:25.239329 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511f2d5c-867b-486b-bfe3-b51a7e188891 admin admin] PATH_INFO: `/v3/projects/1012b97156d1400eb6b251f712e58ba2` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:25.243240 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511f2d5c-867b-486b-bfe3-b51a7e188891 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1012b97156d1400eb6b251f712e58ba2)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:25.248755 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511f2d5c-867b-486b-bfe3-b51a7e188891 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:25.398912 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-511f2d5c-867b-486b-bfe3-b51a7e188891 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1012b97156d1400eb6b251f712e58ba2', 'request_id': 'req-511f2d5c-867b-486b-bfe3-b51a7e188891'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:25.412215 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-511f2d5c-867b-486b-bfe3-b51a7e188891 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1012b97156d1400eb6b251f712e58ba2', 'request_id': 'req-511f2d5c-867b-486b-bfe3-b51a7e188891'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:25.427029 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-511f2d5c-867b-486b-bfe3-b51a7e188891 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1012b97156d1400eb6b251f712e58ba2', 'request_id': 'req-511f2d5c-867b-486b-bfe3-b51a7e188891'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:25.485358 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-511f2d5c-867b-486b-bfe3-b51a7e188891 admin admin] The token cache is being invalidate because project 1012b97156d1400eb6b251f712e58ba2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:01:25.487485 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-511f2d5c-867b-486b-bfe3-b51a7e188891 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:25.487975 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-511f2d5c-867b-486b-bfe3-b51a7e188891 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:25.495043 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 743/1450] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Oct 14 13:01:24 2022] DELETE /identity/v3/projects/1012b97156d1400eb6b251f712e58ba2 => generated 0 bytes in 549 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:01:25.499961 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33defae3-1669-4dca-849b-747879ae6720 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:25.501578 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-33defae3-1669-4dca-849b-747879ae6720 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:25.536372 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33defae3-1669-4dca-849b-747879ae6720 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:25.578146 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:01:25.692145 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e201e111-a710-443c-b9b6-488f50db7e9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:25.693342 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e201e111-a710-443c-b9b6-488f50db7e9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:25.693901 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e201e111-a710-443c-b9b6-488f50db7e9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:25.694449 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e201e111-a710-443c-b9b6-488f50db7e9d admin admin] PATH_INFO: `/v3/users/cc50e9e43c434f33ba27ae3810b05b82` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:25.696059 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e201e111-a710-443c-b9b6-488f50db7e9d admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc50e9e43c434f33ba27ae3810b05b82)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:25.698175 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e201e111-a710-443c-b9b6-488f50db7e9d admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:25.810962 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-e201e111-a710-443c-b9b6-488f50db7e9d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc50e9e43c434f33ba27ae3810b05b82'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:25.832501 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-e201e111-a710-443c-b9b6-488f50db7e9d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc50e9e43c434f33ba27ae3810b05b82'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:25.844293 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-e201e111-a710-443c-b9b6-488f50db7e9d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc50e9e43c434f33ba27ae3810b05b82'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:25.862673 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-e201e111-a710-443c-b9b6-488f50db7e9d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc50e9e43c434f33ba27ae3810b05b82'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:25.908544 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-e201e111-a710-443c-b9b6-488f50db7e9d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc50e9e43c434f33ba27ae3810b05b82'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:25.932020 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 708/1451] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Oct 14 13:01:25 2022] DELETE /identity/v3/users/cc50e9e43c434f33ba27ae3810b05b82 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:01:26.298245 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14d927c-a876-490f-9592-656eaab3674c None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:26.300292 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14d927c-a876-490f-9592-656eaab3674c None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:26.301432 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14d927c-a876-490f-9592-656eaab3674c None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:26.305059 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 744/1452] 10.222.0.17 () {54 vars in 921 bytes} [Fri Oct 14 13:01:26 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 13:01:26.329025 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312722c7-b9ff-4375-a2d3-4ade299e869a None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:26.329319 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312722c7-b9ff-4375-a2d3-4ade299e869a None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:26.333620 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312722c7-b9ff-4375-a2d3-4ade299e869a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:26.411113 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-312722c7-b9ff-4375-a2d3-4ade299e869a None None] MFA Rules not processed for user `0a5e5c35ed8b4abc877ba8d8c490dacd`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:01:26.413458 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-312722c7-b9ff-4375-a2d3-4ade299e869a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:26.507011 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14d927c-a876-490f-9592-656eaab3674c None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:26.510284 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-f14d927c-a876-490f-9592-656eaab3674c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:26.598472 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 709/1453] 10.222.0.17 () {58 vars in 1018 bytes} [Fri Oct 14 13:01:26 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:01:26.665980 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14d927c-a876-490f-9592-656eaab3674c None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:26.677191 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312722c7-b9ff-4375-a2d3-4ade299e869a None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:26.678665 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-312722c7-b9ff-4375-a2d3-4ade299e869a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:26.680041 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690e85f1-51bb-4c5c-9970-3e2c496c37dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:26.681589 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690e85f1-51bb-4c5c-9970-3e2c496c37dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:26.682698 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690e85f1-51bb-4c5c-9970-3e2c496c37dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:26.683793 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690e85f1-51bb-4c5c-9970-3e2c496c37dc admin admin] PATH_INFO: `/v3/users/ac6f9d410e524c40acedd10d5a9430ba` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:26.685911 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690e85f1-51bb-4c5c-9970-3e2c496c37dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac6f9d410e524c40acedd10d5a9430ba)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:26.690780 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690e85f1-51bb-4c5c-9970-3e2c496c37dc admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:26.703462 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312722c7-b9ff-4375-a2d3-4ade299e869a None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:26.723164 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc4b1e9-ea38-4a84-8023-3ac05f3dad10 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a5e5c35ed8b4abc877ba8d8c490dacd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:26.723938 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc4b1e9-ea38-4a84-8023-3ac05f3dad10 service placement] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:26.725270 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc4b1e9-ea38-4a84-8023-3ac05f3dad10 service placement] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:26.725751 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc4b1e9-ea38-4a84-8023-3ac05f3dad10 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:26.726867 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:01:26.749153 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc4b1e9-ea38-4a84-8023-3ac05f3dad10 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:26.751574 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc4b1e9-ea38-4a84-8023-3ac05f3dad10 service placement] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:26.810544 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 710/1454] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:01:26 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:01:26.831293 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-690e85f1-51bb-4c5c-9970-3e2c496c37dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac6f9d410e524c40acedd10d5a9430ba'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:26.882185 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-690e85f1-51bb-4c5c-9970-3e2c496c37dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac6f9d410e524c40acedd10d5a9430ba'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:26.886890 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-690e85f1-51bb-4c5c-9970-3e2c496c37dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac6f9d410e524c40acedd10d5a9430ba'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:26.908686 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-690e85f1-51bb-4c5c-9970-3e2c496c37dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac6f9d410e524c40acedd10d5a9430ba'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:26.973997 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-690e85f1-51bb-4c5c-9970-3e2c496c37dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac6f9d410e524c40acedd10d5a9430ba'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:27.024602 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 745/1455] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Oct 14 13:01:26 2022] DELETE /identity/v3/users/ac6f9d410e524c40acedd10d5a9430ba => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:01:27.325409 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9042d97-107f-4f36-b1a7-f0a16272a038 None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:27.325729 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9042d97-107f-4f36-b1a7-f0a16272a038 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:27.325975 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9042d97-107f-4f36-b1a7-f0a16272a038 None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:27.330771 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 711/1456] 10.222.0.17 () {54 vars in 921 bytes} [Fri Oct 14 13:01:27 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 13:01:27.367623 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eea398-3e24-4a8c-9cfb-cbb7dd0ac70e None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:27.368251 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eea398-3e24-4a8c-9cfb-cbb7dd0ac70e None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:27.368251 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eea398-3e24-4a8c-9cfb-cbb7dd0ac70e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:27.419109 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-84eea398-3e24-4a8c-9cfb-cbb7dd0ac70e None None] MFA Rules not processed for user `931f4e32c8764514b5efed31b0785be7`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:01:27.420911 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-84eea398-3e24-4a8c-9cfb-cbb7dd0ac70e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:27.588798 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 746/1457] 10.222.0.17 () {58 vars in 1018 bytes} [Fri Oct 14 13:01:27 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:01:27.672982 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9042d97-107f-4f36-b1a7-f0a16272a038 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:27.675154 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-e9042d97-107f-4f36-b1a7-f0a16272a038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:27.733487 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9042d97-107f-4f36-b1a7-f0a16272a038 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:27.768190 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59d40a5-16d3-45bb-9c69-4c2cf98fa427 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '931f4e32c8764514b5efed31b0785be7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:27.768977 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59d40a5-16d3-45bb-9c69-4c2cf98fa427 service nova] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:27.769280 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59d40a5-16d3-45bb-9c69-4c2cf98fa427 service nova] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:27.770208 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59d40a5-16d3-45bb-9c69-4c2cf98fa427 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:27.795568 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59d40a5-16d3-45bb-9c69-4c2cf98fa427 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:27.797312 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59d40a5-16d3-45bb-9c69-4c2cf98fa427 service nova] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:27.822633 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 712/1458] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:01:27 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:01:28.412324 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eea398-3e24-4a8c-9cfb-cbb7dd0ac70e None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:28.414238 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-84eea398-3e24-4a8c-9cfb-cbb7dd0ac70e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:28.602028 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eea398-3e24-4a8c-9cfb-cbb7dd0ac70e None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:28.638291 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc34e2c-f9ca-482b-a426-e2e15dcf4f52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:28.639780 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc34e2c-f9ca-482b-a426-e2e15dcf4f52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:28.640096 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc34e2c-f9ca-482b-a426-e2e15dcf4f52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:28.640324 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc34e2c-f9ca-482b-a426-e2e15dcf4f52 admin admin] PATH_INFO: `/v3/users/f40545d3e6194632ab657901b6a57d41` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:28.641531 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc34e2c-f9ca-482b-a426-e2e15dcf4f52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f40545d3e6194632ab657901b6a57d41)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:28.643500 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc34e2c-f9ca-482b-a426-e2e15dcf4f52 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:28.707514 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:01:28.750931 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-4dc34e2c-f9ca-482b-a426-e2e15dcf4f52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f40545d3e6194632ab657901b6a57d41'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:28.768519 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-4dc34e2c-f9ca-482b-a426-e2e15dcf4f52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f40545d3e6194632ab657901b6a57d41'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:28.769594 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-4dc34e2c-f9ca-482b-a426-e2e15dcf4f52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f40545d3e6194632ab657901b6a57d41'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:28.787842 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-4dc34e2c-f9ca-482b-a426-e2e15dcf4f52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f40545d3e6194632ab657901b6a57d41'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:28.817823 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-4dc34e2c-f9ca-482b-a426-e2e15dcf4f52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f40545d3e6194632ab657901b6a57d41'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:28.835559 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 747/1459] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Oct 14 13:01:28 2022] DELETE /identity/v3/users/f40545d3e6194632ab657901b6a57d41 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 13:01:28.840927 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fd5d4a-67e1-4a24-b501-cca437678f4d None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:28.841459 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fd5d4a-67e1-4a24-b501-cca437678f4d None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:28.841664 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fd5d4a-67e1-4a24-b501-cca437678f4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:28.903752 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-76fd5d4a-67e1-4a24-b501-cca437678f4d None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:01:28.905818 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-76fd5d4a-67e1-4a24-b501-cca437678f4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:28.928983 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:01:29.054491 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 713/1460] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:01:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:01:29.085050 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc34e2c-f9ca-482b-a426-e2e15dcf4f52 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:29.086685 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-4dc34e2c-f9ca-482b-a426-e2e15dcf4f52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:29.244843 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc34e2c-f9ca-482b-a426-e2e15dcf4f52 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:29.252222 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7fc9c6-5faf-4224-86cf-c76a7408794e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d483292f3a4794848fcacfba5b107e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:29.254028 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7fc9c6-5faf-4224-86cf-c76a7408794e service neutron] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:29.255923 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7fc9c6-5faf-4224-86cf-c76a7408794e service neutron] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:29.256437 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7fc9c6-5faf-4224-86cf-c76a7408794e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:29.282298 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7fc9c6-5faf-4224-86cf-c76a7408794e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:29.286979 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7fc9c6-5faf-4224-86cf-c76a7408794e service neutron] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:29.312143 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 748/1461] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:01:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:01:29.415798 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fd5d4a-67e1-4a24-b501-cca437678f4d None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:29.417684 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-76fd5d4a-67e1-4a24-b501-cca437678f4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:29.440956 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fd5d4a-67e1-4a24-b501-cca437678f4d None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:29.455745 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dde9f1a-9b30-462f-abcc-aa5438c553b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:29.457447 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dde9f1a-9b30-462f-abcc-aa5438c553b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:29.457981 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dde9f1a-9b30-462f-abcc-aa5438c553b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:29.458487 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dde9f1a-9b30-462f-abcc-aa5438c553b3 admin admin] PATH_INFO: `/v3/projects/faa6cdabf4b34b6681d5ac1077eb080f` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:29.460214 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dde9f1a-9b30-462f-abcc-aa5438c553b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=faa6cdabf4b34b6681d5ac1077eb080f)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:29.464444 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dde9f1a-9b30-462f-abcc-aa5438c553b3 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:29.597529 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-0dde9f1a-9b30-462f-abcc-aa5438c553b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'faa6cdabf4b34b6681d5ac1077eb080f', 'request_id': 'req-0dde9f1a-9b30-462f-abcc-aa5438c553b3'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:29.621418 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-0dde9f1a-9b30-462f-abcc-aa5438c553b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'faa6cdabf4b34b6681d5ac1077eb080f', 'request_id': 'req-0dde9f1a-9b30-462f-abcc-aa5438c553b3'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:29.656184 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-0dde9f1a-9b30-462f-abcc-aa5438c553b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'faa6cdabf4b34b6681d5ac1077eb080f', 'request_id': 'req-0dde9f1a-9b30-462f-abcc-aa5438c553b3'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:29.717901 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-0dde9f1a-9b30-462f-abcc-aa5438c553b3 admin admin] The token cache is being invalidate because project faa6cdabf4b34b6681d5ac1077eb080f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:01:29.719208 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-0dde9f1a-9b30-462f-abcc-aa5438c553b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:29.721262 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-0dde9f1a-9b30-462f-abcc-aa5438c553b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:29.728297 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 714/1462] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Oct 14 13:01:29 2022] DELETE /identity/v3/projects/faa6cdabf4b34b6681d5ac1077eb080f => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 13:01:29.735873 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fea7e84-712e-43e0-837c-73ccf2a40505 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:29.736529 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fea7e84-712e-43e0-837c-73ccf2a40505 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:29.736899 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fea7e84-712e-43e0-837c-73ccf2a40505 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:29.801541 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-3fea7e84-712e-43e0-837c-73ccf2a40505 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:01:29.803413 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-3fea7e84-712e-43e0-837c-73ccf2a40505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:29.900297 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dde9f1a-9b30-462f-abcc-aa5438c553b3 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:29.902415 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-0dde9f1a-9b30-462f-abcc-aa5438c553b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:29.985339 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 749/1463] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:01:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:01:29.986863 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f33316-0606-4b61-a69e-9c2f859c9012 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:29.987167 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f33316-0606-4b61-a69e-9c2f859c9012 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:29.987447 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f33316-0606-4b61-a69e-9c2f859c9012 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:30.053076 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-c3f33316-0606-4b61-a69e-9c2f859c9012 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:01:30.061472 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-c3f33316-0606-4b61-a69e-9c2f859c9012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:30.083220 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dde9f1a-9b30-462f-abcc-aa5438c553b3 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:30.092160 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 750/1464] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:01:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:01:30.096977 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f33316-0606-4b61-a69e-9c2f859c9012 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:30.105879 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777cb021-8d7d-443c-8409-bdf303c5f0a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:30.106613 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777cb021-8d7d-443c-8409-bdf303c5f0a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:30.106921 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777cb021-8d7d-443c-8409-bdf303c5f0a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:30.107187 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777cb021-8d7d-443c-8409-bdf303c5f0a9 admin admin] PATH_INFO: `/v3/projects/231d3ca5af264c608e40702ddd7df172` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:30.108849 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777cb021-8d7d-443c-8409-bdf303c5f0a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=231d3ca5af264c608e40702ddd7df172)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:30.113483 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777cb021-8d7d-443c-8409-bdf303c5f0a9 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:30.127351 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f33316-0606-4b61-a69e-9c2f859c9012 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:30.142162 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6abb48-caed-49f0-a871-5aafeaed9c41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:30.142880 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6abb48-caed-49f0-a871-5aafeaed9c41 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:30.145270 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6abb48-caed-49f0-a871-5aafeaed9c41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:30.147711 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6abb48-caed-49f0-a871-5aafeaed9c41 admin admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:30.149787 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6abb48-caed-49f0-a871-5aafeaed9c41 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 13:01:30.150110 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6abb48-caed-49f0-a871-5aafeaed9c41 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:30.156585 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6abb48-caed-49f0-a871-5aafeaed9c41 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:30.197278 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 751/1465] 10.222.0.17 () {58 vars in 1153 bytes} [Fri Oct 14 13:01:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 13:01:30.198703 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6abb48-caed-49f0-a871-5aafeaed9c41 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:30.236101 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6abb48-caed-49f0-a871-5aafeaed9c41 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:30.240296 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:01:30.254733 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-777cb021-8d7d-443c-8409-bdf303c5f0a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '231d3ca5af264c608e40702ddd7df172', 'request_id': 'req-777cb021-8d7d-443c-8409-bdf303c5f0a9'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:30.262042 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-777cb021-8d7d-443c-8409-bdf303c5f0a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '231d3ca5af264c608e40702ddd7df172', 'request_id': 'req-777cb021-8d7d-443c-8409-bdf303c5f0a9'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:30.270446 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-777cb021-8d7d-443c-8409-bdf303c5f0a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '231d3ca5af264c608e40702ddd7df172', 'request_id': 'req-777cb021-8d7d-443c-8409-bdf303c5f0a9'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:30.293499 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-777cb021-8d7d-443c-8409-bdf303c5f0a9 admin admin] The token cache is being invalidate because project 231d3ca5af264c608e40702ddd7df172 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:01:30.294500 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-777cb021-8d7d-443c-8409-bdf303c5f0a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:30.296718 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-777cb021-8d7d-443c-8409-bdf303c5f0a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:30.302358 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 715/1466] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Oct 14 13:01:29 2022] DELETE /identity/v3/projects/231d3ca5af264c608e40702ddd7df172 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 13:01:30.303964 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777cb021-8d7d-443c-8409-bdf303c5f0a9 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:30.307618 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-777cb021-8d7d-443c-8409-bdf303c5f0a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:30.331856 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:01:30.406440 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777cb021-8d7d-443c-8409-bdf303c5f0a9 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:30.417630 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c225c38-2e7f-4a27-886a-4ea76791d4fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:30.420236 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9bec9e-5405-44d5-84ab-7abc99c2c2e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:30.421098 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9bec9e-5405-44d5-84ab-7abc99c2c2e6 admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:30.421687 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c225c38-2e7f-4a27-886a-4ea76791d4fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:30.422438 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9bec9e-5405-44d5-84ab-7abc99c2c2e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:30.422669 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c225c38-2e7f-4a27-886a-4ea76791d4fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:30.423471 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c225c38-2e7f-4a27-886a-4ea76791d4fe admin admin] PATH_INFO: `/v3/projects/d1ecffec30504ffc81f39870277d0ad3` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:30.424485 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9bec9e-5405-44d5-84ab-7abc99c2c2e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:30.425351 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9bec9e-5405-44d5-84ab-7abc99c2c2e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:30.427596 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c225c38-2e7f-4a27-886a-4ea76791d4fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1ecffec30504ffc81f39870277d0ad3)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:30.429740 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c225c38-2e7f-4a27-886a-4ea76791d4fe admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:30.431368 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9bec9e-5405-44d5-84ab-7abc99c2c2e6 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:30.476668 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 752/1467] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Oct 14 13:01:30 2022] POST /identity/v3/projects => generated 367 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:01:30.476668 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9bec9e-5405-44d5-84ab-7abc99c2c2e6 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:30.479427 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-7a9bec9e-5405-44d5-84ab-7abc99c2c2e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:30.546383 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-8c225c38-2e7f-4a27-886a-4ea76791d4fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1ecffec30504ffc81f39870277d0ad3', 'request_id': 'req-8c225c38-2e7f-4a27-886a-4ea76791d4fe'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:30.562083 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-8c225c38-2e7f-4a27-886a-4ea76791d4fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1ecffec30504ffc81f39870277d0ad3', 'request_id': 'req-8c225c38-2e7f-4a27-886a-4ea76791d4fe'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:30.597401 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-8c225c38-2e7f-4a27-886a-4ea76791d4fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1ecffec30504ffc81f39870277d0ad3', 'request_id': 'req-8c225c38-2e7f-4a27-886a-4ea76791d4fe'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:30.630295 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-8c225c38-2e7f-4a27-886a-4ea76791d4fe admin admin] The token cache is being invalidate because project d1ecffec30504ffc81f39870277d0ad3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:01:30.630737 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-8c225c38-2e7f-4a27-886a-4ea76791d4fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:30.631345 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-8c225c38-2e7f-4a27-886a-4ea76791d4fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:30.640485 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 716/1468] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Oct 14 13:01:30 2022] DELETE /identity/v3/projects/d1ecffec30504ffc81f39870277d0ad3 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:01:30.641357 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c225c38-2e7f-4a27-886a-4ea76791d4fe admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:30.642861 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-8c225c38-2e7f-4a27-886a-4ea76791d4fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:30.676237 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9bec9e-5405-44d5-84ab-7abc99c2c2e6 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:30.814080 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:01:30.826807 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c225c38-2e7f-4a27-886a-4ea76791d4fe admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:30.839128 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccbc2b9-3f3c-4455-8978-fd0c8ce26670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:30.840693 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccbc2b9-3f3c-4455-8978-fd0c8ce26670 admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:30.840983 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccbc2b9-3f3c-4455-8978-fd0c8ce26670 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:30.841267 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccbc2b9-3f3c-4455-8978-fd0c8ce26670 admin admin] PATH_INFO: `/v3/users` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:30.842225 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccbc2b9-3f3c-4455-8978-fd0c8ce26670 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:30.843088 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a2a724-ca1a-48fc-9087-314294ccdef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:30.844218 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccbc2b9-3f3c-4455-8978-fd0c8ce26670 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:30.844751 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a2a724-ca1a-48fc-9087-314294ccdef5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:30.845298 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a2a724-ca1a-48fc-9087-314294ccdef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:30.845771 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a2a724-ca1a-48fc-9087-314294ccdef5 admin admin] PATH_INFO: `/v3/users/d0e10d94f3fa4a63a8ffd04f9640428d` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:30.847382 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a2a724-ca1a-48fc-9087-314294ccdef5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0e10d94f3fa4a63a8ffd04f9640428d)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:30.850156 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a2a724-ca1a-48fc-9087-314294ccdef5 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:30.891625 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 717/1469] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Oct 14 13:01:30 2022] POST /identity/v3/users => generated 284 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:01:30.891625 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576628b7-1a39-4bf6-b0f5-f52dc61c1aee None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:30.891625 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576628b7-1a39-4bf6-b0f5-f52dc61c1aee None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:30.891625 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576628b7-1a39-4bf6-b0f5-f52dc61c1aee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:30.945757 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-576628b7-1a39-4bf6-b0f5-f52dc61c1aee None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:01:30.947732 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-576628b7-1a39-4bf6-b0f5-f52dc61c1aee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:30.958684 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-66a2a724-ca1a-48fc-9087-314294ccdef5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0e10d94f3fa4a63a8ffd04f9640428d'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:30.970727 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 718/1470] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:01:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:01:30.977706 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576628b7-1a39-4bf6-b0f5-f52dc61c1aee None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:30.977891 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-66a2a724-ca1a-48fc-9087-314294ccdef5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0e10d94f3fa4a63a8ffd04f9640428d'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:30.977891 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-66a2a724-ca1a-48fc-9087-314294ccdef5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0e10d94f3fa4a63a8ffd04f9640428d'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:30.989968 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576628b7-1a39-4bf6-b0f5-f52dc61c1aee None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:30.991351 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-66a2a724-ca1a-48fc-9087-314294ccdef5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0e10d94f3fa4a63a8ffd04f9640428d'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:30.994115 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:01:31.008497 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b789076b-436f-4166-8d96-249677be6ead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:31.011653 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b789076b-436f-4166-8d96-249677be6ead admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:31.011958 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b789076b-436f-4166-8d96-249677be6ead admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:31.012238 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b789076b-436f-4166-8d96-249677be6ead admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:31.012912 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b789076b-436f-4166-8d96-249677be6ead admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:31.018569 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b789076b-436f-4166-8d96-249677be6ead admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:31.021852 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-66a2a724-ca1a-48fc-9087-314294ccdef5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0e10d94f3fa4a63a8ffd04f9640428d'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:31.036098 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 753/1471] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Oct 14 13:01:30 2022] DELETE /identity/v3/users/d0e10d94f3fa4a63a8ffd04f9640428d => generated 0 bytes in 561 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:01:31.038736 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a56c49b-5da1-4c00-8aa8-921c80544507 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:31.039025 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a56c49b-5da1-4c00-8aa8-921c80544507 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:31.039293 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a56c49b-5da1-4c00-8aa8-921c80544507 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:31.043123 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 719/1472] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:01:30 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:01:31.047281 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b789076b-436f-4166-8d96-249677be6ead admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:31.050306 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-b789076b-436f-4166-8d96-249677be6ead admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:31.081648 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b789076b-436f-4166-8d96-249677be6ead admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:31.093144 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-4a56c49b-5da1-4c00-8aa8-921c80544507 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:01:31.098848 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-4a56c49b-5da1-4c00-8aa8-921c80544507 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:31.261337 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 754/1473] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:01:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:01:31.267444 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e7e97b-19f8-439b-9b76-9ea35a7dead3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:31.268602 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a56c49b-5da1-4c00-8aa8-921c80544507 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:31.268721 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e7e97b-19f8-439b-9b76-9ea35a7dead3 admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:31.269227 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e7e97b-19f8-439b-9b76-9ea35a7dead3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:31.269651 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e7e97b-19f8-439b-9b76-9ea35a7dead3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:31.270535 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e7e97b-19f8-439b-9b76-9ea35a7dead3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:31.272393 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e7e97b-19f8-439b-9b76-9ea35a7dead3 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:31.281779 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a56c49b-5da1-4c00-8aa8-921c80544507 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:31.289979 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaf10d1-5223-422b-bc3a-e769ea29a510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:31.290999 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaf10d1-5223-422b-bc3a-e769ea29a510 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:31.291128 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaf10d1-5223-422b-bc3a-e769ea29a510 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:31.291451 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaf10d1-5223-422b-bc3a-e769ea29a510 admin admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:31.293207 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eaf10d1-5223-422b-bc3a-e769ea29a510 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 13:01:31.293731 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eaf10d1-5223-422b-bc3a-e769ea29a510 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:31.296036 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eaf10d1-5223-422b-bc3a-e769ea29a510 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:31.321537 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 755/1474] 10.222.0.17 () {58 vars in 1153 bytes} [Fri Oct 14 13:01:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 13:01:31.322633 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaf10d1-5223-422b-bc3a-e769ea29a510 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:31.322933 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 720/1475] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:01:31 2022] GET /identity/v3/roles => generated 1420 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:01:31.326312 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e7e97b-19f8-439b-9b76-9ea35a7dead3 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:31.337266 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaf10d1-5223-422b-bc3a-e769ea29a510 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:31.347125 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f66073-3713-410a-bbd8-13d0ba2cce16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:31.347753 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f66073-3713-410a-bbd8-13d0ba2cce16 admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:31.348030 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f66073-3713-410a-bbd8-13d0ba2cce16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:31.348301 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f66073-3713-410a-bbd8-13d0ba2cce16 admin admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:31.348943 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f66073-3713-410a-bbd8-13d0ba2cce16 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:31.349711 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e7e97b-19f8-439b-9b76-9ea35a7dead3 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:31.351227 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f66073-3713-410a-bbd8-13d0ba2cce16 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:31.369873 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a04a8a-7bf7-4102-9a75-6e79baeff0e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:31.372075 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a04a8a-7bf7-4102-9a75-6e79baeff0e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:31.372370 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a04a8a-7bf7-4102-9a75-6e79baeff0e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:31.372655 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a04a8a-7bf7-4102-9a75-6e79baeff0e6 admin admin] PATH_INFO: `/v3/projects/6367f95141b24cb69058933cea2192a1/users/b986c326e118474490f1f32cb43d3e8e/roles/5e8849303a75425b9eaa2681cc031af1` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:31.409809 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a04a8a-7bf7-4102-9a75-6e79baeff0e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6367f95141b24cb69058933cea2192a1, user_id=b986c326e118474490f1f32cb43d3e8e, role_id=5e8849303a75425b9eaa2681cc031af1)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:31.413640 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a04a8a-7bf7-4102-9a75-6e79baeff0e6 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:31.429941 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 756/1476] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Oct 14 13:01:31 2022] POST /identity/v3/projects => generated 401 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:01:31.432684 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f66073-3713-410a-bbd8-13d0ba2cce16 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:31.471236 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 721/1477] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Oct 14 13:01:31 2022] PUT /identity/v3/projects/6367f95141b24cb69058933cea2192a1/users/b986c326e118474490f1f32cb43d3e8e/roles/5e8849303a75425b9eaa2681cc031af1 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:01:31.473268 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1456acd1-9537-4526-be0d-c6fafa886150 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:31.473560 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1456acd1-9537-4526-be0d-c6fafa886150 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:31.473843 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1456acd1-9537-4526-be0d-c6fafa886150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:31.536033 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f66073-3713-410a-bbd8-13d0ba2cce16 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:31.553583 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-1456acd1-9537-4526-be0d-c6fafa886150 None None] MFA Rules not processed for user `b986c326e118474490f1f32cb43d3e8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:01:31.555256 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-1456acd1-9537-4526-be0d-c6fafa886150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:31.728328 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 722/1478] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:01:31 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:01:31.729990 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1456acd1-9537-4526-be0d-c6fafa886150 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:31.734266 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-1456acd1-9537-4526-be0d-c6fafa886150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:31.775066 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:01:31.805922 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00143673-0360-4ef6-b4b8-554d58d2cc80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:31.806607 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00143673-0360-4ef6-b4b8-554d58d2cc80 admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:31.806926 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00143673-0360-4ef6-b4b8-554d58d2cc80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:31.807259 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00143673-0360-4ef6-b4b8-554d58d2cc80 admin admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:31.807944 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00143673-0360-4ef6-b4b8-554d58d2cc80 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:31.813497 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:01:31.815524 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00143673-0360-4ef6-b4b8-554d58d2cc80 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:31.854583 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 757/1479] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Oct 14 13:01:31 2022] POST /identity/v3/users => generated 301 bytes in 424 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:01:31.855611 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00143673-0360-4ef6-b4b8-554d58d2cc80 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:31.882174 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00143673-0360-4ef6-b4b8-554d58d2cc80 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:31.882174 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3447d7f8-3957-41f9-943f-9f9d2aacc03b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:31.882174 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3447d7f8-3957-41f9-943f-9f9d2aacc03b admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:31.882174 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3447d7f8-3957-41f9-943f-9f9d2aacc03b admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:31.882576 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3447d7f8-3957-41f9-943f-9f9d2aacc03b admin admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:31.882576 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3447d7f8-3957-41f9-943f-9f9d2aacc03b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:31.882576 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3447d7f8-3957-41f9-943f-9f9d2aacc03b admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:31.931289 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1456acd1-9537-4526-be0d-c6fafa886150 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:31.958391 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 758/1480] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Oct 14 13:01:31 2022] POST /identity/v3/projects => generated 369 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:01:31.962763 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3447d7f8-3957-41f9-943f-9f9d2aacc03b admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:32.055211 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3447d7f8-3957-41f9-943f-9f9d2aacc03b admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:32.060742 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd44b42-9c7d-4520-9ac7-2d8e6b8d30a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:32.061967 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd44b42-9c7d-4520-9ac7-2d8e6b8d30a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:32.062378 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd44b42-9c7d-4520-9ac7-2d8e6b8d30a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:32.062685 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd44b42-9c7d-4520-9ac7-2d8e6b8d30a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:32.064535 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd44b42-9c7d-4520-9ac7-2d8e6b8d30a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:32.066751 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd44b42-9c7d-4520-9ac7-2d8e6b8d30a7 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:32.088091 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 759/1481] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:01:31 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:01:32.089185 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd44b42-9c7d-4520-9ac7-2d8e6b8d30a7 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:32.111270 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd44b42-9c7d-4520-9ac7-2d8e6b8d30a7 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:32.116047 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53423e8e-d656-466b-8d27-c5bf60392bc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:32.116891 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53423e8e-d656-466b-8d27-c5bf60392bc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:32.117298 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53423e8e-d656-466b-8d27-c5bf60392bc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:32.117589 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53423e8e-d656-466b-8d27-c5bf60392bc4 admin admin] PATH_INFO: `/v3/projects/2f77c558e7014f638c40f32989c20492` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:32.120802 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53423e8e-d656-466b-8d27-c5bf60392bc4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f77c558e7014f638c40f32989c20492)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:32.124218 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde9fd02-f694-425e-bd71-3d909e688156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:32.124491 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53423e8e-d656-466b-8d27-c5bf60392bc4 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:32.124849 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde9fd02-f694-425e-bd71-3d909e688156 admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:32.125136 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde9fd02-f694-425e-bd71-3d909e688156 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:32.125413 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde9fd02-f694-425e-bd71-3d909e688156 admin admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:32.126083 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde9fd02-f694-425e-bd71-3d909e688156 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:32.128086 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde9fd02-f694-425e-bd71-3d909e688156 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:32.191675 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 760/1482] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Oct 14 13:01:32 2022] POST /identity/v3/users => generated 291 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:01:32.193080 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde9fd02-f694-425e-bd71-3d909e688156 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:32.227311 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde9fd02-f694-425e-bd71-3d909e688156 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:32.254867 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-53423e8e-d656-466b-8d27-c5bf60392bc4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f77c558e7014f638c40f32989c20492', 'request_id': 'req-53423e8e-d656-466b-8d27-c5bf60392bc4'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:32.310559 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-53423e8e-d656-466b-8d27-c5bf60392bc4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f77c558e7014f638c40f32989c20492', 'request_id': 'req-53423e8e-d656-466b-8d27-c5bf60392bc4'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:32.324032 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-53423e8e-d656-466b-8d27-c5bf60392bc4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f77c558e7014f638c40f32989c20492', 'request_id': 'req-53423e8e-d656-466b-8d27-c5bf60392bc4'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:32.352044 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-53423e8e-d656-466b-8d27-c5bf60392bc4 admin admin] The token cache is being invalidate because project 2f77c558e7014f638c40f32989c20492 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:01:32.352451 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-53423e8e-d656-466b-8d27-c5bf60392bc4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:32.353053 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-53423e8e-d656-466b-8d27-c5bf60392bc4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:32.359104 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 723/1483] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Oct 14 13:01:31 2022] DELETE /identity/v3/projects/2f77c558e7014f638c40f32989c20492 => generated 0 bytes in 626 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:01:32.362848 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53423e8e-d656-466b-8d27-c5bf60392bc4 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:32.365762 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-53423e8e-d656-466b-8d27-c5bf60392bc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:32.372387 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433306bf-6fb2-46f8-b6c1-facfdbfb06f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:32.375096 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433306bf-6fb2-46f8-b6c1-facfdbfb06f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:32.376427 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433306bf-6fb2-46f8-b6c1-facfdbfb06f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:32.377334 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433306bf-6fb2-46f8-b6c1-facfdbfb06f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:32.380037 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433306bf-6fb2-46f8-b6c1-facfdbfb06f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:32.380783 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53423e8e-d656-466b-8d27-c5bf60392bc4 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:32.384536 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433306bf-6fb2-46f8-b6c1-facfdbfb06f8 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:32.386499 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087e0af5-507b-4624-870e-a9f82c33fd0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:32.387119 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087e0af5-507b-4624-870e-a9f82c33fd0d admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:32.387398 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087e0af5-507b-4624-870e-a9f82c33fd0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:32.387720 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087e0af5-507b-4624-870e-a9f82c33fd0d admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:32.388730 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087e0af5-507b-4624-870e-a9f82c33fd0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:32.390725 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087e0af5-507b-4624-870e-a9f82c33fd0d admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:32.408230 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 724/1484] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:01:32 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:01:32.409364 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087e0af5-507b-4624-870e-a9f82c33fd0d admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:32.412776 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-087e0af5-507b-4624-870e-a9f82c33fd0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:32.413476 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 761/1485] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:01:32 2022] GET /identity/v3/roles => generated 1420 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:01:32.415472 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433306bf-6fb2-46f8-b6c1-facfdbfb06f8 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:32.432774 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433306bf-6fb2-46f8-b6c1-facfdbfb06f8 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:32.433106 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087e0af5-507b-4624-870e-a9f82c33fd0d admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:32.439723 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99df5ff9-4cc8-4227-875d-2ee04ce6857d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:32.441246 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fc0834-18f9-4bba-9852-c92f56f06730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:32.441386 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fc0834-18f9-4bba-9852-c92f56f06730 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:32.441825 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fc0834-18f9-4bba-9852-c92f56f06730 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:32.442102 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fc0834-18f9-4bba-9852-c92f56f06730 admin admin] PATH_INFO: `/v3/users/8cfdd55a58f248a0bb47dc10fd0e5543` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:32.443537 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fc0834-18f9-4bba-9852-c92f56f06730 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8cfdd55a58f248a0bb47dc10fd0e5543)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:32.444070 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99df5ff9-4cc8-4227-875d-2ee04ce6857d admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:32.445861 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fc0834-18f9-4bba-9852-c92f56f06730 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:32.446328 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99df5ff9-4cc8-4227-875d-2ee04ce6857d admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:32.446838 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99df5ff9-4cc8-4227-875d-2ee04ce6857d admin admin] PATH_INFO: `/v3/projects/4551642c3a534ceea952d2c83676f65d/users/902e3b64d31d4e8eab5b8080ba1b4cce/roles/7f6e29e390bc41f7a9af17659a2e95d1` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:32.471245 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99df5ff9-4cc8-4227-875d-2ee04ce6857d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4551642c3a534ceea952d2c83676f65d, user_id=902e3b64d31d4e8eab5b8080ba1b4cce, role_id=7f6e29e390bc41f7a9af17659a2e95d1)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:32.473933 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99df5ff9-4cc8-4227-875d-2ee04ce6857d admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:32.503784 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 762/1486] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Oct 14 13:01:32 2022] PUT /identity/v3/projects/4551642c3a534ceea952d2c83676f65d/users/902e3b64d31d4e8eab5b8080ba1b4cce/roles/7f6e29e390bc41f7a9af17659a2e95d1 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:01:32.503784 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99df5ff9-4cc8-4227-875d-2ee04ce6857d admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:32.508023 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-99df5ff9-4cc8-4227-875d-2ee04ce6857d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:32.523979 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:01:32.527338 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-44fc0834-18f9-4bba-9852-c92f56f06730 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8cfdd55a58f248a0bb47dc10fd0e5543'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:32.530667 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:01:32.541384 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-44fc0834-18f9-4bba-9852-c92f56f06730 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8cfdd55a58f248a0bb47dc10fd0e5543'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:32.542572 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-44fc0834-18f9-4bba-9852-c92f56f06730 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8cfdd55a58f248a0bb47dc10fd0e5543'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:32.555897 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-44fc0834-18f9-4bba-9852-c92f56f06730 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8cfdd55a58f248a0bb47dc10fd0e5543'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:32.580293 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-44fc0834-18f9-4bba-9852-c92f56f06730 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8cfdd55a58f248a0bb47dc10fd0e5543'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:32.590795 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 725/1487] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Oct 14 13:01:32 2022] DELETE /identity/v3/users/8cfdd55a58f248a0bb47dc10fd0e5543 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:01:32.592385 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fc0834-18f9-4bba-9852-c92f56f06730 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:32.594012 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-44fc0834-18f9-4bba-9852-c92f56f06730 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:32.608610 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99df5ff9-4cc8-4227-875d-2ee04ce6857d admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:32.714437 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e0c5fa-f3e8-48f6-95e9-917f1ad25a53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:32.715438 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e0c5fa-f3e8-48f6-95e9-917f1ad25a53 admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:32.715563 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e0c5fa-f3e8-48f6-95e9-917f1ad25a53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:32.715816 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e0c5fa-f3e8-48f6-95e9-917f1ad25a53 admin admin] PATH_INFO: `/v3/projects/120e65c0f59e455c823f5b6c5f8d67c3/users/be21e157413f463a9de771672f7218c9/roles/5e8849303a75425b9eaa2681cc031af1` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:32.722078 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fc0834-18f9-4bba-9852-c92f56f06730 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:32.733673 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5154584a-6694-400a-bf11-0a81c23ef41e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:32.738668 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5154584a-6694-400a-bf11-0a81c23ef41e admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:32.739066 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5154584a-6694-400a-bf11-0a81c23ef41e admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:32.739598 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5154584a-6694-400a-bf11-0a81c23ef41e admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:32.740487 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5154584a-6694-400a-bf11-0a81c23ef41e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:32.741333 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e0c5fa-f3e8-48f6-95e9-917f1ad25a53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=120e65c0f59e455c823f5b6c5f8d67c3, user_id=be21e157413f463a9de771672f7218c9, role_id=5e8849303a75425b9eaa2681cc031af1)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:32.742650 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5154584a-6694-400a-bf11-0a81c23ef41e admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:32.745202 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e0c5fa-f3e8-48f6-95e9-917f1ad25a53 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:32.759167 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 726/1488] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:01:32 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:01:32.760024 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5154584a-6694-400a-bf11-0a81c23ef41e admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:32.771345 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5154584a-6694-400a-bf11-0a81c23ef41e admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:32.773685 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 763/1489] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Oct 14 13:01:32 2022] PUT /identity/v3/projects/120e65c0f59e455c823f5b6c5f8d67c3/users/be21e157413f463a9de771672f7218c9/roles/5e8849303a75425b9eaa2681cc031af1 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:01:32.784725 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f24ac4-5cc4-4d2c-a980-f59f4eed31c0 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:32.785528 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f24ac4-5cc4-4d2c-a980-f59f4eed31c0 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:32.786607 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f24ac4-5cc4-4d2c-a980-f59f4eed31c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:32.820585 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-92f24ac4-5cc4-4d2c-a980-f59f4eed31c0 None None] MFA Rules not processed for user `be21e157413f463a9de771672f7218c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:01:32.821824 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-92f24ac4-5cc4-4d2c-a980-f59f4eed31c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:32.841732 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef260247-442d-4eaf-bd22-a03bb29999cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:32.842105 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef260247-442d-4eaf-bd22-a03bb29999cf admin admin] REQUEST_METHOD: `PUT` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:32.842420 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef260247-442d-4eaf-bd22-a03bb29999cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:32.842693 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef260247-442d-4eaf-bd22-a03bb29999cf admin admin] PATH_INFO: `/v3/projects/4551642c3a534ceea952d2c83676f65d/users/902e3b64d31d4e8eab5b8080ba1b4cce/roles/7f6e29e390bc41f7a9af17659a2e95d1` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:32.844776 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef260247-442d-4eaf-bd22-a03bb29999cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=4551642c3a534ceea952d2c83676f65d, user_id=902e3b64d31d4e8eab5b8080ba1b4cce, role_id=7f6e29e390bc41f7a9af17659a2e95d1)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:32.847515 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef260247-442d-4eaf-bd22-a03bb29999cf admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:32.860656 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 727/1490] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Oct 14 13:01:32 2022] PUT /identity/v3/projects/4551642c3a534ceea952d2c83676f65d/users/902e3b64d31d4e8eab5b8080ba1b4cce/roles/7f6e29e390bc41f7a9af17659a2e95d1 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:01:32.872000 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee00b049-3ed7-40ab-baae-8d8f78ca6cdd None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:32.872298 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee00b049-3ed7-40ab-baae-8d8f78ca6cdd None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:32.872573 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee00b049-3ed7-40ab-baae-8d8f78ca6cdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:32.911501 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 764/1491] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:01:32 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:01:32.912007 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-ee00b049-3ed7-40ab-baae-8d8f78ca6cdd None None] MFA Rules not processed for user `902e3b64d31d4e8eab5b8080ba1b4cce`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:01:32.912007 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-ee00b049-3ed7-40ab-baae-8d8f78ca6cdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:32.913231 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f24ac4-5cc4-4d2c-a980-f59f4eed31c0 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:32.915629 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-92f24ac4-5cc4-4d2c-a980-f59f4eed31c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:32.949296 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f24ac4-5cc4-4d2c-a980-f59f4eed31c0 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:32.977974 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:01:33.005463 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:01:33.017196 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 728/1492] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:01:32 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 13:01:33.018636 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee00b049-3ed7-40ab-baae-8d8f78ca6cdd None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:33.020237 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-ee00b049-3ed7-40ab-baae-8d8f78ca6cdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:33.041651 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f048d6e9-26fa-41ec-b9cb-c293cb2bee31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:33.042418 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f048d6e9-26fa-41ec-b9cb-c293cb2bee31 admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:33.042772 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f048d6e9-26fa-41ec-b9cb-c293cb2bee31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:33.043112 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f048d6e9-26fa-41ec-b9cb-c293cb2bee31 admin admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:33.043820 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f048d6e9-26fa-41ec-b9cb-c293cb2bee31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:33.047171 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f048d6e9-26fa-41ec-b9cb-c293cb2bee31 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:33.105874 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 765/1493] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Oct 14 13:01:32 2022] POST /identity/v3/projects => generated 399 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 13:01:33.108349 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f048d6e9-26fa-41ec-b9cb-c293cb2bee31 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:33.111670 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-f048d6e9-26fa-41ec-b9cb-c293cb2bee31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:33.149750 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee00b049-3ed7-40ab-baae-8d8f78ca6cdd None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:33.201560 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f048d6e9-26fa-41ec-b9cb-c293cb2bee31 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:33.207056 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fbde22-798e-4577-9415-654ddaa815a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c3c564b8c548e4beef1cbfba2ad343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:33.208227 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fbde22-798e-4577-9415-654ddaa815a2 service cinder] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:33.208227 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fbde22-798e-4577-9415-654ddaa815a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:33.208227 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fbde22-798e-4577-9415-654ddaa815a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:33.258538 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec55da9e-90c3-419b-aa25-20a886a7572e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:33.259185 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec55da9e-90c3-419b-aa25-20a886a7572e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:33.259469 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec55da9e-90c3-419b-aa25-20a886a7572e admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:33.259886 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec55da9e-90c3-419b-aa25-20a886a7572e admin admin] PATH_INFO: `/v3/projects/bd261c710da04c618bc6a77364937a61` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:33.261834 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec55da9e-90c3-419b-aa25-20a886a7572e admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd261c710da04c618bc6a77364937a61)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:33.270551 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec55da9e-90c3-419b-aa25-20a886a7572e admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:33.299497 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fbde22-798e-4577-9415-654ddaa815a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:33.301300 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fbde22-798e-4577-9415-654ddaa815a2 service cinder] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:33.320452 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 766/1494] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:01:33 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:01:33.322701 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f229b0df-e8a0-4f4e-bbab-b2605fe2264b None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:33.323254 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f229b0df-e8a0-4f4e-bbab-b2605fe2264b None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:33.323741 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f229b0df-e8a0-4f4e-bbab-b2605fe2264b None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:33.326698 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 767/1495] 10.222.0.17 () {54 vars in 921 bytes} [Fri Oct 14 13:01:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 13:01:33.328150 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f229b0df-e8a0-4f4e-bbab-b2605fe2264b None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:33.343824 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-ec55da9e-90c3-419b-aa25-20a886a7572e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd261c710da04c618bc6a77364937a61', 'request_id': 'req-ec55da9e-90c3-419b-aa25-20a886a7572e'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:33.352567 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-ec55da9e-90c3-419b-aa25-20a886a7572e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd261c710da04c618bc6a77364937a61', 'request_id': 'req-ec55da9e-90c3-419b-aa25-20a886a7572e'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:33.362091 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-ec55da9e-90c3-419b-aa25-20a886a7572e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd261c710da04c618bc6a77364937a61', 'request_id': 'req-ec55da9e-90c3-419b-aa25-20a886a7572e'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:33.390093 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-ec55da9e-90c3-419b-aa25-20a886a7572e admin admin] The token cache is being invalidate because project bd261c710da04c618bc6a77364937a61 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:01:33.390504 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-ec55da9e-90c3-419b-aa25-20a886a7572e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:33.391243 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-ec55da9e-90c3-419b-aa25-20a886a7572e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:33.395001 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 729/1496] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Oct 14 13:01:33 2022] DELETE /identity/v3/projects/bd261c710da04c618bc6a77364937a61 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:01:33.396599 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec55da9e-90c3-419b-aa25-20a886a7572e admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:33.399610 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-ec55da9e-90c3-419b-aa25-20a886a7572e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:33.431616 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f229b0df-e8a0-4f4e-bbab-b2605fe2264b None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:33.439758 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f322a2-fd2a-465a-bb19-bfc715907429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:33.440395 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f322a2-fd2a-465a-bb19-bfc715907429 admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:33.440661 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f322a2-fd2a-465a-bb19-bfc715907429 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:33.441092 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f322a2-fd2a-465a-bb19-bfc715907429 admin admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:33.442015 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:01:33.442239 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f322a2-fd2a-465a-bb19-bfc715907429 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:33.445416 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f322a2-fd2a-465a-bb19-bfc715907429 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:33.461062 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:01:33.489975 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 768/1497] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Oct 14 13:01:33 2022] POST /identity/v3/users => generated 306 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:01:33.491452 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea14645f-9590-4456-abb0-643e288599e5 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:33.491761 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea14645f-9590-4456-abb0-643e288599e5 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:33.493146 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea14645f-9590-4456-abb0-643e288599e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:33.533677 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-ea14645f-9590-4456-abb0-643e288599e5 None None] MFA Rules not processed for user `931f4e32c8764514b5efed31b0785be7`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:01:33.537046 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-ea14645f-9590-4456-abb0-643e288599e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:33.547933 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec55da9e-90c3-419b-aa25-20a886a7572e admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:33.578191 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540442c9-1817-45ac-91ba-fd59c4373c41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:33.579664 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540442c9-1817-45ac-91ba-fd59c4373c41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:33.580192 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540442c9-1817-45ac-91ba-fd59c4373c41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:33.581430 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540442c9-1817-45ac-91ba-fd59c4373c41 admin admin] PATH_INFO: `/v3/projects/f0246a29bfce40648461ac33bf619ba3` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:33.595627 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540442c9-1817-45ac-91ba-fd59c4373c41 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0246a29bfce40648461ac33bf619ba3)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:33.598603 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540442c9-1817-45ac-91ba-fd59c4373c41 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:33.665331 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-540442c9-1817-45ac-91ba-fd59c4373c41 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0246a29bfce40648461ac33bf619ba3', 'request_id': 'req-540442c9-1817-45ac-91ba-fd59c4373c41'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:33.676000 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-540442c9-1817-45ac-91ba-fd59c4373c41 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0246a29bfce40648461ac33bf619ba3', 'request_id': 'req-540442c9-1817-45ac-91ba-fd59c4373c41'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:33.681772 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 769/1498] 10.222.0.17 () {58 vars in 1018 bytes} [Fri Oct 14 13:01:33 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:01:33.687338 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fb7193-4601-4fda-9257-6567680f14af None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:33.688535 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fb7193-4601-4fda-9257-6567680f14af None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:33.688955 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fb7193-4601-4fda-9257-6567680f14af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:33.692084 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-540442c9-1817-45ac-91ba-fd59c4373c41 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0246a29bfce40648461ac33bf619ba3', 'request_id': 'req-540442c9-1817-45ac-91ba-fd59c4373c41'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:33.724604 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-540442c9-1817-45ac-91ba-fd59c4373c41 admin admin] The token cache is being invalidate because project f0246a29bfce40648461ac33bf619ba3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:01:33.724897 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-540442c9-1817-45ac-91ba-fd59c4373c41 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:33.725641 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-540442c9-1817-45ac-91ba-fd59c4373c41 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:33.730060 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-44fb7193-4601-4fda-9257-6567680f14af None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:01:33.731244 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-44fb7193-4601-4fda-9257-6567680f14af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:33.736261 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 730/1499] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Oct 14 13:01:33 2022] DELETE /identity/v3/projects/f0246a29bfce40648461ac33bf619ba3 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:01:33.737550 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540442c9-1817-45ac-91ba-fd59c4373c41 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:33.743706 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-540442c9-1817-45ac-91ba-fd59c4373c41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:33.818448 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 770/1500] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:01:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:01:33.819712 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bf7e2c-709a-4705-af45-c56040c91fd1 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:33.819999 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bf7e2c-709a-4705-af45-c56040c91fd1 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:33.820277 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bf7e2c-709a-4705-af45-c56040c91fd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:33.844357 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540442c9-1817-45ac-91ba-fd59c4373c41 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:33.850666 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab84370-9760-4708-b36e-fbfdaa38ac91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:33.851288 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab84370-9760-4708-b36e-fbfdaa38ac91 admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:33.851571 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab84370-9760-4708-b36e-fbfdaa38ac91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:33.851846 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab84370-9760-4708-b36e-fbfdaa38ac91 admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:33.852498 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab84370-9760-4708-b36e-fbfdaa38ac91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:33.853164 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-d4bf7e2c-709a-4705-af45-c56040c91fd1 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:01:33.854637 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab84370-9760-4708-b36e-fbfdaa38ac91 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:33.854763 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-d4bf7e2c-709a-4705-af45-c56040c91fd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:33.870662 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 771/1501] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:01:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:01:33.870662 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bf7e2c-709a-4705-af45-c56040c91fd1 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:33.870662 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-d4bf7e2c-709a-4705-af45-c56040c91fd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:33.871008 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 731/1502] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:01:33 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:01:33.871008 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9b9780-3e48-483c-9d41-f0d0e7de45cd None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:33.871008 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9b9780-3e48-483c-9d41-f0d0e7de45cd None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:33.871233 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9b9780-3e48-483c-9d41-f0d0e7de45cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:33.897532 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-9d9b9780-3e48-483c-9d41-f0d0e7de45cd None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:01:33.899288 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-9d9b9780-3e48-483c-9d41-f0d0e7de45cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:33.919299 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 732/1503] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:01:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:01:33.920656 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9b9780-3e48-483c-9d41-f0d0e7de45cd None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:33.933361 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9b9780-3e48-483c-9d41-f0d0e7de45cd None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:33.939622 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9e32ba-0445-468a-811e-6bd08a1ea982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:33.940346 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9e32ba-0445-468a-811e-6bd08a1ea982 admin admin] REQUEST_METHOD: `PUT` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:33.940631 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9e32ba-0445-468a-811e-6bd08a1ea982 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:33.940908 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9e32ba-0445-468a-811e-6bd08a1ea982 admin admin] PATH_INFO: `/v3/projects/4b4abd98b14d41ceb90eb49f5b540f02/users/d27383c6e0b2476b98b977aa7119e8eb/roles/7f6e29e390bc41f7a9af17659a2e95d1` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:33.959232 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9e32ba-0445-468a-811e-6bd08a1ea982 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b4abd98b14d41ceb90eb49f5b540f02, user_id=d27383c6e0b2476b98b977aa7119e8eb, role_id=7f6e29e390bc41f7a9af17659a2e95d1)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:33.963237 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9e32ba-0445-468a-811e-6bd08a1ea982 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:33.965458 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bf7e2c-709a-4705-af45-c56040c91fd1 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:33.973317 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce0be7f-7613-4bd1-bb2f-9ba8b4936fa7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '931f4e32c8764514b5efed31b0785be7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:33.974546 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce0be7f-7613-4bd1-bb2f-9ba8b4936fa7 service nova] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:33.974889 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce0be7f-7613-4bd1-bb2f-9ba8b4936fa7 service nova] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:33.975185 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce0be7f-7613-4bd1-bb2f-9ba8b4936fa7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:33.977507 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-3ce0be7f-7613-4bd1-bb2f-9ba8b4936fa7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:33.987555 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 733/1504] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Oct 14 13:01:33 2022] PUT /identity/v3/projects/4b4abd98b14d41ceb90eb49f5b540f02/users/d27383c6e0b2476b98b977aa7119e8eb/roles/7f6e29e390bc41f7a9af17659a2e95d1 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:01:33.992492 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0aad8e-412d-4bee-89cb-c1f019b0d1bb None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:33.992800 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0aad8e-412d-4bee-89cb-c1f019b0d1bb None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:33.993056 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0aad8e-412d-4bee-89cb-c1f019b0d1bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:33.993352 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce0be7f-7613-4bd1-bb2f-9ba8b4936fa7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:33.995008 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce0be7f-7613-4bd1-bb2f-9ba8b4936fa7 service nova] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:34.008361 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 772/1505] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:01:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:01:34.009573 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce0be7f-7613-4bd1-bb2f-9ba8b4936fa7 service nova] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:34.014687 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-3f0aad8e-412d-4bee-89cb-c1f019b0d1bb None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:01:34.016288 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-3f0aad8e-412d-4bee-89cb-c1f019b0d1bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:34.022774 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce0be7f-7613-4bd1-bb2f-9ba8b4936fa7 service nova] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:34.027958 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:01:34.030295 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:01:34.117511 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9129162c-a693-4894-9e05-9a4bca398e46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:34.118213 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9129162c-a693-4894-9e05-9a4bca398e46 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:34.118488 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9129162c-a693-4894-9e05-9a4bca398e46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:34.118759 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9129162c-a693-4894-9e05-9a4bca398e46 admin admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:34.119419 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9129162c-a693-4894-9e05-9a4bca398e46 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 13:01:34.119881 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9129162c-a693-4894-9e05-9a4bca398e46 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:34.121517 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9129162c-a693-4894-9e05-9a4bca398e46 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:34.128963 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 734/1506] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:01:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:01:34.130071 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0aad8e-412d-4bee-89cb-c1f019b0d1bb None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:34.140873 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 773/1507] 10.222.0.17 () {58 vars in 1153 bytes} [Fri Oct 14 13:01:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 13:01:34.141540 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9129162c-a693-4894-9e05-9a4bca398e46 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:34.147656 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0aad8e-412d-4bee-89cb-c1f019b0d1bb None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:34.154895 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9129162c-a693-4894-9e05-9a4bca398e46 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:34.155200 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e6a77b-e6ef-4f42-ae5d-5d8101c55554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:34.156809 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e6a77b-e6ef-4f42-ae5d-5d8101c55554 admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:34.157367 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e6a77b-e6ef-4f42-ae5d-5d8101c55554 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:34.157876 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e6a77b-e6ef-4f42-ae5d-5d8101c55554 admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:34.159267 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e6a77b-e6ef-4f42-ae5d-5d8101c55554 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:34.160607 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54178f4-fbe1-4814-bea7-f6e0e3ba20b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:34.161083 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e6a77b-e6ef-4f42-ae5d-5d8101c55554 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:34.161385 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54178f4-fbe1-4814-bea7-f6e0e3ba20b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:34.161819 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54178f4-fbe1-4814-bea7-f6e0e3ba20b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:34.162201 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54178f4-fbe1-4814-bea7-f6e0e3ba20b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:34.163301 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54178f4-fbe1-4814-bea7-f6e0e3ba20b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 13:01:34.163674 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54178f4-fbe1-4814-bea7-f6e0e3ba20b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:34.166025 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54178f4-fbe1-4814-bea7-f6e0e3ba20b2 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:34.176071 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 735/1508] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:01:34 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:01:34.176071 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e6a77b-e6ef-4f42-ae5d-5d8101c55554 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:34.182263 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 774/1509] 10.222.0.17 () {58 vars in 1153 bytes} [Fri Oct 14 13:01:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 13:01:34.182501 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54178f4-fbe1-4814-bea7-f6e0e3ba20b2 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:34.189622 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e6a77b-e6ef-4f42-ae5d-5d8101c55554 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:34.194477 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7541206a-048b-4e7f-8b0c-70398293dd27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:34.194629 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54178f4-fbe1-4814-bea7-f6e0e3ba20b2 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:34.195367 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7541206a-048b-4e7f-8b0c-70398293dd27 admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:34.195651 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7541206a-048b-4e7f-8b0c-70398293dd27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:34.195926 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7541206a-048b-4e7f-8b0c-70398293dd27 admin admin] PATH_INFO: `/v3/projects` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:34.196570 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7541206a-048b-4e7f-8b0c-70398293dd27 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:34.198571 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7541206a-048b-4e7f-8b0c-70398293dd27 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:34.201318 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f316ae0-2072-4780-8fd1-1fe0bc9db2f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:34.202268 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f316ae0-2072-4780-8fd1-1fe0bc9db2f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:34.202569 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f316ae0-2072-4780-8fd1-1fe0bc9db2f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:34.202858 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f316ae0-2072-4780-8fd1-1fe0bc9db2f5 admin admin] PATH_INFO: `/v3/projects/4b4abd98b14d41ceb90eb49f5b540f02/users/d27383c6e0b2476b98b977aa7119e8eb/roles/7f6e29e390bc41f7a9af17659a2e95d1` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:34.205536 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f316ae0-2072-4780-8fd1-1fe0bc9db2f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b4abd98b14d41ceb90eb49f5b540f02, user_id=d27383c6e0b2476b98b977aa7119e8eb, role_id=7f6e29e390bc41f7a9af17659a2e95d1)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:34.208329 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f316ae0-2072-4780-8fd1-1fe0bc9db2f5 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:34.226198 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 775/1510] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Oct 14 13:01:34 2022] PUT /identity/v3/projects/4b4abd98b14d41ceb90eb49f5b540f02/users/d27383c6e0b2476b98b977aa7119e8eb/roles/7f6e29e390bc41f7a9af17659a2e95d1 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:01:34.226198 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f316ae0-2072-4780-8fd1-1fe0bc9db2f5 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:34.235450 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 736/1511] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Oct 14 13:01:34 2022] POST /identity/v3/projects => generated 387 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:01:34.237282 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef2b5ac-0d48-4af5-b5b9-9f58e2013b55 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:34.237761 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef2b5ac-0d48-4af5-b5b9-9f58e2013b55 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:34.238459 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef2b5ac-0d48-4af5-b5b9-9f58e2013b55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:34.272522 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-bef2b5ac-0d48-4af5-b5b9-9f58e2013b55 None None] MFA Rules not processed for user `d27383c6e0b2476b98b977aa7119e8eb`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:01:34.273855 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-bef2b5ac-0d48-4af5-b5b9-9f58e2013b55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:34.302773 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f316ae0-2072-4780-8fd1-1fe0bc9db2f5 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:34.378545 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 737/1512] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:01:34 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:01:34.379390 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef2b5ac-0d48-4af5-b5b9-9f58e2013b55 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:34.403276 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c74f30f-a47e-4c90-907a-8421f60daf2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:34.404197 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c74f30f-a47e-4c90-907a-8421f60daf2e admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:34.404595 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c74f30f-a47e-4c90-907a-8421f60daf2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:34.404977 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c74f30f-a47e-4c90-907a-8421f60daf2e admin admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:34.405917 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c74f30f-a47e-4c90-907a-8421f60daf2e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:34.408077 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c74f30f-a47e-4c90-907a-8421f60daf2e admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:34.443247 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 776/1513] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Oct 14 13:01:34 2022] POST /identity/v3/projects => generated 367 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:01:34.447725 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c74f30f-a47e-4c90-907a-8421f60daf2e admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:34.451428 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-5c74f30f-a47e-4c90-907a-8421f60daf2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:34.466211 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef2b5ac-0d48-4af5-b5b9-9f58e2013b55 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:34.473731 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:01:34.491604 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:01:34.556880 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42f9966-9bd5-4ace-a4ed-4c91acb98a68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:34.558994 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42f9966-9bd5-4ace-a4ed-4c91acb98a68 admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:34.559606 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c74f30f-a47e-4c90-907a-8421f60daf2e admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:34.560073 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42f9966-9bd5-4ace-a4ed-4c91acb98a68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:34.561306 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42f9966-9bd5-4ace-a4ed-4c91acb98a68 admin admin] PATH_INFO: `/v3/users` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:34.562359 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42f9966-9bd5-4ace-a4ed-4c91acb98a68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:34.564150 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d26426-77ea-4167-af2d-e163b28728b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c3c564b8c548e4beef1cbfba2ad343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:34.564768 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d26426-77ea-4167-af2d-e163b28728b9 service cinder] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:34.565055 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d26426-77ea-4167-af2d-e163b28728b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:34.565329 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d26426-77ea-4167-af2d-e163b28728b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:34.565949 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42f9966-9bd5-4ace-a4ed-4c91acb98a68 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:34.594391 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 738/1514] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Oct 14 13:01:34 2022] POST /identity/v3/users => generated 294 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:01:34.595492 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42f9966-9bd5-4ace-a4ed-4c91acb98a68 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:34.606739 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42f9966-9bd5-4ace-a4ed-4c91acb98a68 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:34.611651 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fdfc5b-247e-4f0a-a606-577bb1965e2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:34.612261 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fdfc5b-247e-4f0a-a606-577bb1965e2a admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:34.612623 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fdfc5b-247e-4f0a-a606-577bb1965e2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:34.612820 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fdfc5b-247e-4f0a-a606-577bb1965e2a admin admin] PATH_INFO: `/v3/users` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:34.613462 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fdfc5b-247e-4f0a-a606-577bb1965e2a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:34.615434 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fdfc5b-247e-4f0a-a606-577bb1965e2a admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:34.639279 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d26426-77ea-4167-af2d-e163b28728b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:34.641109 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d26426-77ea-4167-af2d-e163b28728b9 service cinder] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:34.643892 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 739/1515] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Oct 14 13:01:34 2022] POST /identity/v3/users => generated 284 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:01:34.644836 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fdfc5b-247e-4f0a-a606-577bb1965e2a admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:34.655996 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 777/1516] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:01:34 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:01:34.656365 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fdfc5b-247e-4f0a-a606-577bb1965e2a admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:34.656913 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d26426-77ea-4167-af2d-e163b28728b9 service cinder] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:34.661889 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23e0aa2-9cc4-48b8-922c-6b26c3524bb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:34.662818 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23e0aa2-9cc4-48b8-922c-6b26c3524bb1 admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:34.663192 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23e0aa2-9cc4-48b8-922c-6b26c3524bb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:34.663574 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23e0aa2-9cc4-48b8-922c-6b26c3524bb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:34.664357 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23e0aa2-9cc4-48b8-922c-6b26c3524bb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:34.666208 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23e0aa2-9cc4-48b8-922c-6b26c3524bb1 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:34.667963 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d26426-77ea-4167-af2d-e163b28728b9 service cinder] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:34.674833 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e504ce4c-6729-43cb-9b74-038b84c6654a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:34.675735 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e504ce4c-6729-43cb-9b74-038b84c6654a admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:34.676203 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e504ce4c-6729-43cb-9b74-038b84c6654a admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:34.676575 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e504ce4c-6729-43cb-9b74-038b84c6654a admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:34.677418 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e504ce4c-6729-43cb-9b74-038b84c6654a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:34.679813 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e504ce4c-6729-43cb-9b74-038b84c6654a admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:34.691238 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 740/1517] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:01:34 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:01:34.693931 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23e0aa2-9cc4-48b8-922c-6b26c3524bb1 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:34.694608 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 778/1518] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:01:34 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:01:34.702247 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e504ce4c-6729-43cb-9b74-038b84c6654a admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:34.704022 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23e0aa2-9cc4-48b8-922c-6b26c3524bb1 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:34.709822 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8f3143-e9c3-48fb-a0aa-a82628d97127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:34.710661 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8f3143-e9c3-48fb-a0aa-a82628d97127 admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:34.710988 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8f3143-e9c3-48fb-a0aa-a82628d97127 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:34.711279 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8f3143-e9c3-48fb-a0aa-a82628d97127 admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:34.712128 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8f3143-e9c3-48fb-a0aa-a82628d97127 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:34.714280 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8f3143-e9c3-48fb-a0aa-a82628d97127 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:34.715878 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e504ce4c-6729-43cb-9b74-038b84c6654a admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:34.723463 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b300c85-1c44-42f8-91de-36f97edf12e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:34.724166 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b300c85-1c44-42f8-91de-36f97edf12e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:34.725031 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b300c85-1c44-42f8-91de-36f97edf12e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:34.725031 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b300c85-1c44-42f8-91de-36f97edf12e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:34.725732 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b300c85-1c44-42f8-91de-36f97edf12e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:34.730192 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 741/1519] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:01:34 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:01:34.730315 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b300c85-1c44-42f8-91de-36f97edf12e3 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:34.731497 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8f3143-e9c3-48fb-a0aa-a82628d97127 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:34.745913 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 779/1520] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:01:34 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:01:34.746074 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8f3143-e9c3-48fb-a0aa-a82628d97127 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:34.747136 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b300c85-1c44-42f8-91de-36f97edf12e3 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:34.750587 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d36925-3df6-4b13-b553-33fdc565b850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:34.751359 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d36925-3df6-4b13-b553-33fdc565b850 admin admin] REQUEST_METHOD: `PUT` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:34.751757 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d36925-3df6-4b13-b553-33fdc565b850 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:34.752173 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d36925-3df6-4b13-b553-33fdc565b850 admin admin] PATH_INFO: `/v3/projects/b7ead3322f6749e2b4c124590ea56257/users/a262d176486a4b83858722c4532c60d0/roles/5e8849303a75425b9eaa2681cc031af1` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:34.762329 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b300c85-1c44-42f8-91de-36f97edf12e3 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:34.771746 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d36925-3df6-4b13-b553-33fdc565b850 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7ead3322f6749e2b4c124590ea56257, user_id=a262d176486a4b83858722c4532c60d0, role_id=5e8849303a75425b9eaa2681cc031af1)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:34.774151 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76d42b1-11c0-4f4e-a9ad-468335729f37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:34.774842 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76d42b1-11c0-4f4e-a9ad-468335729f37 admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:34.775052 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d36925-3df6-4b13-b553-33fdc565b850 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:34.775179 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76d42b1-11c0-4f4e-a9ad-468335729f37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:34.775391 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76d42b1-11c0-4f4e-a9ad-468335729f37 admin admin] PATH_INFO: `/v3/projects/984d898bd5d241169d1bc3725ac0e4a6/users/1057cf0a876943218e90e4f13b7abab5/roles/5e8849303a75425b9eaa2681cc031af1` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:34.797199 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 742/1521] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Oct 14 13:01:34 2022] PUT /identity/v3/projects/b7ead3322f6749e2b4c124590ea56257/users/a262d176486a4b83858722c4532c60d0/roles/5e8849303a75425b9eaa2681cc031af1 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:01:34.797511 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76d42b1-11c0-4f4e-a9ad-468335729f37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=984d898bd5d241169d1bc3725ac0e4a6, user_id=1057cf0a876943218e90e4f13b7abab5, role_id=5e8849303a75425b9eaa2681cc031af1)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:34.799191 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d36925-3df6-4b13-b553-33fdc565b850 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:34.801283 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76d42b1-11c0-4f4e-a9ad-468335729f37 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:34.834785 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 780/1522] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Oct 14 13:01:34 2022] PUT /identity/v3/projects/984d898bd5d241169d1bc3725ac0e4a6/users/1057cf0a876943218e90e4f13b7abab5/roles/5e8849303a75425b9eaa2681cc031af1 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:01:34.843791 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e238bd-fedb-4bba-a470-b80694c2d777 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:34.844083 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e238bd-fedb-4bba-a470-b80694c2d777 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:34.844362 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e238bd-fedb-4bba-a470-b80694c2d777 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:34.884036 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d36925-3df6-4b13-b553-33fdc565b850 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:34.890897 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-90e238bd-fedb-4bba-a470-b80694c2d777 None None] MFA Rules not processed for user `a262d176486a4b83858722c4532c60d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:01:34.893419 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-90e238bd-fedb-4bba-a470-b80694c2d777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:34.961790 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35592b20-90cf-4830-9106-45781a777977 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c3c564b8c548e4beef1cbfba2ad343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:34.962456 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35592b20-90cf-4830-9106-45781a777977 service cinder] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:34.962738 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35592b20-90cf-4830-9106-45781a777977 service cinder] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:34.963014 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35592b20-90cf-4830-9106-45781a777977 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:34.966335 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-35592b20-90cf-4830-9106-45781a777977 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:34.984895 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:01:34.995574 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:01:35.004773 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 781/1523] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:01:34 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:01:35.004918 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dde5f2-2705-4cf0-adfc-12468b6495db None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:35.005339 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dde5f2-2705-4cf0-adfc-12468b6495db None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:35.005648 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dde5f2-2705-4cf0-adfc-12468b6495db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:35.067253 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-c0dde5f2-2705-4cf0-adfc-12468b6495db None None] MFA Rules not processed for user `1057cf0a876943218e90e4f13b7abab5`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:01:35.068499 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-c0dde5f2-2705-4cf0-adfc-12468b6495db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:35.096839 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35592b20-90cf-4830-9106-45781a777977 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:35.098776 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35592b20-90cf-4830-9106-45781a777977 service cinder] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:35.118874 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 743/1524] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:01:34 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:01:35.119963 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35592b20-90cf-4830-9106-45781a777977 service cinder] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:35.174194 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 782/1525] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:01:35 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:01:35.179036 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dde5f2-2705-4cf0-adfc-12468b6495db None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:35.241661 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35592b20-90cf-4830-9106-45781a777977 service cinder] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:35.264250 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6eca90-35b5-4d07-9c4f-9f909be21073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:35.264703 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6eca90-35b5-4d07-9c4f-9f909be21073 admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:35.264984 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6eca90-35b5-4d07-9c4f-9f909be21073 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:35.265255 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6eca90-35b5-4d07-9c4f-9f909be21073 admin admin] PATH_INFO: `/v3/projects` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:35.265901 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6eca90-35b5-4d07-9c4f-9f909be21073 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:35.267575 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dde5f2-2705-4cf0-adfc-12468b6495db None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:35.267900 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6eca90-35b5-4d07-9c4f-9f909be21073 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:35.276437 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94404984-6de3-42a6-ae87-7d5dc375d36e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:35.277084 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94404984-6de3-42a6-ae87-7d5dc375d36e admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:35.277372 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94404984-6de3-42a6-ae87-7d5dc375d36e admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:35.277705 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94404984-6de3-42a6-ae87-7d5dc375d36e admin admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:35.278479 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94404984-6de3-42a6-ae87-7d5dc375d36e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:35.281308 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94404984-6de3-42a6-ae87-7d5dc375d36e admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:35.325288 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 783/1526] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Oct 14 13:01:35 2022] POST /identity/v3/projects => generated 369 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:01:35.327657 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94404984-6de3-42a6-ae87-7d5dc375d36e admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:35.332421 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 744/1527] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Oct 14 13:01:35 2022] POST /identity/v3/projects => generated 385 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:01:35.337120 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6eca90-35b5-4d07-9c4f-9f909be21073 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:35.449866 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6eca90-35b5-4d07-9c4f-9f909be21073 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:35.459425 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936b89a4-1469-4cd8-9597-3f950cc8ace9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:35.460060 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936b89a4-1469-4cd8-9597-3f950cc8ace9 admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:35.460457 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936b89a4-1469-4cd8-9597-3f950cc8ace9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:35.460888 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936b89a4-1469-4cd8-9597-3f950cc8ace9 admin admin] PATH_INFO: `/v3/users` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:35.462615 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936b89a4-1469-4cd8-9597-3f950cc8ace9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:35.466391 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936b89a4-1469-4cd8-9597-3f950cc8ace9 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:35.480506 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94404984-6de3-42a6-ae87-7d5dc375d36e admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:35.487269 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e5d124-26d1-43df-8539-7d6648f39d5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:35.488124 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e5d124-26d1-43df-8539-7d6648f39d5e admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:35.488731 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e5d124-26d1-43df-8539-7d6648f39d5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:35.489020 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e5d124-26d1-43df-8539-7d6648f39d5e admin admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:35.489666 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e5d124-26d1-43df-8539-7d6648f39d5e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:35.493797 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e5d124-26d1-43df-8539-7d6648f39d5e admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:35.510497 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 745/1528] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Oct 14 13:01:35 2022] POST /identity/v3/users => generated 299 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:01:35.521384 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936b89a4-1469-4cd8-9597-3f950cc8ace9 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:35.536000 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936b89a4-1469-4cd8-9597-3f950cc8ace9 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:35.551019 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a92b5d-9dd8-4625-a67a-c4a1eecaabcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:35.552047 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a92b5d-9dd8-4625-a67a-c4a1eecaabcd admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:35.552337 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a92b5d-9dd8-4625-a67a-c4a1eecaabcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:35.552711 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a92b5d-9dd8-4625-a67a-c4a1eecaabcd admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:35.553284 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a92b5d-9dd8-4625-a67a-c4a1eecaabcd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:35.557015 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 784/1529] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Oct 14 13:01:35 2022] POST /identity/v3/users => generated 291 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:01:35.557152 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a92b5d-9dd8-4625-a67a-c4a1eecaabcd admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:35.559736 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e5d124-26d1-43df-8539-7d6648f39d5e admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:35.565946 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-29e5d124-26d1-43df-8539-7d6648f39d5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:35.571391 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 746/1530] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:01:35 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:01:35.572355 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a92b5d-9dd8-4625-a67a-c4a1eecaabcd admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:35.582913 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a92b5d-9dd8-4625-a67a-c4a1eecaabcd admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:35.587827 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdb7b2a-cb69-4b51-bd90-5ca68690dc44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:35.589140 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdb7b2a-cb69-4b51-bd90-5ca68690dc44 admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:35.589623 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdb7b2a-cb69-4b51-bd90-5ca68690dc44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:35.589978 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdb7b2a-cb69-4b51-bd90-5ca68690dc44 admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:35.590673 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:01:35.590775 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdb7b2a-cb69-4b51-bd90-5ca68690dc44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:35.592962 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdb7b2a-cb69-4b51-bd90-5ca68690dc44 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:35.598232 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e5d124-26d1-43df-8539-7d6648f39d5e admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:35.613090 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 747/1531] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:01:35 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:01:35.613638 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdb7b2a-cb69-4b51-bd90-5ca68690dc44 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:35.615089 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51646f54-1418-46a3-ac2c-e65cb53bdaed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:35.616015 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51646f54-1418-46a3-ac2c-e65cb53bdaed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:35.616415 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51646f54-1418-46a3-ac2c-e65cb53bdaed admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:35.616798 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51646f54-1418-46a3-ac2c-e65cb53bdaed admin admin] PATH_INFO: `/v3/users/b986c326e118474490f1f32cb43d3e8e` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:35.620181 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51646f54-1418-46a3-ac2c-e65cb53bdaed admin admin] RBAC: Authorizing `identity:delete_user(user_id=b986c326e118474490f1f32cb43d3e8e)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:35.636072 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:01:35.643298 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51646f54-1418-46a3-ac2c-e65cb53bdaed admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:35.646144 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdb7b2a-cb69-4b51-bd90-5ca68690dc44 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:35.662858 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff95f40-63d1-476a-bf84-4c0d5cd42d1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:35.663952 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff95f40-63d1-476a-bf84-4c0d5cd42d1a admin admin] REQUEST_METHOD: `PUT` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:35.664405 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff95f40-63d1-476a-bf84-4c0d5cd42d1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:35.664832 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff95f40-63d1-476a-bf84-4c0d5cd42d1a admin admin] PATH_INFO: `/v3/projects/6d5d6ff929cb4bacb5b5623c64c576f8/users/d67a09ca67a84904ab94eb927329869e/roles/7f6e29e390bc41f7a9af17659a2e95d1` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:35.697344 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff95f40-63d1-476a-bf84-4c0d5cd42d1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d5d6ff929cb4bacb5b5623c64c576f8, user_id=d67a09ca67a84904ab94eb927329869e, role_id=7f6e29e390bc41f7a9af17659a2e95d1)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:35.697344 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff95f40-63d1-476a-bf84-4c0d5cd42d1a admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:35.718093 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 748/1532] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Oct 14 13:01:35 2022] PUT /identity/v3/projects/6d5d6ff929cb4bacb5b5623c64c576f8/users/d67a09ca67a84904ab94eb927329869e/roles/7f6e29e390bc41f7a9af17659a2e95d1 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:01:35.718970 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff95f40-63d1-476a-bf84-4c0d5cd42d1a admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:35.744108 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-51646f54-1418-46a3-ac2c-e65cb53bdaed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b986c326e118474490f1f32cb43d3e8e'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:35.753463 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-51646f54-1418-46a3-ac2c-e65cb53bdaed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b986c326e118474490f1f32cb43d3e8e'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:35.754060 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-51646f54-1418-46a3-ac2c-e65cb53bdaed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b986c326e118474490f1f32cb43d3e8e'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:35.765577 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-51646f54-1418-46a3-ac2c-e65cb53bdaed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b986c326e118474490f1f32cb43d3e8e'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:35.785329 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-51646f54-1418-46a3-ac2c-e65cb53bdaed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b986c326e118474490f1f32cb43d3e8e'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:35.792474 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 785/1533] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Oct 14 13:01:35 2022] DELETE /identity/v3/users/b986c326e118474490f1f32cb43d3e8e => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:01:35.793307 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51646f54-1418-46a3-ac2c-e65cb53bdaed admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:35.794707 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-51646f54-1418-46a3-ac2c-e65cb53bdaed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:35.837401 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff95f40-63d1-476a-bf84-4c0d5cd42d1a admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:35.863864 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51646f54-1418-46a3-ac2c-e65cb53bdaed admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:35.868626 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15ec95a-d3e3-4b6b-a794-c5b1ba3e8814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:35.869232 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15ec95a-d3e3-4b6b-a794-c5b1ba3e8814 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:35.869508 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15ec95a-d3e3-4b6b-a794-c5b1ba3e8814 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:35.869784 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15ec95a-d3e3-4b6b-a794-c5b1ba3e8814 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:35.870514 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15ec95a-d3e3-4b6b-a794-c5b1ba3e8814 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:35.872118 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15ec95a-d3e3-4b6b-a794-c5b1ba3e8814 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:35.882404 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 786/1534] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:01:35 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:01:35.886590 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a8da33-261b-44b6-bad9-321d826bf3ae None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:35.886872 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a8da33-261b-44b6-bad9-321d826bf3ae None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:35.887144 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a8da33-261b-44b6-bad9-321d826bf3ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:35.897151 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4da956d-af12-4c9a-bf59-eaa512bda4b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:35.897807 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4da956d-af12-4c9a-bf59-eaa512bda4b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:35.898089 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4da956d-af12-4c9a-bf59-eaa512bda4b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:35.898388 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4da956d-af12-4c9a-bf59-eaa512bda4b7 admin admin] PATH_INFO: `/v3/projects/00cdf1f8143d41db909975d35933e8f0/users/4a6c8e57cab4468fa90265eda1e3228f/roles/7f6e29e390bc41f7a9af17659a2e95d1` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:35.907353 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-e9a8da33-261b-44b6-bad9-321d826bf3ae None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:01:35.908598 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-e9a8da33-261b-44b6-bad9-321d826bf3ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:35.913718 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4da956d-af12-4c9a-bf59-eaa512bda4b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00cdf1f8143d41db909975d35933e8f0, user_id=4a6c8e57cab4468fa90265eda1e3228f, role_id=7f6e29e390bc41f7a9af17659a2e95d1)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:35.916212 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 787/1535] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:01:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:01:35.916769 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4da956d-af12-4c9a-bf59-eaa512bda4b7 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:35.917116 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a8da33-261b-44b6-bad9-321d826bf3ae None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:35.927663 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a8da33-261b-44b6-bad9-321d826bf3ae None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:35.932675 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 749/1536] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Oct 14 13:01:35 2022] PUT /identity/v3/projects/00cdf1f8143d41db909975d35933e8f0/users/4a6c8e57cab4468fa90265eda1e3228f/roles/7f6e29e390bc41f7a9af17659a2e95d1 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:01:35.933497 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4da956d-af12-4c9a-bf59-eaa512bda4b7 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:35.935572 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-b4da956d-af12-4c9a-bf59-eaa512bda4b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:35.989142 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2e7c73-2d8c-457f-937f-f0a8ccf9503f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:35.989806 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2e7c73-2d8c-457f-937f-f0a8ccf9503f admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:35.990083 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2e7c73-2d8c-457f-937f-f0a8ccf9503f admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:35.990385 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2e7c73-2d8c-457f-937f-f0a8ccf9503f admin admin] PATH_INFO: `/v3/projects/6d5d6ff929cb4bacb5b5623c64c576f8/users/d67a09ca67a84904ab94eb927329869e/roles/7f6e29e390bc41f7a9af17659a2e95d1` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:35.992288 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2e7c73-2d8c-457f-937f-f0a8ccf9503f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d5d6ff929cb4bacb5b5623c64c576f8, user_id=d67a09ca67a84904ab94eb927329869e, role_id=7f6e29e390bc41f7a9af17659a2e95d1)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:35.993660 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4da956d-af12-4c9a-bf59-eaa512bda4b7 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:35.994968 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2e7c73-2d8c-457f-937f-f0a8ccf9503f admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:35.998136 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ea214e-6cc8-4fad-a5c6-1c036a1b6e6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d483292f3a4794848fcacfba5b107e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:35.998772 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ea214e-6cc8-4fad-a5c6-1c036a1b6e6d service neutron] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:35.999365 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ea214e-6cc8-4fad-a5c6-1c036a1b6e6d service neutron] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:35.999644 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ea214e-6cc8-4fad-a5c6-1c036a1b6e6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:36.002201 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:01:36.007406 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 788/1537] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Oct 14 13:01:35 2022] PUT /identity/v3/projects/6d5d6ff929cb4bacb5b5623c64c576f8/users/d67a09ca67a84904ab94eb927329869e/roles/7f6e29e390bc41f7a9af17659a2e95d1 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:01:36.008321 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2e7c73-2d8c-457f-937f-f0a8ccf9503f admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:36.010590 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-ca2e7c73-2d8c-457f-937f-f0a8ccf9503f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:36.017576 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ea214e-6cc8-4fad-a5c6-1c036a1b6e6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:36.019195 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ea214e-6cc8-4fad-a5c6-1c036a1b6e6d service neutron] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:36.030040 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 750/1538] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:01:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:01:36.031549 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3380a061-a207-47ab-92ac-f1a8e3fbdd2b None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:36.031906 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3380a061-a207-47ab-92ac-f1a8e3fbdd2b None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:36.032256 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3380a061-a207-47ab-92ac-f1a8e3fbdd2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:36.058251 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:01:36.064126 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-3380a061-a207-47ab-92ac-f1a8e3fbdd2b None None] MFA Rules not processed for user `d67a09ca67a84904ab94eb927329869e`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:01:36.067575 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-3380a061-a207-47ab-92ac-f1a8e3fbdd2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:36.089510 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2e7c73-2d8c-457f-937f-f0a8ccf9503f admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:36.096332 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409bd003-adb3-4b50-8c8f-b51f80086e83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:36.096969 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409bd003-adb3-4b50-8c8f-b51f80086e83 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:36.097250 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409bd003-adb3-4b50-8c8f-b51f80086e83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:36.097525 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409bd003-adb3-4b50-8c8f-b51f80086e83 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:36.098216 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409bd003-adb3-4b50-8c8f-b51f80086e83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:36.100113 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409bd003-adb3-4b50-8c8f-b51f80086e83 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:36.111936 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 789/1539] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:01:36 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:01:36.118906 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409bd003-adb3-4b50-8c8f-b51f80086e83 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:36.136389 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409bd003-adb3-4b50-8c8f-b51f80086e83 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:36.145558 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed1932c-28f3-4971-9bcf-071c22ab13c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:36.147253 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed1932c-28f3-4971-9bcf-071c22ab13c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:36.148554 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed1932c-28f3-4971-9bcf-071c22ab13c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:36.148987 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed1932c-28f3-4971-9bcf-071c22ab13c6 admin admin] PATH_INFO: `/v3/projects/00cdf1f8143d41db909975d35933e8f0/users/4a6c8e57cab4468fa90265eda1e3228f/roles/7f6e29e390bc41f7a9af17659a2e95d1` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:36.152316 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed1932c-28f3-4971-9bcf-071c22ab13c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00cdf1f8143d41db909975d35933e8f0, user_id=4a6c8e57cab4468fa90265eda1e3228f, role_id=7f6e29e390bc41f7a9af17659a2e95d1)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:36.155593 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed1932c-28f3-4971-9bcf-071c22ab13c6 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:36.170975 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 790/1540] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Oct 14 13:01:36 2022] PUT /identity/v3/projects/00cdf1f8143d41db909975d35933e8f0/users/4a6c8e57cab4468fa90265eda1e3228f/roles/7f6e29e390bc41f7a9af17659a2e95d1 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:01:36.182302 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4959d3-f107-4171-b2d4-9761f945ac9f None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:36.182983 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4959d3-f107-4171-b2d4-9761f945ac9f None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:36.182983 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4959d3-f107-4171-b2d4-9761f945ac9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:36.183249 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 751/1541] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:01:36 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:01:36.195939 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3380a061-a207-47ab-92ac-f1a8e3fbdd2b None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:36.197605 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-3380a061-a207-47ab-92ac-f1a8e3fbdd2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:36.237097 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-7e4959d3-f107-4171-b2d4-9761f945ac9f None None] MFA Rules not processed for user `4a6c8e57cab4468fa90265eda1e3228f`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:01:36.238841 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-7e4959d3-f107-4171-b2d4-9761f945ac9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:36.270814 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3380a061-a207-47ab-92ac-f1a8e3fbdd2b None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:36.319235 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 791/1542] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:01:36 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:01:36.327717 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75a70a2-f307-4a93-83ef-bfddc8755974 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c3c564b8c548e4beef1cbfba2ad343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:36.328633 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75a70a2-f307-4a93-83ef-bfddc8755974 service cinder] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:36.328917 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75a70a2-f307-4a93-83ef-bfddc8755974 service cinder] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:36.329231 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75a70a2-f307-4a93-83ef-bfddc8755974 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:36.334826 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4959d3-f107-4171-b2d4-9761f945ac9f None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:36.336251 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-7e4959d3-f107-4171-b2d4-9761f945ac9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:36.350541 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4959d3-f107-4171-b2d4-9761f945ac9f None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:36.359385 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09183d62-cdaa-4ff6-a894-05689c2163e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c3c564b8c548e4beef1cbfba2ad343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:36.360300 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09183d62-cdaa-4ff6-a894-05689c2163e9 service cinder] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:36.360790 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09183d62-cdaa-4ff6-a894-05689c2163e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:36.361347 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09183d62-cdaa-4ff6-a894-05689c2163e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:36.390680 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09183d62-cdaa-4ff6-a894-05689c2163e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:36.394652 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09183d62-cdaa-4ff6-a894-05689c2163e9 service cinder] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:36.405761 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 792/1543] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:01:36 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 14 13:01:36.407336 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09183d62-cdaa-4ff6-a894-05689c2163e9 service cinder] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:36.409015 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75a70a2-f307-4a93-83ef-bfddc8755974 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:36.409146 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-09183d62-cdaa-4ff6-a894-05689c2163e9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:36.410854 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75a70a2-f307-4a93-83ef-bfddc8755974 service cinder] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:36.424193 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 752/1544] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:01:36 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 14 13:01:36.482483 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75a70a2-f307-4a93-83ef-bfddc8755974 service cinder] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:36.488149 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:01:36.493113 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75a70a2-f307-4a93-83ef-bfddc8755974 service cinder] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:36.503989 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8dab95-0c9c-4762-bdc2-7b770429c144 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c3c564b8c548e4beef1cbfba2ad343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:36.505356 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8dab95-0c9c-4762-bdc2-7b770429c144 service cinder] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:36.505828 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8dab95-0c9c-4762-bdc2-7b770429c144 service cinder] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:36.506356 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8dab95-0c9c-4762-bdc2-7b770429c144 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:36.508414 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-2d8dab95-0c9c-4762-bdc2-7b770429c144 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:36.508873 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:01:36.516717 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09183d62-cdaa-4ff6-a894-05689c2163e9 service cinder] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:36.522622 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c67fb77-0209-48b6-bdec-3c7383c2d165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:36.522892 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c67fb77-0209-48b6-bdec-3c7383c2d165 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:36.523171 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c67fb77-0209-48b6-bdec-3c7383c2d165 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:36.523444 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c67fb77-0209-48b6-bdec-3c7383c2d165 admin admin] PATH_INFO: `/v3/projects/6367f95141b24cb69058933cea2192a1` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:36.524572 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c67fb77-0209-48b6-bdec-3c7383c2d165 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6367f95141b24cb69058933cea2192a1)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:36.526533 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c67fb77-0209-48b6-bdec-3c7383c2d165 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:36.596374 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8dab95-0c9c-4762-bdc2-7b770429c144 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:36.597840 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8dab95-0c9c-4762-bdc2-7b770429c144 service cinder] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:36.603501 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-7c67fb77-0209-48b6-bdec-3c7383c2d165 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6367f95141b24cb69058933cea2192a1', 'request_id': 'req-7c67fb77-0209-48b6-bdec-3c7383c2d165'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:36.609833 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 753/1545] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:01:36 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 14 13:01:36.610777 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8dab95-0c9c-4762-bdc2-7b770429c144 service cinder] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:36.614778 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-7c67fb77-0209-48b6-bdec-3c7383c2d165 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6367f95141b24cb69058933cea2192a1', 'request_id': 'req-7c67fb77-0209-48b6-bdec-3c7383c2d165'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:36.622207 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8dab95-0c9c-4762-bdc2-7b770429c144 service cinder] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:36.624982 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-7c67fb77-0209-48b6-bdec-3c7383c2d165 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6367f95141b24cb69058933cea2192a1', 'request_id': 'req-7c67fb77-0209-48b6-bdec-3c7383c2d165'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:36.644217 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-7c67fb77-0209-48b6-bdec-3c7383c2d165 admin admin] The token cache is being invalidate because project 6367f95141b24cb69058933cea2192a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:01:36.644660 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-7c67fb77-0209-48b6-bdec-3c7383c2d165 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:36.646536 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-7c67fb77-0209-48b6-bdec-3c7383c2d165 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:36.649578 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 793/1546] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Oct 14 13:01:36 2022] DELETE /identity/v3/projects/6367f95141b24cb69058933cea2192a1 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:01:36.653341 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c67fb77-0209-48b6-bdec-3c7383c2d165 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:36.655052 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-7c67fb77-0209-48b6-bdec-3c7383c2d165 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:36.694518 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4083ca0-3e5c-4911-a8ae-495bbd6209db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:36.695319 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4083ca0-3e5c-4911-a8ae-495bbd6209db admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:36.695734 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4083ca0-3e5c-4911-a8ae-495bbd6209db admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:36.696048 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4083ca0-3e5c-4911-a8ae-495bbd6209db admin admin] PATH_INFO: `/v3/users/a262d176486a4b83858722c4532c60d0` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:36.697436 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4083ca0-3e5c-4911-a8ae-495bbd6209db admin admin] RBAC: Authorizing `identity:delete_user(user_id=a262d176486a4b83858722c4532c60d0)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:36.703330 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4083ca0-3e5c-4911-a8ae-495bbd6209db admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:36.760572 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c67fb77-0209-48b6-bdec-3c7383c2d165 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:36.766811 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331c9e7d-dbfb-4053-a743-7f55fc05101e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:36.767628 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331c9e7d-dbfb-4053-a743-7f55fc05101e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:36.767914 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331c9e7d-dbfb-4053-a743-7f55fc05101e admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:36.768191 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331c9e7d-dbfb-4053-a743-7f55fc05101e admin admin] PATH_INFO: `/v3/users/902e3b64d31d4e8eab5b8080ba1b4cce` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:36.769786 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331c9e7d-dbfb-4053-a743-7f55fc05101e admin admin] RBAC: Authorizing `identity:delete_user(user_id=902e3b64d31d4e8eab5b8080ba1b4cce)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:36.772338 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331c9e7d-dbfb-4053-a743-7f55fc05101e admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:36.790835 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-e4083ca0-3e5c-4911-a8ae-495bbd6209db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a262d176486a4b83858722c4532c60d0'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:36.801756 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-e4083ca0-3e5c-4911-a8ae-495bbd6209db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a262d176486a4b83858722c4532c60d0'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:36.803637 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-e4083ca0-3e5c-4911-a8ae-495bbd6209db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a262d176486a4b83858722c4532c60d0'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:36.834506 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-e4083ca0-3e5c-4911-a8ae-495bbd6209db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a262d176486a4b83858722c4532c60d0'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:36.863046 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-e4083ca0-3e5c-4911-a8ae-495bbd6209db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a262d176486a4b83858722c4532c60d0'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:36.877095 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 754/1547] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Oct 14 13:01:36 2022] DELETE /identity/v3/users/a262d176486a4b83858722c4532c60d0 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:01:36.882314 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b441e2-1a61-4b8f-8da8-c59b405613bc None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:36.882710 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b441e2-1a61-4b8f-8da8-c59b405613bc None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:36.883081 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b441e2-1a61-4b8f-8da8-c59b405613bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:36.938647 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-331c9e7d-dbfb-4053-a743-7f55fc05101e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '902e3b64d31d4e8eab5b8080ba1b4cce'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:36.948242 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-c7b441e2-1a61-4b8f-8da8-c59b405613bc None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:01:36.950985 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-331c9e7d-dbfb-4053-a743-7f55fc05101e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '902e3b64d31d4e8eab5b8080ba1b4cce'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:36.951770 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-331c9e7d-dbfb-4053-a743-7f55fc05101e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '902e3b64d31d4e8eab5b8080ba1b4cce'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:36.955162 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-c7b441e2-1a61-4b8f-8da8-c59b405613bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:36.968452 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-331c9e7d-dbfb-4053-a743-7f55fc05101e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '902e3b64d31d4e8eab5b8080ba1b4cce'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:36.985393 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:01:37.007597 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-331c9e7d-dbfb-4053-a743-7f55fc05101e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '902e3b64d31d4e8eab5b8080ba1b4cce'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:37.020487 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 794/1548] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Oct 14 13:01:36 2022] DELETE /identity/v3/users/902e3b64d31d4e8eab5b8080ba1b4cce => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 13:01:37.055582 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 755/1549] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:01:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:01:37.101424 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331c9e7d-dbfb-4053-a743-7f55fc05101e admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:37.104726 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-331c9e7d-dbfb-4053-a743-7f55fc05101e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:37.113829 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:01:37.195468 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331c9e7d-dbfb-4053-a743-7f55fc05101e admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:37.202518 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac4f868-8562-4533-a934-b0c3a750239e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d483292f3a4794848fcacfba5b107e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:37.203202 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac4f868-8562-4533-a934-b0c3a750239e service neutron] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:37.203488 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac4f868-8562-4533-a934-b0c3a750239e service neutron] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:37.203765 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac4f868-8562-4533-a934-b0c3a750239e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:37.295133 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac4f868-8562-4533-a934-b0c3a750239e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:37.296807 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac4f868-8562-4533-a934-b0c3a750239e service neutron] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:37.307060 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 795/1550] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:01:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:01:37.528823 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b441e2-1a61-4b8f-8da8-c59b405613bc None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:37.530422 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-c7b441e2-1a61-4b8f-8da8-c59b405613bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:37.543087 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b441e2-1a61-4b8f-8da8-c59b405613bc None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:37.547714 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69eb807-21fa-4c3c-96c8-3800f6e91ce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:37.548346 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69eb807-21fa-4c3c-96c8-3800f6e91ce2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:37.548621 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69eb807-21fa-4c3c-96c8-3800f6e91ce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:37.548893 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69eb807-21fa-4c3c-96c8-3800f6e91ce2 admin admin] PATH_INFO: `/v3/projects/4551642c3a534ceea952d2c83676f65d` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:37.550110 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69eb807-21fa-4c3c-96c8-3800f6e91ce2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4551642c3a534ceea952d2c83676f65d)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:37.552040 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69eb807-21fa-4c3c-96c8-3800f6e91ce2 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:37.618536 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-c69eb807-21fa-4c3c-96c8-3800f6e91ce2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4551642c3a534ceea952d2c83676f65d', 'request_id': 'req-c69eb807-21fa-4c3c-96c8-3800f6e91ce2'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:37.628399 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-c69eb807-21fa-4c3c-96c8-3800f6e91ce2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4551642c3a534ceea952d2c83676f65d', 'request_id': 'req-c69eb807-21fa-4c3c-96c8-3800f6e91ce2'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:37.635373 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-c69eb807-21fa-4c3c-96c8-3800f6e91ce2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4551642c3a534ceea952d2c83676f65d', 'request_id': 'req-c69eb807-21fa-4c3c-96c8-3800f6e91ce2'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:37.649977 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-c69eb807-21fa-4c3c-96c8-3800f6e91ce2 admin admin] The token cache is being invalidate because project 4551642c3a534ceea952d2c83676f65d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:01:37.650194 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-c69eb807-21fa-4c3c-96c8-3800f6e91ce2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:37.651126 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-c69eb807-21fa-4c3c-96c8-3800f6e91ce2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:37.653007 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 756/1551] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Oct 14 13:01:37 2022] DELETE /identity/v3/projects/4551642c3a534ceea952d2c83676f65d => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:01:37.659528 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c3947a-e529-4dad-9f8d-21da5394625b None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:37.659821 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c3947a-e529-4dad-9f8d-21da5394625b None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:37.660097 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c3947a-e529-4dad-9f8d-21da5394625b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:37.683879 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-44c3947a-e529-4dad-9f8d-21da5394625b None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:01:37.685154 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-44c3947a-e529-4dad-9f8d-21da5394625b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:37.734317 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69eb807-21fa-4c3c-96c8-3800f6e91ce2 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:37.736896 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-c69eb807-21fa-4c3c-96c8-3800f6e91ce2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:37.770439 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 796/1552] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:01:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:01:37.778022 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e35c82a-1ce6-4aab-944f-a8225f5006ed None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:37.778410 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e35c82a-1ce6-4aab-944f-a8225f5006ed None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:37.779290 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e35c82a-1ce6-4aab-944f-a8225f5006ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:37.808657 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-0e35c82a-1ce6-4aab-944f-a8225f5006ed None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:01:37.808657 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-0e35c82a-1ce6-4aab-944f-a8225f5006ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:37.816735 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 797/1553] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:01:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 13:01:37.820723 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e35c82a-1ce6-4aab-944f-a8225f5006ed None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:37.830460 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e35c82a-1ce6-4aab-944f-a8225f5006ed None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:37.835074 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c599f09-60ae-4f01-be99-dab7328f1cba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:37.835655 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c599f09-60ae-4f01-be99-dab7328f1cba admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:37.835930 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c599f09-60ae-4f01-be99-dab7328f1cba admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:37.836194 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c599f09-60ae-4f01-be99-dab7328f1cba admin admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:37.836832 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c599f09-60ae-4f01-be99-dab7328f1cba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 13:01:37.837133 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c599f09-60ae-4f01-be99-dab7328f1cba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:37.838751 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c599f09-60ae-4f01-be99-dab7328f1cba admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:37.840101 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69eb807-21fa-4c3c-96c8-3800f6e91ce2 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:37.845436 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646a7d14-bc1a-44a9-b171-0c4b3028caad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:37.846226 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646a7d14-bc1a-44a9-b171-0c4b3028caad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:37.846646 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646a7d14-bc1a-44a9-b171-0c4b3028caad admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:37.847029 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646a7d14-bc1a-44a9-b171-0c4b3028caad admin admin] PATH_INFO: `/v3/projects/b7ead3322f6749e2b4c124590ea56257` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:37.848384 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646a7d14-bc1a-44a9-b171-0c4b3028caad admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7ead3322f6749e2b4c124590ea56257)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:37.850755 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646a7d14-bc1a-44a9-b171-0c4b3028caad admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:37.852431 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 798/1554] 10.222.0.17 () {58 vars in 1153 bytes} [Fri Oct 14 13:01:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 13:01:37.856595 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c599f09-60ae-4f01-be99-dab7328f1cba admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:37.868943 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c599f09-60ae-4f01-be99-dab7328f1cba admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:37.874242 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7988650-a5cb-4e48-87b2-c5fdd26732fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:37.874851 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7988650-a5cb-4e48-87b2-c5fdd26732fd admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:37.875128 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7988650-a5cb-4e48-87b2-c5fdd26732fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:37.875401 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7988650-a5cb-4e48-87b2-c5fdd26732fd admin admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:37.876028 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7988650-a5cb-4e48-87b2-c5fdd26732fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:37.877942 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7988650-a5cb-4e48-87b2-c5fdd26732fd admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:37.904227 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:01:37.906940 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-646a7d14-bc1a-44a9-b171-0c4b3028caad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7ead3322f6749e2b4c124590ea56257', 'request_id': 'req-646a7d14-bc1a-44a9-b171-0c4b3028caad'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:37.916201 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 799/1555] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Oct 14 13:01:37 2022] POST /identity/v3/projects => generated 385 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 13:01:37.917255 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-646a7d14-bc1a-44a9-b171-0c4b3028caad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7ead3322f6749e2b4c124590ea56257', 'request_id': 'req-646a7d14-bc1a-44a9-b171-0c4b3028caad'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:37.917370 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7988650-a5cb-4e48-87b2-c5fdd26732fd admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:37.925578 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-646a7d14-bc1a-44a9-b171-0c4b3028caad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7ead3322f6749e2b4c124590ea56257', 'request_id': 'req-646a7d14-bc1a-44a9-b171-0c4b3028caad'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:37.940117 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:01:37.940568 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-646a7d14-bc1a-44a9-b171-0c4b3028caad admin admin] The token cache is being invalidate because project b7ead3322f6749e2b4c124590ea56257 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:01:37.940887 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-646a7d14-bc1a-44a9-b171-0c4b3028caad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:37.941629 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-646a7d14-bc1a-44a9-b171-0c4b3028caad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:37.943351 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 757/1556] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Oct 14 13:01:37 2022] DELETE /identity/v3/projects/b7ead3322f6749e2b4c124590ea56257 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 13:01:37.947466 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646a7d14-bc1a-44a9-b171-0c4b3028caad admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:37.948932 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-646a7d14-bc1a-44a9-b171-0c4b3028caad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:38.010021 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7988650-a5cb-4e48-87b2-c5fdd26732fd admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:38.014752 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8820ad71-2982-446b-a394-97d321a891d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:38.015352 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8820ad71-2982-446b-a394-97d321a891d6 admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:38.015630 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8820ad71-2982-446b-a394-97d321a891d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:38.015903 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8820ad71-2982-446b-a394-97d321a891d6 admin admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:38.016526 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8820ad71-2982-446b-a394-97d321a891d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:38.018465 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8820ad71-2982-446b-a394-97d321a891d6 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:38.028879 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646a7d14-bc1a-44a9-b171-0c4b3028caad admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:38.034827 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d6d186-3e3e-428c-891c-b3cf735b8ff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:38.035465 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d6d186-3e3e-428c-891c-b3cf735b8ff1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:38.035746 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d6d186-3e3e-428c-891c-b3cf735b8ff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:38.036026 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d6d186-3e3e-428c-891c-b3cf735b8ff1 admin admin] PATH_INFO: `/v3/users/d67a09ca67a84904ab94eb927329869e` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:38.037173 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d6d186-3e3e-428c-891c-b3cf735b8ff1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d67a09ca67a84904ab94eb927329869e)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:38.039137 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d6d186-3e3e-428c-891c-b3cf735b8ff1 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:38.043153 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 800/1557] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Oct 14 13:01:37 2022] POST /identity/v3/users => generated 293 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:01:38.044061 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8820ad71-2982-446b-a394-97d321a891d6 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:38.046361 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-8820ad71-2982-446b-a394-97d321a891d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:38.058479 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8820ad71-2982-446b-a394-97d321a891d6 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:38.063346 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604db906-6791-42b9-a72c-ae2ed7bfae81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:38.063938 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604db906-6791-42b9-a72c-ae2ed7bfae81 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:38.064229 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604db906-6791-42b9-a72c-ae2ed7bfae81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:38.064480 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604db906-6791-42b9-a72c-ae2ed7bfae81 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:38.065118 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604db906-6791-42b9-a72c-ae2ed7bfae81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:38.066964 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604db906-6791-42b9-a72c-ae2ed7bfae81 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:38.078480 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 801/1558] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:01:38 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 14 13:01:38.082466 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604db906-6791-42b9-a72c-ae2ed7bfae81 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:38.092297 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-19d6d186-3e3e-428c-891c-b3cf735b8ff1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd67a09ca67a84904ab94eb927329869e'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:38.102181 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-19d6d186-3e3e-428c-891c-b3cf735b8ff1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd67a09ca67a84904ab94eb927329869e'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:38.102974 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-19d6d186-3e3e-428c-891c-b3cf735b8ff1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd67a09ca67a84904ab94eb927329869e'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:38.108630 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604db906-6791-42b9-a72c-ae2ed7bfae81 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:38.114272 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-19d6d186-3e3e-428c-891c-b3cf735b8ff1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd67a09ca67a84904ab94eb927329869e'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:38.114990 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939a3b5c-735a-4c98-8a0a-0c59b7f3df6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:38.116287 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939a3b5c-735a-4c98-8a0a-0c59b7f3df6a admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:38.116560 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939a3b5c-735a-4c98-8a0a-0c59b7f3df6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:38.116840 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939a3b5c-735a-4c98-8a0a-0c59b7f3df6a admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:38.117493 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939a3b5c-735a-4c98-8a0a-0c59b7f3df6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:38.119755 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939a3b5c-735a-4c98-8a0a-0c59b7f3df6a admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:38.129361 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-19d6d186-3e3e-428c-891c-b3cf735b8ff1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd67a09ca67a84904ab94eb927329869e'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:38.132339 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 802/1559] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:01:38 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:01:38.135829 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 758/1560] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Oct 14 13:01:37 2022] DELETE /identity/v3/users/d67a09ca67a84904ab94eb927329869e => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 13:01:38.136358 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939a3b5c-735a-4c98-8a0a-0c59b7f3df6a admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:38.138110 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-939a3b5c-735a-4c98-8a0a-0c59b7f3df6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:38.155576 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939a3b5c-735a-4c98-8a0a-0c59b7f3df6a admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:38.246722 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68684769-1925-4afb-ab97-db6cc70c8117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:38.248388 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68684769-1925-4afb-ab97-db6cc70c8117 admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:38.248809 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68684769-1925-4afb-ab97-db6cc70c8117 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:38.249349 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68684769-1925-4afb-ab97-db6cc70c8117 admin admin] PATH_INFO: `/v3/projects/6f8699c1474745ed8f644eb76e96a541/users/1a7f1358d8364a1f84c70e9174c4c9d3/roles/5e8849303a75425b9eaa2681cc031af1` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:38.283879 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68684769-1925-4afb-ab97-db6cc70c8117 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f8699c1474745ed8f644eb76e96a541, user_id=1a7f1358d8364a1f84c70e9174c4c9d3, role_id=5e8849303a75425b9eaa2681cc031af1)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:38.289320 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68684769-1925-4afb-ab97-db6cc70c8117 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:38.314215 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 803/1561] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Oct 14 13:01:38 2022] PUT /identity/v3/projects/6f8699c1474745ed8f644eb76e96a541/users/1a7f1358d8364a1f84c70e9174c4c9d3/roles/5e8849303a75425b9eaa2681cc031af1 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 13:01:38.320676 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf447bc-d90d-47fc-89c2-8de4ba3d582e None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:38.321035 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf447bc-d90d-47fc-89c2-8de4ba3d582e None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:38.321243 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf447bc-d90d-47fc-89c2-8de4ba3d582e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:38.361446 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-7bf447bc-d90d-47fc-89c2-8de4ba3d582e None None] MFA Rules not processed for user `1a7f1358d8364a1f84c70e9174c4c9d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:01:38.364430 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-7bf447bc-d90d-47fc-89c2-8de4ba3d582e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:38.446453 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:01:38.477431 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 759/1562] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:01:38 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:01:38.517093 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68684769-1925-4afb-ab97-db6cc70c8117 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:38.519108 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-68684769-1925-4afb-ab97-db6cc70c8117 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:38.589930 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68684769-1925-4afb-ab97-db6cc70c8117 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:38.594850 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa3edca-0378-4456-986c-4616bead4f58 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c3c564b8c548e4beef1cbfba2ad343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:38.595466 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa3edca-0378-4456-986c-4616bead4f58 service cinder] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:38.595740 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa3edca-0378-4456-986c-4616bead4f58 service cinder] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:38.596010 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa3edca-0378-4456-986c-4616bead4f58 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:38.613601 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa3edca-0378-4456-986c-4616bead4f58 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:38.614109 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf447bc-d90d-47fc-89c2-8de4ba3d582e None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:38.615150 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa3edca-0378-4456-986c-4616bead4f58 service cinder] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:38.615658 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-7bf447bc-d90d-47fc-89c2-8de4ba3d582e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:38.626113 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 804/1563] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:01:38 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:01:38.745234 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf447bc-d90d-47fc-89c2-8de4ba3d582e None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:38.751245 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3243ca-ce61-46b3-839d-2b2ffb7b6721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:38.752154 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3243ca-ce61-46b3-839d-2b2ffb7b6721 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:38.752441 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3243ca-ce61-46b3-839d-2b2ffb7b6721 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:38.752717 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3243ca-ce61-46b3-839d-2b2ffb7b6721 admin admin] PATH_INFO: `/v3/projects/6d5d6ff929cb4bacb5b5623c64c576f8` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:38.754093 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3243ca-ce61-46b3-839d-2b2ffb7b6721 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d5d6ff929cb4bacb5b5623c64c576f8)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:38.758279 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3243ca-ce61-46b3-839d-2b2ffb7b6721 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:38.833344 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-2e3243ca-ce61-46b3-839d-2b2ffb7b6721 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d5d6ff929cb4bacb5b5623c64c576f8', 'request_id': 'req-2e3243ca-ce61-46b3-839d-2b2ffb7b6721'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:38.843385 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-2e3243ca-ce61-46b3-839d-2b2ffb7b6721 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d5d6ff929cb4bacb5b5623c64c576f8', 'request_id': 'req-2e3243ca-ce61-46b3-839d-2b2ffb7b6721'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:38.858391 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-2e3243ca-ce61-46b3-839d-2b2ffb7b6721 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d5d6ff929cb4bacb5b5623c64c576f8', 'request_id': 'req-2e3243ca-ce61-46b3-839d-2b2ffb7b6721'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:38.876578 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-2e3243ca-ce61-46b3-839d-2b2ffb7b6721 admin admin] The token cache is being invalidate because project 6d5d6ff929cb4bacb5b5623c64c576f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:01:38.877082 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-2e3243ca-ce61-46b3-839d-2b2ffb7b6721 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:38.877926 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-2e3243ca-ce61-46b3-839d-2b2ffb7b6721 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:38.879823 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 760/1564] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Oct 14 13:01:38 2022] DELETE /identity/v3/projects/6d5d6ff929cb4bacb5b5623c64c576f8 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 13:01:38.885678 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6476936c-164b-42e9-9d1d-389e0b7e915b None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:38.886071 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6476936c-164b-42e9-9d1d-389e0b7e915b None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:38.886547 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6476936c-164b-42e9-9d1d-389e0b7e915b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:38.902026 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:01:38.927074 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-6476936c-164b-42e9-9d1d-389e0b7e915b None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:01:38.928321 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-6476936c-164b-42e9-9d1d-389e0b7e915b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:39.041442 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 805/1565] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:01:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:01:39.058421 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158ac64e-affb-4926-afbe-8e4a41b2f8fb None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:39.058784 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158ac64e-affb-4926-afbe-8e4a41b2f8fb None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:39.059252 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158ac64e-affb-4926-afbe-8e4a41b2f8fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:39.085975 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-158ac64e-affb-4926-afbe-8e4a41b2f8fb None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:01:39.087638 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-158ac64e-affb-4926-afbe-8e4a41b2f8fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:39.106744 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 761/1566] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:01:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:01:39.112875 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6476936c-164b-42e9-9d1d-389e0b7e915b None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:39.123356 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6476936c-164b-42e9-9d1d-389e0b7e915b None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:39.128597 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce5348c-3d51-4fc1-99f9-45a7afad9aea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:39.129348 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce5348c-3d51-4fc1-99f9-45a7afad9aea admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:39.129854 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce5348c-3d51-4fc1-99f9-45a7afad9aea admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:39.130220 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce5348c-3d51-4fc1-99f9-45a7afad9aea admin admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:39.130941 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce5348c-3d51-4fc1-99f9-45a7afad9aea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 13:01:39.131344 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce5348c-3d51-4fc1-99f9-45a7afad9aea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:39.133050 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce5348c-3d51-4fc1-99f9-45a7afad9aea admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:39.148913 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 806/1567] 10.222.0.17 () {58 vars in 1153 bytes} [Fri Oct 14 13:01:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 13:01:39.153420 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158ac64e-affb-4926-afbe-8e4a41b2f8fb None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:39.164434 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158ac64e-affb-4926-afbe-8e4a41b2f8fb None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:39.169142 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e179c9-c0fa-476e-99ef-b7fe983e5122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:39.170399 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e179c9-c0fa-476e-99ef-b7fe983e5122 admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:39.170750 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e179c9-c0fa-476e-99ef-b7fe983e5122 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:39.171020 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e179c9-c0fa-476e-99ef-b7fe983e5122 admin admin] PATH_INFO: `/v3/projects` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:39.171669 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e179c9-c0fa-476e-99ef-b7fe983e5122 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:39.173576 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e179c9-c0fa-476e-99ef-b7fe983e5122 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:39.202746 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 762/1568] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Oct 14 13:01:39 2022] POST /identity/v3/projects => generated 379 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 13:01:39.211322 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce5348c-3d51-4fc1-99f9-45a7afad9aea admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:39.222429 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce5348c-3d51-4fc1-99f9-45a7afad9aea admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:39.280645 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31ec457-02af-4c1d-8bd4-8d49225bf9af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:39.281252 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31ec457-02af-4c1d-8bd4-8d49225bf9af admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:39.281536 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31ec457-02af-4c1d-8bd4-8d49225bf9af admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:39.281812 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31ec457-02af-4c1d-8bd4-8d49225bf9af admin admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:39.282480 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31ec457-02af-4c1d-8bd4-8d49225bf9af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:39.284416 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31ec457-02af-4c1d-8bd4-8d49225bf9af admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:39.309993 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 807/1569] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Oct 14 13:01:39 2022] POST /identity/v3/users => generated 290 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:01:39.311296 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e179c9-c0fa-476e-99ef-b7fe983e5122 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:39.321541 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e179c9-c0fa-476e-99ef-b7fe983e5122 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:39.326627 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0769d25-149c-4278-bf83-89bf670b53db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:39.327219 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0769d25-149c-4278-bf83-89bf670b53db admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:39.330114 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0769d25-149c-4278-bf83-89bf670b53db admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:39.330535 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0769d25-149c-4278-bf83-89bf670b53db admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:39.331332 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0769d25-149c-4278-bf83-89bf670b53db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:39.333015 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0769d25-149c-4278-bf83-89bf670b53db admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:39.344516 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 763/1570] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:01:39 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:01:39.348570 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31ec457-02af-4c1d-8bd4-8d49225bf9af admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:39.360082 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31ec457-02af-4c1d-8bd4-8d49225bf9af admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:39.364881 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178584c4-c490-4a6b-8f61-35090b502e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:39.365483 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178584c4-c490-4a6b-8f61-35090b502e24 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:39.365768 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178584c4-c490-4a6b-8f61-35090b502e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:39.366046 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178584c4-c490-4a6b-8f61-35090b502e24 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:39.366727 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178584c4-c490-4a6b-8f61-35090b502e24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:39.368503 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178584c4-c490-4a6b-8f61-35090b502e24 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:39.388831 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 808/1571] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:01:39 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:01:39.393231 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0769d25-149c-4278-bf83-89bf670b53db admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:39.404547 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0769d25-149c-4278-bf83-89bf670b53db admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:39.409561 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a91a98-c87c-4d1c-b983-a760afc19acd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:39.410289 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a91a98-c87c-4d1c-b983-a760afc19acd admin admin] REQUEST_METHOD: `PUT` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:39.410572 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a91a98-c87c-4d1c-b983-a760afc19acd admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:39.410856 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a91a98-c87c-4d1c-b983-a760afc19acd admin admin] PATH_INFO: `/v3/projects/76e6d567c67e41ecb50785f394b70125/users/3d07e2d9a16243a69027a7b83fa0923c/roles/5e8849303a75425b9eaa2681cc031af1` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:39.427171 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a91a98-c87c-4d1c-b983-a760afc19acd admin admin] RBAC: Authorizing `identity:create_grant(project_id=76e6d567c67e41ecb50785f394b70125, user_id=3d07e2d9a16243a69027a7b83fa0923c, role_id=5e8849303a75425b9eaa2681cc031af1)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:39.430160 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a91a98-c87c-4d1c-b983-a760afc19acd admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:39.457690 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 764/1572] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Oct 14 13:01:39 2022] PUT /identity/v3/projects/76e6d567c67e41ecb50785f394b70125/users/3d07e2d9a16243a69027a7b83fa0923c/roles/5e8849303a75425b9eaa2681cc031af1 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:01:39.458939 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cf2484-3af8-44f5-806a-2a3345b99909 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:39.459227 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cf2484-3af8-44f5-806a-2a3345b99909 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:39.459510 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cf2484-3af8-44f5-806a-2a3345b99909 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:39.492989 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-22cf2484-3af8-44f5-806a-2a3345b99909 None None] MFA Rules not processed for user `3d07e2d9a16243a69027a7b83fa0923c`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:01:39.493882 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-22cf2484-3af8-44f5-806a-2a3345b99909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:39.572875 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 809/1573] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:01:39 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 13:01:39.578725 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a91a98-c87c-4d1c-b983-a760afc19acd admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:39.593571 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:01:39.649697 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a91a98-c87c-4d1c-b983-a760afc19acd admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:39.654892 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493c0133-9a32-497a-9af6-a6a85b80a586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:39.655572 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493c0133-9a32-497a-9af6-a6a85b80a586 admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:39.655942 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493c0133-9a32-497a-9af6-a6a85b80a586 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:39.656281 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493c0133-9a32-497a-9af6-a6a85b80a586 admin admin] PATH_INFO: `/v3/projects` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:39.656985 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493c0133-9a32-497a-9af6-a6a85b80a586 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:39.659024 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493c0133-9a32-497a-9af6-a6a85b80a586 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:39.690601 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 765/1574] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Oct 14 13:01:39 2022] POST /identity/v3/projects => generated 381 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:01:39.694400 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cf2484-3af8-44f5-806a-2a3345b99909 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:39.699894 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:01:39.707183 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cf2484-3af8-44f5-806a-2a3345b99909 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:39.763970 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21164246-160d-47a8-b876-ec8c609be0c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:39.764608 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21164246-160d-47a8-b876-ec8c609be0c4 admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:39.764889 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21164246-160d-47a8-b876-ec8c609be0c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:39.765161 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21164246-160d-47a8-b876-ec8c609be0c4 admin admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:39.765787 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21164246-160d-47a8-b876-ec8c609be0c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:39.767793 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21164246-160d-47a8-b876-ec8c609be0c4 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:39.789234 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 810/1575] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Oct 14 13:01:39 2022] POST /identity/v3/users => generated 297 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:01:39.793385 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493c0133-9a32-497a-9af6-a6a85b80a586 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:39.804494 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493c0133-9a32-497a-9af6-a6a85b80a586 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:39.809097 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77e38aa-d04d-4599-ac54-d2d6b74acb18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:39.809691 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77e38aa-d04d-4599-ac54-d2d6b74acb18 admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:39.809974 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77e38aa-d04d-4599-ac54-d2d6b74acb18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:39.810614 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77e38aa-d04d-4599-ac54-d2d6b74acb18 admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:39.811280 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77e38aa-d04d-4599-ac54-d2d6b74acb18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:39.812895 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77e38aa-d04d-4599-ac54-d2d6b74acb18 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:39.823643 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 766/1576] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:01:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:01:39.828277 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21164246-160d-47a8-b876-ec8c609be0c4 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:39.838036 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21164246-160d-47a8-b876-ec8c609be0c4 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:39.843627 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccfce64-ac1b-4c4f-976b-96978949e5bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:39.844269 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccfce64-ac1b-4c4f-976b-96978949e5bb admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:39.844551 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccfce64-ac1b-4c4f-976b-96978949e5bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:39.844839 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccfce64-ac1b-4c4f-976b-96978949e5bb admin admin] PATH_INFO: `/v3/projects/cac8dd603ffe469685952db4cb618827/users/02dbf20801f54e33a49a8d9cafe35066/roles/7f6e29e390bc41f7a9af17659a2e95d1` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:39.862529 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccfce64-ac1b-4c4f-976b-96978949e5bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=cac8dd603ffe469685952db4cb618827, user_id=02dbf20801f54e33a49a8d9cafe35066, role_id=7f6e29e390bc41f7a9af17659a2e95d1)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:39.865202 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccfce64-ac1b-4c4f-976b-96978949e5bb admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:39.879121 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 811/1577] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Oct 14 13:01:39 2022] PUT /identity/v3/projects/cac8dd603ffe469685952db4cb618827/users/02dbf20801f54e33a49a8d9cafe35066/roles/7f6e29e390bc41f7a9af17659a2e95d1 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:01:39.883108 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77e38aa-d04d-4599-ac54-d2d6b74acb18 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:39.894620 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77e38aa-d04d-4599-ac54-d2d6b74acb18 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:39.958080 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef138eb9-c249-46ab-b8fe-98b704b7188e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:39.958725 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef138eb9-c249-46ab-b8fe-98b704b7188e admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:39.959008 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef138eb9-c249-46ab-b8fe-98b704b7188e admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:39.959283 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef138eb9-c249-46ab-b8fe-98b704b7188e admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:39.959953 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef138eb9-c249-46ab-b8fe-98b704b7188e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:39.961635 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef138eb9-c249-46ab-b8fe-98b704b7188e admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:39.973789 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 767/1578] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:01:39 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:01:39.977888 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccfce64-ac1b-4c4f-976b-96978949e5bb admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:39.989956 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccfce64-ac1b-4c4f-976b-96978949e5bb admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:39.994879 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d9a4b2-195b-4b45-bc57-895187a20559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:39.995616 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d9a4b2-195b-4b45-bc57-895187a20559 admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:39.995969 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d9a4b2-195b-4b45-bc57-895187a20559 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:39.996313 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d9a4b2-195b-4b45-bc57-895187a20559 admin admin] PATH_INFO: `/v3/projects/cac8dd603ffe469685952db4cb618827/users/02dbf20801f54e33a49a8d9cafe35066/roles/7f6e29e390bc41f7a9af17659a2e95d1` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:39.999221 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d9a4b2-195b-4b45-bc57-895187a20559 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cac8dd603ffe469685952db4cb618827, user_id=02dbf20801f54e33a49a8d9cafe35066, role_id=7f6e29e390bc41f7a9af17659a2e95d1)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:40.001931 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d9a4b2-195b-4b45-bc57-895187a20559 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:40.013172 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 812/1579] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Oct 14 13:01:39 2022] PUT /identity/v3/projects/cac8dd603ffe469685952db4cb618827/users/02dbf20801f54e33a49a8d9cafe35066/roles/7f6e29e390bc41f7a9af17659a2e95d1 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:01:40.025314 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5facca-2559-460f-82af-356c102b3305 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:40.025614 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5facca-2559-460f-82af-356c102b3305 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:40.025892 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5facca-2559-460f-82af-356c102b3305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:40.071802 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-ef5facca-2559-460f-82af-356c102b3305 None None] MFA Rules not processed for user `02dbf20801f54e33a49a8d9cafe35066`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:01:40.073957 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-ef5facca-2559-460f-82af-356c102b3305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:40.198353 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 768/1580] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:01:40 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:01:40.272577 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d9a4b2-195b-4b45-bc57-895187a20559 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:40.274447 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-93d9a4b2-195b-4b45-bc57-895187a20559 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:40.356121 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d9a4b2-195b-4b45-bc57-895187a20559 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:40.364105 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f546bae-fd38-4a48-bce8-b5c2d62612b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c3c564b8c548e4beef1cbfba2ad343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:40.364828 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f546bae-fd38-4a48-bce8-b5c2d62612b5 service cinder] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:40.365826 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f546bae-fd38-4a48-bce8-b5c2d62612b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:40.365826 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f546bae-fd38-4a48-bce8-b5c2d62612b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:40.385587 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f546bae-fd38-4a48-bce8-b5c2d62612b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:40.390114 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f546bae-fd38-4a48-bce8-b5c2d62612b5 service cinder] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:40.416927 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 813/1581] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:01:40 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:01:40.480571 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5facca-2559-460f-82af-356c102b3305 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:40.489244 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-ef5facca-2559-460f-82af-356c102b3305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:40.513373 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:01:40.638455 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5facca-2559-460f-82af-356c102b3305 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:40.644399 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76eb3544-6bd8-4442-b346-5e4fe86c2b93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:40.645069 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eb3544-6bd8-4442-b346-5e4fe86c2b93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:40.645354 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eb3544-6bd8-4442-b346-5e4fe86c2b93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:40.645696 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eb3544-6bd8-4442-b346-5e4fe86c2b93 admin admin] PATH_INFO: `/v3/users/be21e157413f463a9de771672f7218c9` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:40.647741 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76eb3544-6bd8-4442-b346-5e4fe86c2b93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be21e157413f463a9de771672f7218c9)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:40.650035 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76eb3544-6bd8-4442-b346-5e4fe86c2b93 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:40.751015 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-76eb3544-6bd8-4442-b346-5e4fe86c2b93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be21e157413f463a9de771672f7218c9'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:40.762989 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-76eb3544-6bd8-4442-b346-5e4fe86c2b93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be21e157413f463a9de771672f7218c9'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:40.765073 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-76eb3544-6bd8-4442-b346-5e4fe86c2b93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be21e157413f463a9de771672f7218c9'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:40.776532 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-76eb3544-6bd8-4442-b346-5e4fe86c2b93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be21e157413f463a9de771672f7218c9'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:40.796141 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-76eb3544-6bd8-4442-b346-5e4fe86c2b93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be21e157413f463a9de771672f7218c9'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:40.804881 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 769/1582] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Oct 14 13:01:40 2022] DELETE /identity/v3/users/be21e157413f463a9de771672f7218c9 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:01:40.809487 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9df3eb-3cba-4bbc-bcfd-e1dfbbcef6c0 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:40.809923 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9df3eb-3cba-4bbc-bcfd-e1dfbbcef6c0 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:40.810155 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9df3eb-3cba-4bbc-bcfd-e1dfbbcef6c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:40.840318 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-6f9df3eb-3cba-4bbc-bcfd-e1dfbbcef6c0 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:01:40.841736 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-6f9df3eb-3cba-4bbc-bcfd-e1dfbbcef6c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:40.938814 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:01:40.965205 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 814/1583] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:01:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:01:40.993966 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76eb3544-6bd8-4442-b346-5e4fe86c2b93 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:40.996671 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-76eb3544-6bd8-4442-b346-5e4fe86c2b93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:41.114886 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9df3eb-3cba-4bbc-bcfd-e1dfbbcef6c0 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:41.115617 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76eb3544-6bd8-4442-b346-5e4fe86c2b93 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:41.116349 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-6f9df3eb-3cba-4bbc-bcfd-e1dfbbcef6c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:41.119746 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbfe97d-fc4e-47c9-a717-54fcd58dbe56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d483292f3a4794848fcacfba5b107e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:41.120462 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbfe97d-fc4e-47c9-a717-54fcd58dbe56 service neutron] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:41.120842 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbfe97d-fc4e-47c9-a717-54fcd58dbe56 service neutron] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:41.121216 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbfe97d-fc4e-47c9-a717-54fcd58dbe56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:41.137668 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbfe97d-fc4e-47c9-a717-54fcd58dbe56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:41.139341 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbfe97d-fc4e-47c9-a717-54fcd58dbe56 service neutron] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:41.140598 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9df3eb-3cba-4bbc-bcfd-e1dfbbcef6c0 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:41.146564 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e30b94d-6395-4995-8780-178de19b2b41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:41.147090 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e30b94d-6395-4995-8780-178de19b2b41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:41.147471 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e30b94d-6395-4995-8780-178de19b2b41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:41.147852 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e30b94d-6395-4995-8780-178de19b2b41 admin admin] PATH_INFO: `/v3/users/1057cf0a876943218e90e4f13b7abab5` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:41.149130 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e30b94d-6395-4995-8780-178de19b2b41 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1057cf0a876943218e90e4f13b7abab5)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:41.150395 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 770/1584] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:01:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:01:41.151030 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbfe97d-fc4e-47c9-a717-54fcd58dbe56 service neutron] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:41.151443 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e30b94d-6395-4995-8780-178de19b2b41 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:41.152495 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-4bbfe97d-fc4e-47c9-a717-54fcd58dbe56 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:41.194541 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:01:41.231977 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-9e30b94d-6395-4995-8780-178de19b2b41 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1057cf0a876943218e90e4f13b7abab5'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:41.242741 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-9e30b94d-6395-4995-8780-178de19b2b41 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1057cf0a876943218e90e4f13b7abab5'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:41.245524 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-9e30b94d-6395-4995-8780-178de19b2b41 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1057cf0a876943218e90e4f13b7abab5'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:41.249048 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbfe97d-fc4e-47c9-a717-54fcd58dbe56 service neutron] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:41.255518 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4340f466-3f56-4e86-956a-b7a1a0cb4a1e tempest-VolumeQuotaClassesTest-1474890315 tempest-VolumeQuotaClassesTest-1474890315-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02dbf20801f54e33a49a8d9cafe35066', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac8dd603ffe469685952db4cb618827', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:41.256386 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4340f466-3f56-4e86-956a-b7a1a0cb4a1e tempest-VolumeQuotaClassesTest-1474890315 tempest-VolumeQuotaClassesTest-1474890315-project-admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:41.257061 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4340f466-3f56-4e86-956a-b7a1a0cb4a1e tempest-VolumeQuotaClassesTest-1474890315 tempest-VolumeQuotaClassesTest-1474890315-project-admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:41.257601 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4340f466-3f56-4e86-956a-b7a1a0cb4a1e tempest-VolumeQuotaClassesTest-1474890315 tempest-VolumeQuotaClassesTest-1474890315-project-admin] PATH_INFO: `/v3/domains` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:41.258788 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4340f466-3f56-4e86-956a-b7a1a0cb4a1e tempest-VolumeQuotaClassesTest-1474890315 tempest-VolumeQuotaClassesTest-1474890315-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 13:01:41.259254 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4340f466-3f56-4e86-956a-b7a1a0cb4a1e tempest-VolumeQuotaClassesTest-1474890315 tempest-VolumeQuotaClassesTest-1474890315-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:41.259482 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-9e30b94d-6395-4995-8780-178de19b2b41 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1057cf0a876943218e90e4f13b7abab5'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:41.261440 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4340f466-3f56-4e86-956a-b7a1a0cb4a1e tempest-VolumeQuotaClassesTest-1474890315 tempest-VolumeQuotaClassesTest-1474890315-project-admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:41.275975 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 771/1585] 10.222.0.17 () {58 vars in 1153 bytes} [Fri Oct 14 13:01:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 13:01:41.280053 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-9e30b94d-6395-4995-8780-178de19b2b41 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1057cf0a876943218e90e4f13b7abab5'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:41.280916 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4340f466-3f56-4e86-956a-b7a1a0cb4a1e tempest-VolumeQuotaClassesTest-1474890315 tempest-VolumeQuotaClassesTest-1474890315-project-admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:41.283048 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-4340f466-3f56-4e86-956a-b7a1a0cb4a1e tempest-VolumeQuotaClassesTest-1474890315 tempest-VolumeQuotaClassesTest-1474890315-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:41.290165 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 815/1586] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Oct 14 13:01:41 2022] DELETE /identity/v3/users/1057cf0a876943218e90e4f13b7abab5 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:01:41.295867 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a0deea-d080-46d4-b30e-a04159b0a06c None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:41.296349 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a0deea-d080-46d4-b30e-a04159b0a06c None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:41.297045 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a0deea-d080-46d4-b30e-a04159b0a06c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:41.301354 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4340f466-3f56-4e86-956a-b7a1a0cb4a1e tempest-VolumeQuotaClassesTest-1474890315 tempest-VolumeQuotaClassesTest-1474890315-project-admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:41.332379 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-c9a0deea-d080-46d4-b30e-a04159b0a06c None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:01:41.334132 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-c9a0deea-d080-46d4-b30e-a04159b0a06c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:41.403318 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bb4257-2034-4cbc-a16f-a3c4d7ecff2a tempest-VolumeQuotaClassesTest-1474890315 tempest-VolumeQuotaClassesTest-1474890315-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02dbf20801f54e33a49a8d9cafe35066', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac8dd603ffe469685952db4cb618827', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:41.405300 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bb4257-2034-4cbc-a16f-a3c4d7ecff2a tempest-VolumeQuotaClassesTest-1474890315 tempest-VolumeQuotaClassesTest-1474890315-project-admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:41.405600 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bb4257-2034-4cbc-a16f-a3c4d7ecff2a tempest-VolumeQuotaClassesTest-1474890315 tempest-VolumeQuotaClassesTest-1474890315-project-admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:41.406032 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bb4257-2034-4cbc-a16f-a3c4d7ecff2a tempest-VolumeQuotaClassesTest-1474890315 tempest-VolumeQuotaClassesTest-1474890315-project-admin] PATH_INFO: `/v3/projects` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:41.406727 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bb4257-2034-4cbc-a16f-a3c4d7ecff2a tempest-VolumeQuotaClassesTest-1474890315 tempest-VolumeQuotaClassesTest-1474890315-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:41.408775 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bb4257-2034-4cbc-a16f-a3c4d7ecff2a tempest-VolumeQuotaClassesTest-1474890315 tempest-VolumeQuotaClassesTest-1474890315-project-admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:41.469087 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 816/1587] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:01:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 13:01:41.481172 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 772/1588] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Oct 14 13:01:41 2022] POST /identity/v3/projects => generated 354 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:01:41.484341 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a0deea-d080-46d4-b30e-a04159b0a06c None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:41.486341 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-c9a0deea-d080-46d4-b30e-a04159b0a06c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:41.488505 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bb4257-2034-4cbc-a16f-a3c4d7ecff2a tempest-VolumeQuotaClassesTest-1474890315 tempest-VolumeQuotaClassesTest-1474890315-project-admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:41.610151 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a0deea-d080-46d4-b30e-a04159b0a06c None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:41.654405 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bb4257-2034-4cbc-a16f-a3c4d7ecff2a tempest-VolumeQuotaClassesTest-1474890315 tempest-VolumeQuotaClassesTest-1474890315-project-admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:41.654894 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:01:41.667329 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95050b2f-f9fd-4d7a-9871-339280c9b107 tempest-VolumeQuotaClassesTest-1474890315 tempest-VolumeQuotaClassesTest-1474890315-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02dbf20801f54e33a49a8d9cafe35066', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac8dd603ffe469685952db4cb618827', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:41.669038 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95050b2f-f9fd-4d7a-9871-339280c9b107 tempest-VolumeQuotaClassesTest-1474890315 tempest-VolumeQuotaClassesTest-1474890315-project-admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:41.670428 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95050b2f-f9fd-4d7a-9871-339280c9b107 tempest-VolumeQuotaClassesTest-1474890315 tempest-VolumeQuotaClassesTest-1474890315-project-admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:41.670428 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95050b2f-f9fd-4d7a-9871-339280c9b107 tempest-VolumeQuotaClassesTest-1474890315 tempest-VolumeQuotaClassesTest-1474890315-project-admin] PATH_INFO: `/v3/domains` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:41.670837 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95050b2f-f9fd-4d7a-9871-339280c9b107 tempest-VolumeQuotaClassesTest-1474890315 tempest-VolumeQuotaClassesTest-1474890315-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 13:01:41.671160 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95050b2f-f9fd-4d7a-9871-339280c9b107 tempest-VolumeQuotaClassesTest-1474890315 tempest-VolumeQuotaClassesTest-1474890315-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:41.677327 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95050b2f-f9fd-4d7a-9871-339280c9b107 tempest-VolumeQuotaClassesTest-1474890315 tempest-VolumeQuotaClassesTest-1474890315-project-admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:41.697439 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00414b3-8199-4574-9188-44efb41c93c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d483292f3a4794848fcacfba5b107e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:41.698615 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00414b3-8199-4574-9188-44efb41c93c1 service neutron] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:41.698907 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00414b3-8199-4574-9188-44efb41c93c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:41.699790 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00414b3-8199-4574-9188-44efb41c93c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:41.722654 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 773/1589] 10.222.0.17 () {58 vars in 1153 bytes} [Fri Oct 14 13:01:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 13:01:41.751638 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95050b2f-f9fd-4d7a-9871-339280c9b107 tempest-VolumeQuotaClassesTest-1474890315 tempest-VolumeQuotaClassesTest-1474890315-project-admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:41.754348 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-95050b2f-f9fd-4d7a-9871-339280c9b107 tempest-VolumeQuotaClassesTest-1474890315 tempest-VolumeQuotaClassesTest-1474890315-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:41.862338 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00414b3-8199-4574-9188-44efb41c93c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:41.866854 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00414b3-8199-4574-9188-44efb41c93c1 service neutron] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:41.882519 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 817/1590] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:01:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:01:41.883666 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00414b3-8199-4574-9188-44efb41c93c1 service neutron] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:41.886907 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:01:41.934505 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00414b3-8199-4574-9188-44efb41c93c1 service neutron] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:41.935820 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95050b2f-f9fd-4d7a-9871-339280c9b107 tempest-VolumeQuotaClassesTest-1474890315 tempest-VolumeQuotaClassesTest-1474890315-project-admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:41.952115 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300a6b7c-ccb3-4247-95ec-c7a36b203766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:41.952842 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300a6b7c-ccb3-4247-95ec-c7a36b203766 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:41.953219 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300a6b7c-ccb3-4247-95ec-c7a36b203766 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:41.954078 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300a6b7c-ccb3-4247-95ec-c7a36b203766 admin admin] PATH_INFO: `/v3/projects/120e65c0f59e455c823f5b6c5f8d67c3` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:41.957743 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300a6b7c-ccb3-4247-95ec-c7a36b203766 admin admin] RBAC: Authorizing `identity:delete_project(project_id=120e65c0f59e455c823f5b6c5f8d67c3)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:41.959840 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd89bdb-ebf9-4a36-8863-87610883fd09 tempest-VolumeQuotaClassesTest-1474890315 tempest-VolumeQuotaClassesTest-1474890315-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02dbf20801f54e33a49a8d9cafe35066', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac8dd603ffe469685952db4cb618827', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:41.961852 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd89bdb-ebf9-4a36-8863-87610883fd09 tempest-VolumeQuotaClassesTest-1474890315 tempest-VolumeQuotaClassesTest-1474890315-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:41.962249 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300a6b7c-ccb3-4247-95ec-c7a36b203766 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:41.962875 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd89bdb-ebf9-4a36-8863-87610883fd09 tempest-VolumeQuotaClassesTest-1474890315 tempest-VolumeQuotaClassesTest-1474890315-project-admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:41.963350 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd89bdb-ebf9-4a36-8863-87610883fd09 tempest-VolumeQuotaClassesTest-1474890315 tempest-VolumeQuotaClassesTest-1474890315-project-admin] PATH_INFO: `/v3/projects/226f41a8e8a4401baa0c5251df9bce97` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:41.966542 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd89bdb-ebf9-4a36-8863-87610883fd09 tempest-VolumeQuotaClassesTest-1474890315 tempest-VolumeQuotaClassesTest-1474890315-project-admin] RBAC: Authorizing `identity:delete_project(project_id=226f41a8e8a4401baa0c5251df9bce97)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:41.974092 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd89bdb-ebf9-4a36-8863-87610883fd09 tempest-VolumeQuotaClassesTest-1474890315 tempest-VolumeQuotaClassesTest-1474890315-project-admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:42.075085 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-300a6b7c-ccb3-4247-95ec-c7a36b203766 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '120e65c0f59e455c823f5b6c5f8d67c3', 'request_id': 'req-300a6b7c-ccb3-4247-95ec-c7a36b203766'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:42.081442 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-3dd89bdb-ebf9-4a36-8863-87610883fd09 tempest-VolumeQuotaClassesTest-1474890315 tempest-VolumeQuotaClassesTest-1474890315-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '226f41a8e8a4401baa0c5251df9bce97', 'request_id': 'req-3dd89bdb-ebf9-4a36-8863-87610883fd09'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:42.091758 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-3dd89bdb-ebf9-4a36-8863-87610883fd09 tempest-VolumeQuotaClassesTest-1474890315 tempest-VolumeQuotaClassesTest-1474890315-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '226f41a8e8a4401baa0c5251df9bce97', 'request_id': 'req-3dd89bdb-ebf9-4a36-8863-87610883fd09'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:42.098181 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-300a6b7c-ccb3-4247-95ec-c7a36b203766 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '120e65c0f59e455c823f5b6c5f8d67c3', 'request_id': 'req-300a6b7c-ccb3-4247-95ec-c7a36b203766'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:42.103714 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-3dd89bdb-ebf9-4a36-8863-87610883fd09 tempest-VolumeQuotaClassesTest-1474890315 tempest-VolumeQuotaClassesTest-1474890315-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '226f41a8e8a4401baa0c5251df9bce97', 'request_id': 'req-3dd89bdb-ebf9-4a36-8863-87610883fd09'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:42.109615 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-300a6b7c-ccb3-4247-95ec-c7a36b203766 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '120e65c0f59e455c823f5b6c5f8d67c3', 'request_id': 'req-300a6b7c-ccb3-4247-95ec-c7a36b203766'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:42.138143 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-300a6b7c-ccb3-4247-95ec-c7a36b203766 admin admin] The token cache is being invalidate because project 120e65c0f59e455c823f5b6c5f8d67c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:01:42.138601 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-300a6b7c-ccb3-4247-95ec-c7a36b203766 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:42.139328 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-300a6b7c-ccb3-4247-95ec-c7a36b203766 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:42.142131 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 774/1591] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Oct 14 13:01:41 2022] DELETE /identity/v3/projects/120e65c0f59e455c823f5b6c5f8d67c3 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:01:42.146432 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300a6b7c-ccb3-4247-95ec-c7a36b203766 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:42.147859 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-300a6b7c-ccb3-4247-95ec-c7a36b203766 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:42.155035 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-3dd89bdb-ebf9-4a36-8863-87610883fd09 tempest-VolumeQuotaClassesTest-1474890315 tempest-VolumeQuotaClassesTest-1474890315-project-admin] The token cache is being invalidate because project 226f41a8e8a4401baa0c5251df9bce97 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:01:42.155481 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-3dd89bdb-ebf9-4a36-8863-87610883fd09 tempest-VolumeQuotaClassesTest-1474890315 tempest-VolumeQuotaClassesTest-1474890315-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:42.159734 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-3dd89bdb-ebf9-4a36-8863-87610883fd09 tempest-VolumeQuotaClassesTest-1474890315 tempest-VolumeQuotaClassesTest-1474890315-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:42.165781 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 818/1592] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Oct 14 13:01:41 2022] DELETE /identity/v3/projects/226f41a8e8a4401baa0c5251df9bce97 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:01:42.306719 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db6fba3-3974-41d7-89c3-e36da564e482 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:42.307341 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db6fba3-3974-41d7-89c3-e36da564e482 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:42.307341 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db6fba3-3974-41d7-89c3-e36da564e482 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:42.309019 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 819/1593] 10.222.0.17 () {54 vars in 921 bytes} [Fri Oct 14 13:01:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 13:01:42.313879 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300a6b7c-ccb3-4247-95ec-c7a36b203766 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:42.322651 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30d5110-97d0-4d46-a9ca-015bd0b1af82 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:42.323523 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30d5110-97d0-4d46-a9ca-015bd0b1af82 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:42.324248 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30d5110-97d0-4d46-a9ca-015bd0b1af82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:42.379274 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-d30d5110-97d0-4d46-a9ca-015bd0b1af82 None None] MFA Rules not processed for user `931f4e32c8764514b5efed31b0785be7`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:01:42.380530 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-d30d5110-97d0-4d46-a9ca-015bd0b1af82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:42.493708 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e1a50c-79aa-442b-ac02-a642a9c65146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:42.494776 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e1a50c-79aa-442b-ac02-a642a9c65146 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:42.495265 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e1a50c-79aa-442b-ac02-a642a9c65146 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:42.495795 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e1a50c-79aa-442b-ac02-a642a9c65146 admin admin] PATH_INFO: `/v3/users/d27383c6e0b2476b98b977aa7119e8eb` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:42.497986 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e1a50c-79aa-442b-ac02-a642a9c65146 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d27383c6e0b2476b98b977aa7119e8eb)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:42.507590 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e1a50c-79aa-442b-ac02-a642a9c65146 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:42.532895 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:01:42.566887 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 820/1594] 10.222.0.17 () {58 vars in 1018 bytes} [Fri Oct 14 13:01:42 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 13:01:42.567941 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30d5110-97d0-4d46-a9ca-015bd0b1af82 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:42.569923 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-d30d5110-97d0-4d46-a9ca-015bd0b1af82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:42.586994 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30d5110-97d0-4d46-a9ca-015bd0b1af82 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:42.592455 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bd254f-2b63-48b5-aece-a520206cb628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:42.593284 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bd254f-2b63-48b5-aece-a520206cb628 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:42.593674 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bd254f-2b63-48b5-aece-a520206cb628 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:42.594033 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bd254f-2b63-48b5-aece-a520206cb628 admin admin] PATH_INFO: `/v3/users/3d07e2d9a16243a69027a7b83fa0923c` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:42.594795 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:01:42.596696 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bd254f-2b63-48b5-aece-a520206cb628 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d07e2d9a16243a69027a7b83fa0923c)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:42.598949 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bd254f-2b63-48b5-aece-a520206cb628 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:42.653935 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-85e1a50c-79aa-442b-ac02-a642a9c65146 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd27383c6e0b2476b98b977aa7119e8eb'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:42.665844 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-85e1a50c-79aa-442b-ac02-a642a9c65146 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd27383c6e0b2476b98b977aa7119e8eb'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:42.666689 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-85e1a50c-79aa-442b-ac02-a642a9c65146 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd27383c6e0b2476b98b977aa7119e8eb'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:42.673717 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-09bd254f-2b63-48b5-aece-a520206cb628 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d07e2d9a16243a69027a7b83fa0923c'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:42.677366 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-85e1a50c-79aa-442b-ac02-a642a9c65146 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd27383c6e0b2476b98b977aa7119e8eb'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:42.683292 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-09bd254f-2b63-48b5-aece-a520206cb628 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d07e2d9a16243a69027a7b83fa0923c'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:42.684474 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-09bd254f-2b63-48b5-aece-a520206cb628 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d07e2d9a16243a69027a7b83fa0923c'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:42.696686 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-09bd254f-2b63-48b5-aece-a520206cb628 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d07e2d9a16243a69027a7b83fa0923c'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:42.702050 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-85e1a50c-79aa-442b-ac02-a642a9c65146 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd27383c6e0b2476b98b977aa7119e8eb'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:42.715141 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 775/1595] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Oct 14 13:01:42 2022] DELETE /identity/v3/users/d27383c6e0b2476b98b977aa7119e8eb => generated 0 bytes in 569 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:01:42.716593 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e1a50c-79aa-442b-ac02-a642a9c65146 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:42.718191 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-85e1a50c-79aa-442b-ac02-a642a9c65146 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:42.737279 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-09bd254f-2b63-48b5-aece-a520206cb628 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d07e2d9a16243a69027a7b83fa0923c'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:42.755143 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 821/1596] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Oct 14 13:01:42 2022] DELETE /identity/v3/users/3d07e2d9a16243a69027a7b83fa0923c => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:01:42.757869 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bd254f-2b63-48b5-aece-a520206cb628 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:42.761964 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-09bd254f-2b63-48b5-aece-a520206cb628 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:42.832869 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e1a50c-79aa-442b-ac02-a642a9c65146 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:42.892130 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bd254f-2b63-48b5-aece-a520206cb628 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:42.907176 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9507f4-4d85-4533-92bf-bad25952e18c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '931f4e32c8764514b5efed31b0785be7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:42.908094 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9507f4-4d85-4533-92bf-bad25952e18c service nova] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:42.908577 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9507f4-4d85-4533-92bf-bad25952e18c service nova] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:42.908897 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9507f4-4d85-4533-92bf-bad25952e18c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:42.912493 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-6a9507f4-4d85-4533-92bf-bad25952e18c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:42.928538 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9507f4-4d85-4533-92bf-bad25952e18c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:42.930960 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9507f4-4d85-4533-92bf-bad25952e18c service nova] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:42.947562 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 822/1597] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:01:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:01:42.949172 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cfd47e-08ec-4705-ba65-7bb1f8fb345e None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:42.949842 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cfd47e-08ec-4705-ba65-7bb1f8fb345e None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:42.950592 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cfd47e-08ec-4705-ba65-7bb1f8fb345e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:42.967203 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43414a71-23dd-4e46-bc75-8503328b8531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:42.967945 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43414a71-23dd-4e46-bc75-8503328b8531 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:42.968317 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43414a71-23dd-4e46-bc75-8503328b8531 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:42.968684 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43414a71-23dd-4e46-bc75-8503328b8531 admin admin] PATH_INFO: `/v3/projects/984d898bd5d241169d1bc3725ac0e4a6` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:42.971023 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43414a71-23dd-4e46-bc75-8503328b8531 admin admin] RBAC: Authorizing `identity:delete_project(project_id=984d898bd5d241169d1bc3725ac0e4a6)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:42.972928 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43414a71-23dd-4e46-bc75-8503328b8531 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:42.990807 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-59cfd47e-08ec-4705-ba65-7bb1f8fb345e None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:01:42.992496 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-59cfd47e-08ec-4705-ba65-7bb1f8fb345e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:43.005125 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 823/1598] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:01:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:01:43.016293 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cfd47e-08ec-4705-ba65-7bb1f8fb345e None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:43.018474 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-59cfd47e-08ec-4705-ba65-7bb1f8fb345e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:43.070212 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:01:43.073308 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-43414a71-23dd-4e46-bc75-8503328b8531 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '984d898bd5d241169d1bc3725ac0e4a6', 'request_id': 'req-43414a71-23dd-4e46-bc75-8503328b8531'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:43.090686 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-43414a71-23dd-4e46-bc75-8503328b8531 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '984d898bd5d241169d1bc3725ac0e4a6', 'request_id': 'req-43414a71-23dd-4e46-bc75-8503328b8531'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:43.105933 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-43414a71-23dd-4e46-bc75-8503328b8531 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '984d898bd5d241169d1bc3725ac0e4a6', 'request_id': 'req-43414a71-23dd-4e46-bc75-8503328b8531'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:43.108536 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:01:43.125070 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-43414a71-23dd-4e46-bc75-8503328b8531 admin admin] The token cache is being invalidate because project 984d898bd5d241169d1bc3725ac0e4a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:01:43.125943 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-43414a71-23dd-4e46-bc75-8503328b8531 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:43.126416 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-43414a71-23dd-4e46-bc75-8503328b8531 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:43.128260 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 776/1599] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Oct 14 13:01:42 2022] DELETE /identity/v3/projects/984d898bd5d241169d1bc3725ac0e4a6 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:01:43.132272 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43414a71-23dd-4e46-bc75-8503328b8531 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:43.135252 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-43414a71-23dd-4e46-bc75-8503328b8531 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:43.135743 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cfd47e-08ec-4705-ba65-7bb1f8fb345e None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:43.214579 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c432378-f46b-47d5-b0ae-9cbc262adf5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d483292f3a4794848fcacfba5b107e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:43.215231 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c432378-f46b-47d5-b0ae-9cbc262adf5e service neutron] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:43.215509 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c432378-f46b-47d5-b0ae-9cbc262adf5e service neutron] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:43.215787 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c432378-f46b-47d5-b0ae-9cbc262adf5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:43.218293 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-7c432378-f46b-47d5-b0ae-9cbc262adf5e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:43.233824 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43414a71-23dd-4e46-bc75-8503328b8531 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:43.238519 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece9f70b-d836-4798-ac74-80ab1dc2980e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:43.239180 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece9f70b-d836-4798-ac74-80ab1dc2980e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:43.239459 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece9f70b-d836-4798-ac74-80ab1dc2980e admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:43.239735 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece9f70b-d836-4798-ac74-80ab1dc2980e admin admin] PATH_INFO: `/v3/users/4a6c8e57cab4468fa90265eda1e3228f` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:43.240883 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece9f70b-d836-4798-ac74-80ab1dc2980e admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a6c8e57cab4468fa90265eda1e3228f)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:43.242856 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece9f70b-d836-4798-ac74-80ab1dc2980e admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:43.287603 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c432378-f46b-47d5-b0ae-9cbc262adf5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:43.289079 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c432378-f46b-47d5-b0ae-9cbc262adf5e service neutron] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:43.293964 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-ece9f70b-d836-4798-ac74-80ab1dc2980e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a6c8e57cab4468fa90265eda1e3228f'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:43.302080 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-ece9f70b-d836-4798-ac74-80ab1dc2980e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a6c8e57cab4468fa90265eda1e3228f'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:43.302272 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 824/1600] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:01:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:01:43.302770 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c432378-f46b-47d5-b0ae-9cbc262adf5e service neutron] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:43.302878 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-ece9f70b-d836-4798-ac74-80ab1dc2980e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a6c8e57cab4468fa90265eda1e3228f'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:43.304082 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-7c432378-f46b-47d5-b0ae-9cbc262adf5e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:43.312037 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-ece9f70b-d836-4798-ac74-80ab1dc2980e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a6c8e57cab4468fa90265eda1e3228f'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:43.319043 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c432378-f46b-47d5-b0ae-9cbc262adf5e service neutron] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:43.324894 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90a6113-db6f-4812-bfd6-a4c3fcb43824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:43.326429 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90a6113-db6f-4812-bfd6-a4c3fcb43824 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:43.326719 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90a6113-db6f-4812-bfd6-a4c3fcb43824 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:43.327052 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90a6113-db6f-4812-bfd6-a4c3fcb43824 admin admin] PATH_INFO: `/v3/projects/4b4abd98b14d41ceb90eb49f5b540f02` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:43.328430 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90a6113-db6f-4812-bfd6-a4c3fcb43824 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b4abd98b14d41ceb90eb49f5b540f02)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:43.329165 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-ece9f70b-d836-4798-ac74-80ab1dc2980e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a6c8e57cab4468fa90265eda1e3228f'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:43.330402 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90a6113-db6f-4812-bfd6-a4c3fcb43824 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:43.337043 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 777/1601] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Oct 14 13:01:43 2022] DELETE /identity/v3/users/4a6c8e57cab4468fa90265eda1e3228f => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:01:43.404017 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-c90a6113-db6f-4812-bfd6-a4c3fcb43824 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b4abd98b14d41ceb90eb49f5b540f02', 'request_id': 'req-c90a6113-db6f-4812-bfd6-a4c3fcb43824'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:43.415072 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-c90a6113-db6f-4812-bfd6-a4c3fcb43824 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b4abd98b14d41ceb90eb49f5b540f02', 'request_id': 'req-c90a6113-db6f-4812-bfd6-a4c3fcb43824'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:43.426389 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-c90a6113-db6f-4812-bfd6-a4c3fcb43824 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b4abd98b14d41ceb90eb49f5b540f02', 'request_id': 'req-c90a6113-db6f-4812-bfd6-a4c3fcb43824'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:43.446327 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-c90a6113-db6f-4812-bfd6-a4c3fcb43824 admin admin] The token cache is being invalidate because project 4b4abd98b14d41ceb90eb49f5b540f02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:01:43.447104 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-c90a6113-db6f-4812-bfd6-a4c3fcb43824 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:43.447782 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-c90a6113-db6f-4812-bfd6-a4c3fcb43824 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:43.450214 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 825/1602] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Oct 14 13:01:43 2022] DELETE /identity/v3/projects/4b4abd98b14d41ceb90eb49f5b540f02 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:01:43.455017 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d759afbc-32c0-4d20-9243-24c62d378a57 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:43.455938 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d759afbc-32c0-4d20-9243-24c62d378a57 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:43.457242 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d759afbc-32c0-4d20-9243-24c62d378a57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:43.492807 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-d759afbc-32c0-4d20-9243-24c62d378a57 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:01:43.494314 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-d759afbc-32c0-4d20-9243-24c62d378a57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:43.563100 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:01:43.583227 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 778/1603] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:01:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:01:43.591888 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb93dde-31d5-4763-a9f7-94467bba2b96 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:43.592211 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb93dde-31d5-4763-a9f7-94467bba2b96 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:43.592534 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb93dde-31d5-4763-a9f7-94467bba2b96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:43.619551 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-3bb93dde-31d5-4763-a9f7-94467bba2b96 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:01:43.621429 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-3bb93dde-31d5-4763-a9f7-94467bba2b96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:43.636196 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 826/1604] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:01:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:01:43.637720 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d759afbc-32c0-4d20-9243-24c62d378a57 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:43.664812 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d759afbc-32c0-4d20-9243-24c62d378a57 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:43.671577 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a4115d-2a23-45ba-942f-5329c387bba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:43.672241 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a4115d-2a23-45ba-942f-5329c387bba6 admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:43.672482 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a4115d-2a23-45ba-942f-5329c387bba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:43.673791 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a4115d-2a23-45ba-942f-5329c387bba6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:43.673791 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a4115d-2a23-45ba-942f-5329c387bba6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 13:01:43.673981 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a4115d-2a23-45ba-942f-5329c387bba6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:43.675682 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a4115d-2a23-45ba-942f-5329c387bba6 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:43.699743 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 779/1605] 10.222.0.17 () {58 vars in 1153 bytes} [Fri Oct 14 13:01:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 13:01:43.700755 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb93dde-31d5-4763-a9f7-94467bba2b96 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:43.711915 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a4115d-2a23-45ba-942f-5329c387bba6 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:43.713800 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb93dde-31d5-4763-a9f7-94467bba2b96 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:43.714479 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-81a4115d-2a23-45ba-942f-5329c387bba6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:43.721200 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7eaaa35-9ae5-4e41-b5e6-7ce6fbf664ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:43.722075 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eaaa35-9ae5-4e41-b5e6-7ce6fbf664ea admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:43.722527 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eaaa35-9ae5-4e41-b5e6-7ce6fbf664ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:43.723049 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eaaa35-9ae5-4e41-b5e6-7ce6fbf664ea admin admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:43.723828 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7eaaa35-9ae5-4e41-b5e6-7ce6fbf664ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:43.734624 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a4115d-2a23-45ba-942f-5329c387bba6 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:43.740554 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d1f46b-ac75-4943-a125-7d461d5f8ff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:43.741207 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d1f46b-ac75-4943-a125-7d461d5f8ff9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:43.741492 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d1f46b-ac75-4943-a125-7d461d5f8ff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:43.741771 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d1f46b-ac75-4943-a125-7d461d5f8ff9 admin admin] PATH_INFO: `/v3/projects/76e6d567c67e41ecb50785f394b70125` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:43.743515 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d1f46b-ac75-4943-a125-7d461d5f8ff9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=76e6d567c67e41ecb50785f394b70125)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:43.745503 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d1f46b-ac75-4943-a125-7d461d5f8ff9 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:43.747771 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7eaaa35-9ae5-4e41-b5e6-7ce6fbf664ea admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:43.815714 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 827/1606] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Oct 14 13:01:43 2022] POST /identity/v3/projects => generated 381 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:01:43.815714 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7eaaa35-9ae5-4e41-b5e6-7ce6fbf664ea admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:43.816447 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-36d1f46b-ac75-4943-a125-7d461d5f8ff9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76e6d567c67e41ecb50785f394b70125', 'request_id': 'req-36d1f46b-ac75-4943-a125-7d461d5f8ff9'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:43.819209 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-a7eaaa35-9ae5-4e41-b5e6-7ce6fbf664ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:43.826282 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:01:43.831463 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-36d1f46b-ac75-4943-a125-7d461d5f8ff9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76e6d567c67e41ecb50785f394b70125', 'request_id': 'req-36d1f46b-ac75-4943-a125-7d461d5f8ff9'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:43.842416 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-36d1f46b-ac75-4943-a125-7d461d5f8ff9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76e6d567c67e41ecb50785f394b70125', 'request_id': 'req-36d1f46b-ac75-4943-a125-7d461d5f8ff9'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:43.870226 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-36d1f46b-ac75-4943-a125-7d461d5f8ff9 admin admin] The token cache is being invalidate because project 76e6d567c67e41ecb50785f394b70125 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:01:43.870757 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-36d1f46b-ac75-4943-a125-7d461d5f8ff9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:43.871938 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-36d1f46b-ac75-4943-a125-7d461d5f8ff9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:43.876820 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 780/1607] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Oct 14 13:01:43 2022] DELETE /identity/v3/projects/76e6d567c67e41ecb50785f394b70125 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 13:01:43.877767 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d1f46b-ac75-4943-a125-7d461d5f8ff9 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:43.879906 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-36d1f46b-ac75-4943-a125-7d461d5f8ff9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:43.917845 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7eaaa35-9ae5-4e41-b5e6-7ce6fbf664ea admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:43.928077 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3f9712-098b-4fab-930b-d438b4384977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:43.928737 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3f9712-098b-4fab-930b-d438b4384977 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:43.929018 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3f9712-098b-4fab-930b-d438b4384977 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:43.929305 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3f9712-098b-4fab-930b-d438b4384977 admin admin] PATH_INFO: `/v3/projects/00cdf1f8143d41db909975d35933e8f0` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:43.931264 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3f9712-098b-4fab-930b-d438b4384977 admin admin] RBAC: Authorizing `identity:delete_project(project_id=00cdf1f8143d41db909975d35933e8f0)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:43.942266 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3f9712-098b-4fab-930b-d438b4384977 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:43.996712 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d1f46b-ac75-4943-a125-7d461d5f8ff9 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:44.002902 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0ca9dc-01cc-441c-a299-0efd0db360d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:44.003693 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0ca9dc-01cc-441c-a299-0efd0db360d9 admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:44.004097 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0ca9dc-01cc-441c-a299-0efd0db360d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:44.004482 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0ca9dc-01cc-441c-a299-0efd0db360d9 admin admin] PATH_INFO: `/v3/users` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:44.005670 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0ca9dc-01cc-441c-a299-0efd0db360d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:44.009225 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0ca9dc-01cc-441c-a299-0efd0db360d9 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:44.048931 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 781/1608] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Oct 14 13:01:43 2022] POST /identity/v3/users => generated 291 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:01:44.049847 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0ca9dc-01cc-441c-a299-0efd0db360d9 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:44.052730 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-1e0ca9dc-01cc-441c-a299-0efd0db360d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:44.058997 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-fd3f9712-098b-4fab-930b-d438b4384977 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00cdf1f8143d41db909975d35933e8f0', 'request_id': 'req-fd3f9712-098b-4fab-930b-d438b4384977'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:44.067231 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-fd3f9712-098b-4fab-930b-d438b4384977 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00cdf1f8143d41db909975d35933e8f0', 'request_id': 'req-fd3f9712-098b-4fab-930b-d438b4384977'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:44.069536 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0ca9dc-01cc-441c-a299-0efd0db360d9 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:44.076944 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-fd3f9712-098b-4fab-930b-d438b4384977 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00cdf1f8143d41db909975d35933e8f0', 'request_id': 'req-fd3f9712-098b-4fab-930b-d438b4384977'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:44.093860 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-fd3f9712-098b-4fab-930b-d438b4384977 admin admin] The token cache is being invalidate because project 00cdf1f8143d41db909975d35933e8f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:01:44.094203 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-fd3f9712-098b-4fab-930b-d438b4384977 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:44.095211 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-fd3f9712-098b-4fab-930b-d438b4384977 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:44.097065 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 828/1609] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Oct 14 13:01:43 2022] DELETE /identity/v3/projects/00cdf1f8143d41db909975d35933e8f0 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:01:44.097682 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3f9712-098b-4fab-930b-d438b4384977 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:44.099658 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-fd3f9712-098b-4fab-930b-d438b4384977 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:44.148785 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:01:44.166486 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13d268b-a544-48f8-868c-b378781f421f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:44.167416 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13d268b-a544-48f8-868c-b378781f421f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:44.167705 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13d268b-a544-48f8-868c-b378781f421f admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:44.168006 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13d268b-a544-48f8-868c-b378781f421f admin admin] PATH_INFO: `/v3/users/02dbf20801f54e33a49a8d9cafe35066` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:44.170023 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13d268b-a544-48f8-868c-b378781f421f admin admin] RBAC: Authorizing `identity:delete_user(user_id=02dbf20801f54e33a49a8d9cafe35066)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:44.173664 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13d268b-a544-48f8-868c-b378781f421f admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:44.182488 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3f9712-098b-4fab-930b-d438b4384977 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:44.188194 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3b6714-2a55-47df-84a7-5ad8f3be1a4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:44.188807 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3b6714-2a55-47df-84a7-5ad8f3be1a4d admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:44.189180 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3b6714-2a55-47df-84a7-5ad8f3be1a4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:44.189395 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3b6714-2a55-47df-84a7-5ad8f3be1a4d admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:44.190092 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3b6714-2a55-47df-84a7-5ad8f3be1a4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:44.191820 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3b6714-2a55-47df-84a7-5ad8f3be1a4d admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:44.202841 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 829/1610] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:01:44 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:01:44.204189 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a59cd7-1959-4310-960e-9acdc7208816 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:44.204484 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a59cd7-1959-4310-960e-9acdc7208816 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:44.204791 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a59cd7-1959-4310-960e-9acdc7208816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:44.226644 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-c3a59cd7-1959-4310-960e-9acdc7208816 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:01:44.227878 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-c3a59cd7-1959-4310-960e-9acdc7208816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:44.236920 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 830/1611] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:01:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:01:44.239037 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a59cd7-1959-4310-960e-9acdc7208816 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:44.245931 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-e13d268b-a544-48f8-868c-b378781f421f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02dbf20801f54e33a49a8d9cafe35066'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:44.252121 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a59cd7-1959-4310-960e-9acdc7208816 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:44.258478 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5d283a-57c0-4ee5-8507-282aade975a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:44.258749 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5d283a-57c0-4ee5-8507-282aade975a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:44.259313 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5d283a-57c0-4ee5-8507-282aade975a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:44.259825 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5d283a-57c0-4ee5-8507-282aade975a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:44.260501 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5d283a-57c0-4ee5-8507-282aade975a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:44.262491 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5d283a-57c0-4ee5-8507-282aade975a8 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:44.272235 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-e13d268b-a544-48f8-868c-b378781f421f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02dbf20801f54e33a49a8d9cafe35066'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:44.273005 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-e13d268b-a544-48f8-868c-b378781f421f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02dbf20801f54e33a49a8d9cafe35066'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:44.275149 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 831/1612] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:01:44 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:01:44.280212 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325c854d-64b8-44d8-b44e-80e9931d542e None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:44.280504 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325c854d-64b8-44d8-b44e-80e9931d542e None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:44.280844 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325c854d-64b8-44d8-b44e-80e9931d542e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:44.283905 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-e13d268b-a544-48f8-868c-b378781f421f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02dbf20801f54e33a49a8d9cafe35066'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:44.299037 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-e13d268b-a544-48f8-868c-b378781f421f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02dbf20801f54e33a49a8d9cafe35066'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:44.304411 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-325c854d-64b8-44d8-b44e-80e9931d542e None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:01:44.308691 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 782/1613] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Oct 14 13:01:44 2022] DELETE /identity/v3/users/02dbf20801f54e33a49a8d9cafe35066 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:01:44.308834 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-325c854d-64b8-44d8-b44e-80e9931d542e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:44.308943 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13d268b-a544-48f8-868c-b378781f421f admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:44.308943 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-e13d268b-a544-48f8-868c-b378781f421f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:44.336271 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:01:44.412108 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13d268b-a544-48f8-868c-b378781f421f admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:44.418003 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ddcb31-6ef8-4908-98f1-1b7f4e486b9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:44.418765 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ddcb31-6ef8-4908-98f1-1b7f4e486b9e admin admin] REQUEST_METHOD: `PUT` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:44.419330 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ddcb31-6ef8-4908-98f1-1b7f4e486b9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:44.419771 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ddcb31-6ef8-4908-98f1-1b7f4e486b9e admin admin] PATH_INFO: `/v3/projects/8a23c3534048472abccfb2a42cc80ab4/users/fde2f1d345f84f85b892dcb73c1c6f0d/roles/5e8849303a75425b9eaa2681cc031af1` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:44.429435 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 832/1614] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:01:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:01:44.433370 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325c854d-64b8-44d8-b44e-80e9931d542e None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:44.440180 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ddcb31-6ef8-4908-98f1-1b7f4e486b9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a23c3534048472abccfb2a42cc80ab4, user_id=fde2f1d345f84f85b892dcb73c1c6f0d, role_id=5e8849303a75425b9eaa2681cc031af1)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:44.443000 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ddcb31-6ef8-4908-98f1-1b7f4e486b9e admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:44.443253 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325c854d-64b8-44d8-b44e-80e9931d542e None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:44.448597 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78645ce6-a052-4df8-a3ab-d18c96291650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:44.449320 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78645ce6-a052-4df8-a3ab-d18c96291650 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:44.449589 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78645ce6-a052-4df8-a3ab-d18c96291650 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:44.449906 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78645ce6-a052-4df8-a3ab-d18c96291650 admin admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:44.451262 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78645ce6-a052-4df8-a3ab-d18c96291650 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 13:01:44.451581 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78645ce6-a052-4df8-a3ab-d18c96291650 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:44.453324 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78645ce6-a052-4df8-a3ab-d18c96291650 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:44.461875 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 783/1615] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Oct 14 13:01:44 2022] PUT /identity/v3/projects/8a23c3534048472abccfb2a42cc80ab4/users/fde2f1d345f84f85b892dcb73c1c6f0d/roles/5e8849303a75425b9eaa2681cc031af1 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:01:44.470744 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 833/1616] 10.222.0.17 () {58 vars in 1153 bytes} [Fri Oct 14 13:01:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 13:01:44.472627 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b80b473-1549-4889-9bf6-42c8672b91c9 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:44.472996 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b80b473-1549-4889-9bf6-42c8672b91c9 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:44.473350 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b80b473-1549-4889-9bf6-42c8672b91c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:44.475287 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78645ce6-a052-4df8-a3ab-d18c96291650 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:44.487746 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78645ce6-a052-4df8-a3ab-d18c96291650 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:44.508375 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-9b80b473-1549-4889-9bf6-42c8672b91c9 None None] MFA Rules not processed for user `fde2f1d345f84f85b892dcb73c1c6f0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:01:44.509745 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-9b80b473-1549-4889-9bf6-42c8672b91c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:44.560988 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3f3b06-edb8-4ae7-8099-817957010d01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:44.561796 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3f3b06-edb8-4ae7-8099-817957010d01 admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:44.562252 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3f3b06-edb8-4ae7-8099-817957010d01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:44.563166 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3f3b06-edb8-4ae7-8099-817957010d01 admin admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:44.564104 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3f3b06-edb8-4ae7-8099-817957010d01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:44.566764 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3f3b06-edb8-4ae7-8099-817957010d01 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:44.571048 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:01:44.601885 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 784/1617] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:01:44 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:01:44.605125 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 834/1618] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Oct 14 13:01:44 2022] POST /identity/v3/projects => generated 379 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 13:01:44.609763 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b80b473-1549-4889-9bf6-42c8672b91c9 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:44.611300 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3f3b06-edb8-4ae7-8099-817957010d01 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:44.618843 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b80b473-1549-4889-9bf6-42c8672b91c9 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:44.687905 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fa01a2-a5ea-4fd5-9084-b173f485a74a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:44.689889 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fa01a2-a5ea-4fd5-9084-b173f485a74a admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:44.689889 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fa01a2-a5ea-4fd5-9084-b173f485a74a admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:44.689889 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fa01a2-a5ea-4fd5-9084-b173f485a74a admin admin] PATH_INFO: `/v3/projects` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:44.690191 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fa01a2-a5ea-4fd5-9084-b173f485a74a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:44.692202 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fa01a2-a5ea-4fd5-9084-b173f485a74a admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:44.697833 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3f3b06-edb8-4ae7-8099-817957010d01 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:44.703164 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06471a1f-034f-4446-852c-4551526ae0d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:44.703623 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06471a1f-034f-4446-852c-4551526ae0d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:44.703903 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06471a1f-034f-4446-852c-4551526ae0d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:44.704191 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06471a1f-034f-4446-852c-4551526ae0d0 admin admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:44.704829 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06471a1f-034f-4446-852c-4551526ae0d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:44.706856 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06471a1f-034f-4446-852c-4551526ae0d0 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:44.723038 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 785/1619] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Oct 14 13:01:44 2022] POST /identity/v3/projects => generated 383 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 13:01:44.723978 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fa01a2-a5ea-4fd5-9084-b173f485a74a admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:44.725874 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-f5fa01a2-a5ea-4fd5-9084-b173f485a74a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:44.735016 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 835/1620] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Oct 14 13:01:44 2022] POST /identity/v3/users => generated 290 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:01:44.736171 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06471a1f-034f-4446-852c-4551526ae0d0 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:44.747279 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06471a1f-034f-4446-852c-4551526ae0d0 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:44.757648 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:01:44.798968 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fa01a2-a5ea-4fd5-9084-b173f485a74a admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:44.804449 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbcc49f-eb62-4f72-9fb9-87171e790eae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:44.805229 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbcc49f-eb62-4f72-9fb9-87171e790eae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:44.805610 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbcc49f-eb62-4f72-9fb9-87171e790eae admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:44.805889 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbcc49f-eb62-4f72-9fb9-87171e790eae admin admin] PATH_INFO: `/v3/projects/cac8dd603ffe469685952db4cb618827` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:44.807218 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbcc49f-eb62-4f72-9fb9-87171e790eae admin admin] RBAC: Authorizing `identity:delete_project(project_id=cac8dd603ffe469685952db4cb618827)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:44.809070 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbcc49f-eb62-4f72-9fb9-87171e790eae admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:44.826412 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303463f1-0c30-4e07-9d6c-8bd307245c8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:44.826520 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303463f1-0c30-4e07-9d6c-8bd307245c8d admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:44.826744 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303463f1-0c30-4e07-9d6c-8bd307245c8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:44.827241 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303463f1-0c30-4e07-9d6c-8bd307245c8d admin admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:44.827885 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303463f1-0c30-4e07-9d6c-8bd307245c8d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:44.830257 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303463f1-0c30-4e07-9d6c-8bd307245c8d admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:44.873794 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-5cbcc49f-eb62-4f72-9fb9-87171e790eae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cac8dd603ffe469685952db4cb618827', 'request_id': 'req-5cbcc49f-eb62-4f72-9fb9-87171e790eae'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:44.876531 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 836/1621] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Oct 14 13:01:44 2022] POST /identity/v3/users => generated 298 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:01:44.877439 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303463f1-0c30-4e07-9d6c-8bd307245c8d admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:44.881443 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-5cbcc49f-eb62-4f72-9fb9-87171e790eae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cac8dd603ffe469685952db4cb618827', 'request_id': 'req-5cbcc49f-eb62-4f72-9fb9-87171e790eae'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:44.887860 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303463f1-0c30-4e07-9d6c-8bd307245c8d admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:44.888759 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-5cbcc49f-eb62-4f72-9fb9-87171e790eae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cac8dd603ffe469685952db4cb618827', 'request_id': 'req-5cbcc49f-eb62-4f72-9fb9-87171e790eae'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:44.907539 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-5cbcc49f-eb62-4f72-9fb9-87171e790eae admin admin] The token cache is being invalidate because project cac8dd603ffe469685952db4cb618827 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:01:44.907835 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-5cbcc49f-eb62-4f72-9fb9-87171e790eae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:44.908540 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-5cbcc49f-eb62-4f72-9fb9-87171e790eae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:44.910059 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 786/1622] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Oct 14 13:01:44 2022] DELETE /identity/v3/projects/cac8dd603ffe469685952db4cb618827 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:01:44.914249 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbcc49f-eb62-4f72-9fb9-87171e790eae admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:44.916002 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-5cbcc49f-eb62-4f72-9fb9-87171e790eae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:44.921127 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:01:44.955158 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051e047f-8961-4b88-834a-1dd2f9aa762a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:44.955784 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051e047f-8961-4b88-834a-1dd2f9aa762a admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:44.956065 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051e047f-8961-4b88-834a-1dd2f9aa762a admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:44.956339 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051e047f-8961-4b88-834a-1dd2f9aa762a admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:44.956995 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051e047f-8961-4b88-834a-1dd2f9aa762a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:44.958680 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051e047f-8961-4b88-834a-1dd2f9aa762a admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:44.973033 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 837/1623] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:01:44 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:01:44.973033 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f150b643-29cf-4b20-a0e4-67693f43e1ae None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:44.973033 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f150b643-29cf-4b20-a0e4-67693f43e1ae None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:44.973033 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f150b643-29cf-4b20-a0e4-67693f43e1ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:44.994784 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-f150b643-29cf-4b20-a0e4-67693f43e1ae None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:01:44.996162 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-f150b643-29cf-4b20-a0e4-67693f43e1ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:45.000561 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbcc49f-eb62-4f72-9fb9-87171e790eae admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:45.005026 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 838/1624] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:01:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:01:45.005250 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80759ab-5dcb-44f4-9fc0-cf4f6fc59061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:45.005807 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f150b643-29cf-4b20-a0e4-67693f43e1ae None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:45.005907 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80759ab-5dcb-44f4-9fc0-cf4f6fc59061 admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:45.006217 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80759ab-5dcb-44f4-9fc0-cf4f6fc59061 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:45.006573 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80759ab-5dcb-44f4-9fc0-cf4f6fc59061 admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:45.007100 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-f150b643-29cf-4b20-a0e4-67693f43e1ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:45.007263 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80759ab-5dcb-44f4-9fc0-cf4f6fc59061 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:45.008839 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80759ab-5dcb-44f4-9fc0-cf4f6fc59061 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:45.019503 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f150b643-29cf-4b20-a0e4-67693f43e1ae None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:45.020886 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 787/1625] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:01:44 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:01:45.021932 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f691264d-79bc-413d-b350-b07ab264e036 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:45.022250 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f691264d-79bc-413d-b350-b07ab264e036 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:45.022532 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f691264d-79bc-413d-b350-b07ab264e036 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:45.026915 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293a2f56-912c-4fa4-b706-a90e9205ec0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:45.027532 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293a2f56-912c-4fa4-b706-a90e9205ec0c admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:45.027809 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293a2f56-912c-4fa4-b706-a90e9205ec0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:45.028079 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293a2f56-912c-4fa4-b706-a90e9205ec0c admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:45.028745 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293a2f56-912c-4fa4-b706-a90e9205ec0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:45.030370 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293a2f56-912c-4fa4-b706-a90e9205ec0c admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:45.044250 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 839/1626] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:01:45 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:01:45.045341 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293a2f56-912c-4fa4-b706-a90e9205ec0c admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:45.046341 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-f691264d-79bc-413d-b350-b07ab264e036 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:01:45.047840 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-f691264d-79bc-413d-b350-b07ab264e036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:45.056961 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293a2f56-912c-4fa4-b706-a90e9205ec0c admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:45.057063 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 788/1627] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:01:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:01:45.057832 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f691264d-79bc-413d-b350-b07ab264e036 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:45.068938 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f181f6-b037-4d54-b59f-b698c13f4f38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:45.069159 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f691264d-79bc-413d-b350-b07ab264e036 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:45.069623 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f181f6-b037-4d54-b59f-b698c13f4f38 admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:45.069907 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f181f6-b037-4d54-b59f-b698c13f4f38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:45.070300 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f181f6-b037-4d54-b59f-b698c13f4f38 admin admin] PATH_INFO: `/v3/projects/3d2e01e6f9464eb99cf5c083962272c8/users/b4258d3af6204e8eb9793295348b3997/roles/7f6e29e390bc41f7a9af17659a2e95d1` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:45.076128 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff747a4-e105-4ab4-9dc7-b3187b7da0d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:45.076989 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff747a4-e105-4ab4-9dc7-b3187b7da0d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:45.077309 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff747a4-e105-4ab4-9dc7-b3187b7da0d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:45.077649 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff747a4-e105-4ab4-9dc7-b3187b7da0d8 admin admin] PATH_INFO: `/v3/projects/84d13241455a4e53949413289f428e10/users/3430dac2c2b94d21a7657c94356016c6/roles/5e8849303a75425b9eaa2681cc031af1` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:45.102307 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f181f6-b037-4d54-b59f-b698c13f4f38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d2e01e6f9464eb99cf5c083962272c8, user_id=b4258d3af6204e8eb9793295348b3997, role_id=7f6e29e390bc41f7a9af17659a2e95d1)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:45.105286 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff747a4-e105-4ab4-9dc7-b3187b7da0d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84d13241455a4e53949413289f428e10, user_id=3430dac2c2b94d21a7657c94356016c6, role_id=5e8849303a75425b9eaa2681cc031af1)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:45.105772 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f181f6-b037-4d54-b59f-b698c13f4f38 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:45.108131 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff747a4-e105-4ab4-9dc7-b3187b7da0d8 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:45.123767 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 840/1628] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Oct 14 13:01:45 2022] PUT /identity/v3/projects/3d2e01e6f9464eb99cf5c083962272c8/users/b4258d3af6204e8eb9793295348b3997/roles/7f6e29e390bc41f7a9af17659a2e95d1 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:01:45.123767 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f181f6-b037-4d54-b59f-b698c13f4f38 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:45.128416 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 789/1629] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Oct 14 13:01:45 2022] PUT /identity/v3/projects/84d13241455a4e53949413289f428e10/users/3430dac2c2b94d21a7657c94356016c6/roles/5e8849303a75425b9eaa2681cc031af1 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:01:45.129261 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff747a4-e105-4ab4-9dc7-b3187b7da0d8 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:45.196963 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:01:45.201093 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f181f6-b037-4d54-b59f-b698c13f4f38 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:45.207726 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff747a4-e105-4ab4-9dc7-b3187b7da0d8 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:45.208280 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efe8e1a-8a06-4fd0-bfdb-e32d3b3b2a70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:45.208903 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efe8e1a-8a06-4fd0-bfdb-e32d3b3b2a70 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:45.209188 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efe8e1a-8a06-4fd0-bfdb-e32d3b3b2a70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:45.209464 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efe8e1a-8a06-4fd0-bfdb-e32d3b3b2a70 admin admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:45.210209 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efe8e1a-8a06-4fd0-bfdb-e32d3b3b2a70 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 13:01:45.210567 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efe8e1a-8a06-4fd0-bfdb-e32d3b3b2a70 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:45.212194 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efe8e1a-8a06-4fd0-bfdb-e32d3b3b2a70 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:45.213037 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c97485c-e5ec-43f9-b051-61a04d039446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:45.213708 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c97485c-e5ec-43f9-b051-61a04d039446 admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:45.214058 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c97485c-e5ec-43f9-b051-61a04d039446 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:45.214423 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c97485c-e5ec-43f9-b051-61a04d039446 admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:45.215134 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c97485c-e5ec-43f9-b051-61a04d039446 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:45.217682 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c97485c-e5ec-43f9-b051-61a04d039446 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:45.234432 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 841/1630] 10.222.0.17 () {58 vars in 1153 bytes} [Fri Oct 14 13:01:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 13:01:45.234628 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 790/1631] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:01:45 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:01:45.234721 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15354aba-1759-49ea-9f27-5941f44655bf None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:45.234721 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15354aba-1759-49ea-9f27-5941f44655bf None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:45.234899 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c97485c-e5ec-43f9-b051-61a04d039446 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:45.234986 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15354aba-1759-49ea-9f27-5941f44655bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:45.236382 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-1c97485c-e5ec-43f9-b051-61a04d039446 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:45.251280 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c97485c-e5ec-43f9-b051-61a04d039446 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:45.258765 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95979506-6d13-4b90-a4e5-867d599904a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:45.259518 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95979506-6d13-4b90-a4e5-867d599904a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:45.259902 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95979506-6d13-4b90-a4e5-867d599904a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:45.260299 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95979506-6d13-4b90-a4e5-867d599904a3 admin admin] PATH_INFO: `/v3/users/1a7f1358d8364a1f84c70e9174c4c9d3` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:45.261619 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95979506-6d13-4b90-a4e5-867d599904a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a7f1358d8364a1f84c70e9174c4c9d3)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:45.263956 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95979506-6d13-4b90-a4e5-867d599904a3 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:45.265035 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-15354aba-1759-49ea-9f27-5941f44655bf None None] MFA Rules not processed for user `3430dac2c2b94d21a7657c94356016c6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:01:45.266293 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-15354aba-1759-49ea-9f27-5941f44655bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:45.313332 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-95979506-6d13-4b90-a4e5-867d599904a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a7f1358d8364a1f84c70e9174c4c9d3'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:45.320317 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-95979506-6d13-4b90-a4e5-867d599904a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a7f1358d8364a1f84c70e9174c4c9d3'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:45.320978 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-95979506-6d13-4b90-a4e5-867d599904a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a7f1358d8364a1f84c70e9174c4c9d3'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:45.323477 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:01:45.329353 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-95979506-6d13-4b90-a4e5-867d599904a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a7f1358d8364a1f84c70e9174c4c9d3'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:45.334517 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 842/1632] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:01:45 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:01:45.338285 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15354aba-1759-49ea-9f27-5941f44655bf None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:45.344032 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-95979506-6d13-4b90-a4e5-867d599904a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a7f1358d8364a1f84c70e9174c4c9d3'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:45.345582 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15354aba-1759-49ea-9f27-5941f44655bf None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:45.350472 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cd568d-6129-4ee9-8a52-d3de8914713c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:45.350817 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 791/1633] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Oct 14 13:01:45 2022] DELETE /identity/v3/users/1a7f1358d8364a1f84c70e9174c4c9d3 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:01:45.351124 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cd568d-6129-4ee9-8a52-d3de8914713c admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:45.351586 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95979506-6d13-4b90-a4e5-867d599904a3 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:45.351774 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cd568d-6129-4ee9-8a52-d3de8914713c admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:45.352114 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cd568d-6129-4ee9-8a52-d3de8914713c admin admin] PATH_INFO: `/v3/projects/3d2e01e6f9464eb99cf5c083962272c8/users/b4258d3af6204e8eb9793295348b3997/roles/7f6e29e390bc41f7a9af17659a2e95d1` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:45.353033 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-95979506-6d13-4b90-a4e5-867d599904a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:45.353999 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cd568d-6129-4ee9-8a52-d3de8914713c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d2e01e6f9464eb99cf5c083962272c8, user_id=b4258d3af6204e8eb9793295348b3997, role_id=7f6e29e390bc41f7a9af17659a2e95d1)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:45.357542 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cd568d-6129-4ee9-8a52-d3de8914713c admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:45.368901 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 843/1634] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Oct 14 13:01:45 2022] PUT /identity/v3/projects/3d2e01e6f9464eb99cf5c083962272c8/users/b4258d3af6204e8eb9793295348b3997/roles/7f6e29e390bc41f7a9af17659a2e95d1 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:01:45.379659 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cd568d-6129-4ee9-8a52-d3de8914713c admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:45.379659 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-37cd568d-6129-4ee9-8a52-d3de8914713c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:45.424345 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95979506-6d13-4b90-a4e5-867d599904a3 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:45.439062 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cd568d-6129-4ee9-8a52-d3de8914713c admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:45.443936 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6d33e6-afb4-467d-811d-c4d8dc252b76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:45.444622 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6d33e6-afb4-467d-811d-c4d8dc252b76 admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:45.444975 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6d33e6-afb4-467d-811d-c4d8dc252b76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:45.445382 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6d33e6-afb4-467d-811d-c4d8dc252b76 admin admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:45.446037 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6d33e6-afb4-467d-811d-c4d8dc252b76 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:45.448039 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6d33e6-afb4-467d-811d-c4d8dc252b76 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:45.484566 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 844/1635] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Oct 14 13:01:45 2022] POST /identity/v3/projects => generated 377 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:01:45.484566 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fee6f2-b79e-49ed-b854-fab48e8a0505 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:45.484566 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fee6f2-b79e-49ed-b854-fab48e8a0505 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:45.484566 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fee6f2-b79e-49ed-b854-fab48e8a0505 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:45.492948 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e774c2b8-f647-428f-a35b-f0b659b149f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:45.493571 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e774c2b8-f647-428f-a35b-f0b659b149f5 admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:45.493851 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e774c2b8-f647-428f-a35b-f0b659b149f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:45.494154 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e774c2b8-f647-428f-a35b-f0b659b149f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:45.494788 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e774c2b8-f647-428f-a35b-f0b659b149f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:45.497862 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e774c2b8-f647-428f-a35b-f0b659b149f5 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:45.504172 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-20fee6f2-b79e-49ed-b854-fab48e8a0505 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:01:45.505398 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-20fee6f2-b79e-49ed-b854-fab48e8a0505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:45.533340 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 792/1636] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Oct 14 13:01:45 2022] POST /identity/v3/projects => generated 387 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:01:45.534729 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95184d1f-0e2d-4369-aa00-307b453a64bf None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:45.535014 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95184d1f-0e2d-4369-aa00-307b453a64bf None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:45.535286 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95184d1f-0e2d-4369-aa00-307b453a64bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:45.562864 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:01:45.566992 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-95184d1f-0e2d-4369-aa00-307b453a64bf None None] MFA Rules not processed for user `b4258d3af6204e8eb9793295348b3997`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:01:45.568332 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-95184d1f-0e2d-4369-aa00-307b453a64bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:45.590281 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 845/1637] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:01:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:01:45.590281 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fee6f2-b79e-49ed-b854-fab48e8a0505 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:45.600519 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fee6f2-b79e-49ed-b854-fab48e8a0505 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:45.631910 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:DELETE=3,keystone:SELECT=96,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:01:45.648206 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 793/1638] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:01:45 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:01:45.649107 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95184d1f-0e2d-4369-aa00-307b453a64bf None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:45.660817 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acd7554-eced-40fd-adb8-4fb1a90cd530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:45.661597 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acd7554-eced-40fd-adb8-4fb1a90cd530 admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:45.661807 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acd7554-eced-40fd-adb8-4fb1a90cd530 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:45.662156 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acd7554-eced-40fd-adb8-4fb1a90cd530 admin admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:45.662996 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acd7554-eced-40fd-adb8-4fb1a90cd530 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:45.664664 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acd7554-eced-40fd-adb8-4fb1a90cd530 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:45.688324 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 846/1639] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Oct 14 13:01:45 2022] POST /identity/v3/users => generated 295 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:01:45.692127 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acd7554-eced-40fd-adb8-4fb1a90cd530 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:45.693725 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-3acd7554-eced-40fd-adb8-4fb1a90cd530 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:45.717737 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95184d1f-0e2d-4369-aa00-307b453a64bf None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:45.722540 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28923eff-4ce6-4cc7-8ab1-fc2daae2ee76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:45.723149 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28923eff-4ce6-4cc7-8ab1-fc2daae2ee76 admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:45.723431 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28923eff-4ce6-4cc7-8ab1-fc2daae2ee76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:45.723706 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28923eff-4ce6-4cc7-8ab1-fc2daae2ee76 admin admin] PATH_INFO: `/v3/users` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:45.724605 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28923eff-4ce6-4cc7-8ab1-fc2daae2ee76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:45.726619 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28923eff-4ce6-4cc7-8ab1-fc2daae2ee76 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:45.750569 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 794/1640] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Oct 14 13:01:45 2022] POST /identity/v3/users => generated 294 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:01:45.751463 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28923eff-4ce6-4cc7-8ab1-fc2daae2ee76 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:45.753055 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-28923eff-4ce6-4cc7-8ab1-fc2daae2ee76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:45.755482 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acd7554-eced-40fd-adb8-4fb1a90cd530 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:45.759122 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6be4013-5fad-42b6-bed8-920c01467848 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d483292f3a4794848fcacfba5b107e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:45.759730 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6be4013-5fad-42b6-bed8-920c01467848 service neutron] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:45.760030 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6be4013-5fad-42b6-bed8-920c01467848 service neutron] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:45.760300 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6be4013-5fad-42b6-bed8-920c01467848 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:45.770047 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6be4013-5fad-42b6-bed8-920c01467848 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:45.771510 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6be4013-5fad-42b6-bed8-920c01467848 service neutron] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:45.781467 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 847/1641] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:01:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:01:45.782296 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6be4013-5fad-42b6-bed8-920c01467848 service neutron] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:45.791677 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6be4013-5fad-42b6-bed8-920c01467848 service neutron] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:45.797074 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b099afd-3774-4b12-ba41-60b2397ff91c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:45.797675 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b099afd-3774-4b12-ba41-60b2397ff91c admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:45.797951 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b099afd-3774-4b12-ba41-60b2397ff91c admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:45.798247 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b099afd-3774-4b12-ba41-60b2397ff91c admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:45.798882 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b099afd-3774-4b12-ba41-60b2397ff91c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:45.800781 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b099afd-3774-4b12-ba41-60b2397ff91c admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:45.811447 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 848/1642] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:01:45 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:01:45.815380 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b099afd-3774-4b12-ba41-60b2397ff91c admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:45.819600 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28923eff-4ce6-4cc7-8ab1-fc2daae2ee76 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:45.825338 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b099afd-3774-4b12-ba41-60b2397ff91c admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:45.826262 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dc9d56-7a1a-4c45-8f8a-fdc93d0a738c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c3c564b8c548e4beef1cbfba2ad343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:45.827506 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dc9d56-7a1a-4c45-8f8a-fdc93d0a738c service cinder] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:45.828005 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dc9d56-7a1a-4c45-8f8a-fdc93d0a738c service cinder] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:45.828290 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dc9d56-7a1a-4c45-8f8a-fdc93d0a738c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:45.830328 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b02d3b-7503-40e0-a152-f265451e2184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:45.830939 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b02d3b-7503-40e0-a152-f265451e2184 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:45.831418 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b02d3b-7503-40e0-a152-f265451e2184 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:45.831734 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b02d3b-7503-40e0-a152-f265451e2184 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:45.832517 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b02d3b-7503-40e0-a152-f265451e2184 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:45.834263 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b02d3b-7503-40e0-a152-f265451e2184 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:45.845150 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dc9d56-7a1a-4c45-8f8a-fdc93d0a738c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:45.846669 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dc9d56-7a1a-4c45-8f8a-fdc93d0a738c service cinder] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:45.850471 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 849/1643] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:01:45 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:01:45.851504 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b02d3b-7503-40e0-a152-f265451e2184 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:45.864081 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b02d3b-7503-40e0-a152-f265451e2184 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:45.870247 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4004711f-bbdc-4bad-a898-32f101f8a2cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:45.871052 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4004711f-bbdc-4bad-a898-32f101f8a2cc admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:45.871436 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4004711f-bbdc-4bad-a898-32f101f8a2cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:45.871813 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4004711f-bbdc-4bad-a898-32f101f8a2cc admin admin] PATH_INFO: `/v3/projects/2a7f7d969063485992be17b65c7b3b0b/users/a3a8a5f6f2e34c4abf577f2506c46688/roles/7f6e29e390bc41f7a9af17659a2e95d1` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:45.878936 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 795/1644] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:01:45 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:01:45.882110 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dc9d56-7a1a-4c45-8f8a-fdc93d0a738c service cinder] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:45.892150 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4004711f-bbdc-4bad-a898-32f101f8a2cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a7f7d969063485992be17b65c7b3b0b, user_id=a3a8a5f6f2e34c4abf577f2506c46688, role_id=7f6e29e390bc41f7a9af17659a2e95d1)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:45.895229 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4004711f-bbdc-4bad-a898-32f101f8a2cc admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:45.914114 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dc9d56-7a1a-4c45-8f8a-fdc93d0a738c service cinder] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:45.917985 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 850/1645] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Oct 14 13:01:45 2022] PUT /identity/v3/projects/2a7f7d969063485992be17b65c7b3b0b/users/a3a8a5f6f2e34c4abf577f2506c46688/roles/7f6e29e390bc41f7a9af17659a2e95d1 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:01:45.919724 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4004711f-bbdc-4bad-a898-32f101f8a2cc admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:45.973436 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:01:46.014862 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4004711f-bbdc-4bad-a898-32f101f8a2cc admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:46.025871 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8b90c0-58e3-4e87-ab4c-6002130ef937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:46.025871 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8b90c0-58e3-4e87-ab4c-6002130ef937 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:46.025871 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8b90c0-58e3-4e87-ab4c-6002130ef937 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:46.025871 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8b90c0-58e3-4e87-ab4c-6002130ef937 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:46.026219 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8b90c0-58e3-4e87-ab4c-6002130ef937 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:46.026219 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8b90c0-58e3-4e87-ab4c-6002130ef937 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:46.045540 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 851/1646] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:01:45 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:01:46.047352 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8b90c0-58e3-4e87-ab4c-6002130ef937 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:46.066048 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8b90c0-58e3-4e87-ab4c-6002130ef937 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:46.092186 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ed1a0c-e5d5-46fb-bd1a-9fdf4b1bcb6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:46.092647 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ed1a0c-e5d5-46fb-bd1a-9fdf4b1bcb6e admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:46.093046 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ed1a0c-e5d5-46fb-bd1a-9fdf4b1bcb6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:46.093510 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ed1a0c-e5d5-46fb-bd1a-9fdf4b1bcb6e admin admin] PATH_INFO: `/v3/projects/2a7f7d969063485992be17b65c7b3b0b/users/a3a8a5f6f2e34c4abf577f2506c46688/roles/7f6e29e390bc41f7a9af17659a2e95d1` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:46.103005 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ed1a0c-e5d5-46fb-bd1a-9fdf4b1bcb6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a7f7d969063485992be17b65c7b3b0b, user_id=a3a8a5f6f2e34c4abf577f2506c46688, role_id=7f6e29e390bc41f7a9af17659a2e95d1)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:46.106104 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ed1a0c-e5d5-46fb-bd1a-9fdf4b1bcb6e admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:46.123406 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067472a0-7732-4e31-a61f-94557c2f7db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:46.123771 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067472a0-7732-4e31-a61f-94557c2f7db4 admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:46.124655 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067472a0-7732-4e31-a61f-94557c2f7db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:46.124937 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067472a0-7732-4e31-a61f-94557c2f7db4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:46.125596 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067472a0-7732-4e31-a61f-94557c2f7db4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:46.129082 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067472a0-7732-4e31-a61f-94557c2f7db4 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:46.137226 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 852/1647] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Oct 14 13:01:46 2022] PUT /identity/v3/projects/2a7f7d969063485992be17b65c7b3b0b/users/a3a8a5f6f2e34c4abf577f2506c46688/roles/7f6e29e390bc41f7a9af17659a2e95d1 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:01:46.142664 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ed1a0c-e5d5-46fb-bd1a-9fdf4b1bcb6e admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:46.154811 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 796/1648] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:01:45 2022] GET /identity/v3/roles => generated 1420 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:01:46.159697 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33279e4e-e74b-479f-8956-aff9039f5097 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:46.159978 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33279e4e-e74b-479f-8956-aff9039f5097 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:46.160253 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33279e4e-e74b-479f-8956-aff9039f5097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:46.196715 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-33279e4e-e74b-479f-8956-aff9039f5097 None None] MFA Rules not processed for user `a3a8a5f6f2e34c4abf577f2506c46688`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:01:46.197965 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-33279e4e-e74b-479f-8956-aff9039f5097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:46.212226 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:01:46.245337 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ed1a0c-e5d5-46fb-bd1a-9fdf4b1bcb6e admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:46.257304 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd563ad7-1db6-4e56-bbbc-9b9ff75b728f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c3c564b8c548e4beef1cbfba2ad343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:46.257512 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd563ad7-1db6-4e56-bbbc-9b9ff75b728f service cinder] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:46.257796 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd563ad7-1db6-4e56-bbbc-9b9ff75b728f service cinder] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:46.258079 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd563ad7-1db6-4e56-bbbc-9b9ff75b728f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:46.263967 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-cd563ad7-1db6-4e56-bbbc-9b9ff75b728f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:46.370346 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 797/1649] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:01:46 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:01:46.371562 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33279e4e-e74b-479f-8956-aff9039f5097 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:46.379553 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd563ad7-1db6-4e56-bbbc-9b9ff75b728f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:46.381120 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd563ad7-1db6-4e56-bbbc-9b9ff75b728f service cinder] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:46.392921 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 853/1650] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:01:46 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:01:46.393877 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd563ad7-1db6-4e56-bbbc-9b9ff75b728f service cinder] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:46.395726 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-cd563ad7-1db6-4e56-bbbc-9b9ff75b728f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:46.467760 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33279e4e-e74b-479f-8956-aff9039f5097 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:46.500649 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721643a1-2a8b-44c8-b603-4e1362db4641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:46.501435 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721643a1-2a8b-44c8-b603-4e1362db4641 admin admin] REQUEST_METHOD: `PUT` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:46.501759 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721643a1-2a8b-44c8-b603-4e1362db4641 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:46.502081 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721643a1-2a8b-44c8-b603-4e1362db4641 admin admin] PATH_INFO: `/v3/projects/1dc665d05152444b962d5de34e8148a2/users/8fbc0d331576460ebbdcdeb1ccb60e47/roles/5e8849303a75425b9eaa2681cc031af1` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:46.504970 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd563ad7-1db6-4e56-bbbc-9b9ff75b728f service cinder] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:46.510917 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f2ed91-988d-4da3-9da9-4617a22cb5c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:46.511984 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f2ed91-988d-4da3-9da9-4617a22cb5c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:46.512728 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f2ed91-988d-4da3-9da9-4617a22cb5c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:46.513747 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f2ed91-988d-4da3-9da9-4617a22cb5c2 admin admin] PATH_INFO: `/v3/projects/6f8699c1474745ed8f644eb76e96a541` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:46.515586 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f2ed91-988d-4da3-9da9-4617a22cb5c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f8699c1474745ed8f644eb76e96a541)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:46.518335 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f2ed91-988d-4da3-9da9-4617a22cb5c2 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:46.549117 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721643a1-2a8b-44c8-b603-4e1362db4641 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1dc665d05152444b962d5de34e8148a2, user_id=8fbc0d331576460ebbdcdeb1ccb60e47, role_id=5e8849303a75425b9eaa2681cc031af1)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:46.551868 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721643a1-2a8b-44c8-b603-4e1362db4641 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:46.583474 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 798/1651] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Oct 14 13:01:46 2022] PUT /identity/v3/projects/1dc665d05152444b962d5de34e8148a2/users/8fbc0d331576460ebbdcdeb1ccb60e47/roles/5e8849303a75425b9eaa2681cc031af1 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:01:46.584346 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721643a1-2a8b-44c8-b603-4e1362db4641 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:46.589655 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-721643a1-2a8b-44c8-b603-4e1362db4641 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:46.599369 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:01:46.683440 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-82f2ed91-988d-4da3-9da9-4617a22cb5c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f8699c1474745ed8f644eb76e96a541', 'request_id': 'req-82f2ed91-988d-4da3-9da9-4617a22cb5c2'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:46.699848 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-82f2ed91-988d-4da3-9da9-4617a22cb5c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f8699c1474745ed8f644eb76e96a541', 'request_id': 'req-82f2ed91-988d-4da3-9da9-4617a22cb5c2'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:46.717751 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-82f2ed91-988d-4da3-9da9-4617a22cb5c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f8699c1474745ed8f644eb76e96a541', 'request_id': 'req-82f2ed91-988d-4da3-9da9-4617a22cb5c2'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:46.760340 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-82f2ed91-988d-4da3-9da9-4617a22cb5c2 admin admin] The token cache is being invalidate because project 6f8699c1474745ed8f644eb76e96a541 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:01:46.760647 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-82f2ed91-988d-4da3-9da9-4617a22cb5c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:46.761734 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-82f2ed91-988d-4da3-9da9-4617a22cb5c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:46.767555 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 854/1652] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Oct 14 13:01:46 2022] DELETE /identity/v3/projects/6f8699c1474745ed8f644eb76e96a541 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:01:46.771210 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c24ca2-19d1-4d56-ab24-d006636de22a None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:46.771210 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c24ca2-19d1-4d56-ab24-d006636de22a None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:46.771210 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c24ca2-19d1-4d56-ab24-d006636de22a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:46.772060 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721643a1-2a8b-44c8-b603-4e1362db4641 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:46.838779 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-c5c24ca2-19d1-4d56-ab24-d006636de22a None None] MFA Rules not processed for user `8fbc0d331576460ebbdcdeb1ccb60e47`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:01:46.840143 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-c5c24ca2-19d1-4d56-ab24-d006636de22a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:46.860770 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:01:46.869989 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b96128c-7150-4dbf-abe0-daf252ea3742 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c3c564b8c548e4beef1cbfba2ad343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:46.870855 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b96128c-7150-4dbf-abe0-daf252ea3742 service cinder] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:46.871065 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b96128c-7150-4dbf-abe0-daf252ea3742 service cinder] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:46.871849 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b96128c-7150-4dbf-abe0-daf252ea3742 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:46.875183 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-9b96128c-7150-4dbf-abe0-daf252ea3742 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:46.961563 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 855/1653] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:01:46 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:01:46.962792 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b642e6bd-46ae-472d-9436-12d0fdaeeff6 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:46.963151 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b642e6bd-46ae-472d-9436-12d0fdaeeff6 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:46.963583 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b642e6bd-46ae-472d-9436-12d0fdaeeff6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:46.965408 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b96128c-7150-4dbf-abe0-daf252ea3742 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:46.967643 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b96128c-7150-4dbf-abe0-daf252ea3742 service cinder] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:46.983202 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 799/1654] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:01:46 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:01:46.984332 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b96128c-7150-4dbf-abe0-daf252ea3742 service cinder] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:46.985882 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-9b96128c-7150-4dbf-abe0-daf252ea3742 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:47.003933 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-b642e6bd-46ae-472d-9436-12d0fdaeeff6 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:01:47.005163 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-b642e6bd-46ae-472d-9436-12d0fdaeeff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:47.089747 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b96128c-7150-4dbf-abe0-daf252ea3742 service cinder] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:47.101570 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0607c66e-20cd-4bc0-baba-f21c86e5680a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:47.103069 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0607c66e-20cd-4bc0-baba-f21c86e5680a admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:47.105591 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0607c66e-20cd-4bc0-baba-f21c86e5680a admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:47.105591 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0607c66e-20cd-4bc0-baba-f21c86e5680a admin admin] PATH_INFO: `/v3/projects` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:47.108179 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0607c66e-20cd-4bc0-baba-f21c86e5680a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:47.114466 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0607c66e-20cd-4bc0-baba-f21c86e5680a admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:47.140474 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 856/1655] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:01:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:01:47.141615 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b642e6bd-46ae-472d-9436-12d0fdaeeff6 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:47.143686 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-b642e6bd-46ae-472d-9436-12d0fdaeeff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:47.166785 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b642e6bd-46ae-472d-9436-12d0fdaeeff6 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:47.183268 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce3be5c-8c23-4602-97cc-61e91e6b16ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:47.183926 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce3be5c-8c23-4602-97cc-61e91e6b16ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:47.184205 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce3be5c-8c23-4602-97cc-61e91e6b16ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:47.184501 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce3be5c-8c23-4602-97cc-61e91e6b16ac admin admin] PATH_INFO: `/v3/users/fde2f1d345f84f85b892dcb73c1c6f0d` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:47.188088 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 800/1656] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Oct 14 13:01:46 2022] POST /identity/v3/projects => generated 385 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:01:47.190592 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce3be5c-8c23-4602-97cc-61e91e6b16ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=fde2f1d345f84f85b892dcb73c1c6f0d)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:47.191228 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1663e65-dd27-41ce-817f-f5015f81493b None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:47.193521 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1663e65-dd27-41ce-817f-f5015f81493b None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:47.193829 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1663e65-dd27-41ce-817f-f5015f81493b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:47.199596 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce3be5c-8c23-4602-97cc-61e91e6b16ac admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:47.228913 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-e1663e65-dd27-41ce-817f-f5015f81493b None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:01:47.230195 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-e1663e65-dd27-41ce-817f-f5015f81493b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:47.281533 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:01:47.307082 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-9ce3be5c-8c23-4602-97cc-61e91e6b16ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fde2f1d345f84f85b892dcb73c1c6f0d'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:47.322865 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-9ce3be5c-8c23-4602-97cc-61e91e6b16ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fde2f1d345f84f85b892dcb73c1c6f0d'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:47.323694 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-9ce3be5c-8c23-4602-97cc-61e91e6b16ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fde2f1d345f84f85b892dcb73c1c6f0d'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:47.348809 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-9ce3be5c-8c23-4602-97cc-61e91e6b16ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fde2f1d345f84f85b892dcb73c1c6f0d'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:47.357156 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 801/1657] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:01:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:01:47.357156 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1663e65-dd27-41ce-817f-f5015f81493b None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:47.357156 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-e1663e65-dd27-41ce-817f-f5015f81493b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:47.371296 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1663e65-dd27-41ce-817f-f5015f81493b None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:47.371800 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-9ce3be5c-8c23-4602-97cc-61e91e6b16ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fde2f1d345f84f85b892dcb73c1c6f0d'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:47.377222 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed58284-9e81-4093-95b0-79708f314c1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:47.378669 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed58284-9e81-4093-95b0-79708f314c1c admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:47.378967 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed58284-9e81-4093-95b0-79708f314c1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:47.379366 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed58284-9e81-4093-95b0-79708f314c1c admin admin] PATH_INFO: `/v3/users` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:47.380022 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed58284-9e81-4093-95b0-79708f314c1c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:47.381050 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 857/1658] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Oct 14 13:01:47 2022] DELETE /identity/v3/users/fde2f1d345f84f85b892dcb73c1c6f0d => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:01:47.381987 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed58284-9e81-4093-95b0-79708f314c1c admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:47.382094 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce3be5c-8c23-4602-97cc-61e91e6b16ac admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:47.413804 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 802/1659] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Oct 14 13:01:47 2022] POST /identity/v3/users => generated 293 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:01:47.415382 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a7adcd-4282-4ac4-a2cd-ff093e7014e6 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:47.416791 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a7adcd-4282-4ac4-a2cd-ff093e7014e6 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:47.416976 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a7adcd-4282-4ac4-a2cd-ff093e7014e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:47.440351 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-68a7adcd-4282-4ac4-a2cd-ff093e7014e6 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:01:47.441792 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-68a7adcd-4282-4ac4-a2cd-ff093e7014e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:47.460924 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:01:47.516019 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce3be5c-8c23-4602-97cc-61e91e6b16ac admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:47.530206 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19cdb76-e6fe-45d1-89a7-114ed8ff94bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:47.534344 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19cdb76-e6fe-45d1-89a7-114ed8ff94bb admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:47.534754 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19cdb76-e6fe-45d1-89a7-114ed8ff94bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:47.535103 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19cdb76-e6fe-45d1-89a7-114ed8ff94bb admin admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:47.535937 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19cdb76-e6fe-45d1-89a7-114ed8ff94bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 13:01:47.536251 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19cdb76-e6fe-45d1-89a7-114ed8ff94bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:47.537890 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19cdb76-e6fe-45d1-89a7-114ed8ff94bb admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:47.566608 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 858/1660] 10.222.0.17 () {58 vars in 1153 bytes} [Fri Oct 14 13:01:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 13:01:47.567584 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19cdb76-e6fe-45d1-89a7-114ed8ff94bb admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:47.585034 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19cdb76-e6fe-45d1-89a7-114ed8ff94bb admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:47.592975 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb555a3-cee6-4ad3-b083-896fdf8a4b34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:47.593908 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb555a3-cee6-4ad3-b083-896fdf8a4b34 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:47.594432 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb555a3-cee6-4ad3-b083-896fdf8a4b34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:47.595247 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb555a3-cee6-4ad3-b083-896fdf8a4b34 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:47.596116 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb555a3-cee6-4ad3-b083-896fdf8a4b34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:47.598621 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb555a3-cee6-4ad3-b083-896fdf8a4b34 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:47.611877 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 803/1661] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:01:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:01:47.612750 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a7adcd-4282-4ac4-a2cd-ff093e7014e6 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:47.616723 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 859/1662] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:01:47 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:01:47.622727 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb555a3-cee6-4ad3-b083-896fdf8a4b34 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:47.626025 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a7adcd-4282-4ac4-a2cd-ff093e7014e6 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:47.631364 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a40a5b-f189-42e0-8d03-9f6e3c61a0ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:47.631939 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a40a5b-f189-42e0-8d03-9f6e3c61a0ff admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:47.632228 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a40a5b-f189-42e0-8d03-9f6e3c61a0ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:47.632508 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a40a5b-f189-42e0-8d03-9f6e3c61a0ff admin admin] PATH_INFO: `/v3/projects` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:47.633233 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a40a5b-f189-42e0-8d03-9f6e3c61a0ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:47.635280 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a40a5b-f189-42e0-8d03-9f6e3c61a0ff admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:47.643567 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb555a3-cee6-4ad3-b083-896fdf8a4b34 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:47.669560 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affff7a5-fa32-4e32-8b40-3c8df08fc7ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:47.670280 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affff7a5-fa32-4e32-8b40-3c8df08fc7ac admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:47.670559 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affff7a5-fa32-4e32-8b40-3c8df08fc7ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:47.670828 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affff7a5-fa32-4e32-8b40-3c8df08fc7ac admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:47.671469 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affff7a5-fa32-4e32-8b40-3c8df08fc7ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:47.673795 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affff7a5-fa32-4e32-8b40-3c8df08fc7ac admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:47.676340 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 804/1663] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Oct 14 13:01:47 2022] POST /identity/v3/projects => generated 365 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:01:47.677519 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a40a5b-f189-42e0-8d03-9f6e3c61a0ff admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:47.682472 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-82a40a5b-f189-42e0-8d03-9f6e3c61a0ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:47.692088 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 860/1664] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:01:47 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:01:47.693659 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affff7a5-fa32-4e32-8b40-3c8df08fc7ac admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:47.705112 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affff7a5-fa32-4e32-8b40-3c8df08fc7ac admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:47.748137 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a40a5b-f189-42e0-8d03-9f6e3c61a0ff admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:47.751766 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5beb26-722c-4b99-83ef-dd7a75495715 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d483292f3a4794848fcacfba5b107e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:47.752371 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5beb26-722c-4b99-83ef-dd7a75495715 service neutron] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:47.752656 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5beb26-722c-4b99-83ef-dd7a75495715 service neutron] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:47.752917 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5beb26-722c-4b99-83ef-dd7a75495715 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:47.781277 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6274568-22f7-4253-8300-9ff99477ae25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:47.781894 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6274568-22f7-4253-8300-9ff99477ae25 admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:47.782196 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6274568-22f7-4253-8300-9ff99477ae25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:47.782479 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6274568-22f7-4253-8300-9ff99477ae25 admin admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:47.783109 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6274568-22f7-4253-8300-9ff99477ae25 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:47.785011 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6274568-22f7-4253-8300-9ff99477ae25 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:47.807949 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 861/1665] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Oct 14 13:01:47 2022] POST /identity/v3/users => generated 283 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:01:47.808605 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6274568-22f7-4253-8300-9ff99477ae25 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:47.821295 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6274568-22f7-4253-8300-9ff99477ae25 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:47.825287 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5beb26-722c-4b99-83ef-dd7a75495715 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:47.826586 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186b3ea4-4e89-401a-8a96-969f0875268f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:47.827021 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5beb26-722c-4b99-83ef-dd7a75495715 service neutron] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:47.838341 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 805/1666] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:01:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:01:47.839074 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186b3ea4-4e89-401a-8a96-969f0875268f admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:47.839372 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186b3ea4-4e89-401a-8a96-969f0875268f admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:47.839474 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5beb26-722c-4b99-83ef-dd7a75495715 service neutron] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:47.839647 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186b3ea4-4e89-401a-8a96-969f0875268f admin admin] PATH_INFO: `/v3/projects/955eafdb1fdc482983d7058c9e06df01/users/be7a733aea914024b64bb67390855f6a/roles/5e8849303a75425b9eaa2681cc031af1` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:47.851150 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5beb26-722c-4b99-83ef-dd7a75495715 service neutron] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:47.854552 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:01:47.857808 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513b431b-0391-4e55-9708-cef7e0dea5ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:47.858621 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513b431b-0391-4e55-9708-cef7e0dea5ad admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:47.859006 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513b431b-0391-4e55-9708-cef7e0dea5ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:47.859382 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513b431b-0391-4e55-9708-cef7e0dea5ad admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:47.860132 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513b431b-0391-4e55-9708-cef7e0dea5ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:47.861846 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513b431b-0391-4e55-9708-cef7e0dea5ad admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:47.864427 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186b3ea4-4e89-401a-8a96-969f0875268f admin admin] RBAC: Authorizing `identity:create_grant(project_id=955eafdb1fdc482983d7058c9e06df01, user_id=be7a733aea914024b64bb67390855f6a, role_id=5e8849303a75425b9eaa2681cc031af1)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:47.869396 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186b3ea4-4e89-401a-8a96-969f0875268f admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:47.878474 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 806/1667] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:01:47 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:01:47.879881 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513b431b-0391-4e55-9708-cef7e0dea5ad admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:47.896157 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 862/1668] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Oct 14 13:01:47 2022] PUT /identity/v3/projects/955eafdb1fdc482983d7058c9e06df01/users/be7a733aea914024b64bb67390855f6a/roles/5e8849303a75425b9eaa2681cc031af1 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:01:47.897136 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513b431b-0391-4e55-9708-cef7e0dea5ad admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:47.906849 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ac0f07-5266-482d-82a5-0801ac8f9cf4 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:47.907928 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ac0f07-5266-482d-82a5-0801ac8f9cf4 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:47.909420 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ac0f07-5266-482d-82a5-0801ac8f9cf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:47.934770 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:01:47.946565 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-d5ac0f07-5266-482d-82a5-0801ac8f9cf4 None None] MFA Rules not processed for user `be7a733aea914024b64bb67390855f6a`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:01:47.948787 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-d5ac0f07-5266-482d-82a5-0801ac8f9cf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:47.995201 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9db5863-4cde-4f32-b301-a010e0bc886d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:47.996226 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9db5863-4cde-4f32-b301-a010e0bc886d admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:47.996651 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9db5863-4cde-4f32-b301-a010e0bc886d admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:47.998974 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9db5863-4cde-4f32-b301-a010e0bc886d admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:48.000956 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9db5863-4cde-4f32-b301-a010e0bc886d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:48.002978 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9db5863-4cde-4f32-b301-a010e0bc886d admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:48.020313 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 807/1669] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:01:47 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:01:48.025121 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9db5863-4cde-4f32-b301-a010e0bc886d admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:48.041613 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9db5863-4cde-4f32-b301-a010e0bc886d admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:48.047836 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934b2ae9-9479-43ee-8a3f-bb940979e518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:48.048883 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934b2ae9-9479-43ee-8a3f-bb940979e518 admin admin] REQUEST_METHOD: `PUT` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:48.049594 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934b2ae9-9479-43ee-8a3f-bb940979e518 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:48.050253 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934b2ae9-9479-43ee-8a3f-bb940979e518 admin admin] PATH_INFO: `/v3/projects/760159925b284562ac48c0a6bb6de822/users/385c82cfb14f40c0b307ca5da21a74ff/roles/5e8849303a75425b9eaa2681cc031af1` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:48.069719 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934b2ae9-9479-43ee-8a3f-bb940979e518 admin admin] RBAC: Authorizing `identity:create_grant(project_id=760159925b284562ac48c0a6bb6de822, user_id=385c82cfb14f40c0b307ca5da21a74ff, role_id=5e8849303a75425b9eaa2681cc031af1)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:48.073702 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934b2ae9-9479-43ee-8a3f-bb940979e518 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:48.080175 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 863/1670] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:01:47 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:01:48.085201 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ac0f07-5266-482d-82a5-0801ac8f9cf4 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:48.104497 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ac0f07-5266-482d-82a5-0801ac8f9cf4 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:48.107242 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 808/1671] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Oct 14 13:01:48 2022] PUT /identity/v3/projects/760159925b284562ac48c0a6bb6de822/users/385c82cfb14f40c0b307ca5da21a74ff/roles/5e8849303a75425b9eaa2681cc031af1 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 13:01:48.124002 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76866be4-8f4e-4d02-badf-2869c9299443 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:48.124506 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76866be4-8f4e-4d02-badf-2869c9299443 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:48.125590 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76866be4-8f4e-4d02-badf-2869c9299443 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:48.163187 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-76866be4-8f4e-4d02-badf-2869c9299443 None None] MFA Rules not processed for user `385c82cfb14f40c0b307ca5da21a74ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:01:48.165307 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-76866be4-8f4e-4d02-badf-2869c9299443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:48.192247 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbccb6d-eb73-4b20-82a6-bb74e23df00b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:48.193283 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbccb6d-eb73-4b20-82a6-bb74e23df00b admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:48.193816 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbccb6d-eb73-4b20-82a6-bb74e23df00b admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:48.194356 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbccb6d-eb73-4b20-82a6-bb74e23df00b admin admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:48.195268 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbccb6d-eb73-4b20-82a6-bb74e23df00b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:48.197475 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbccb6d-eb73-4b20-82a6-bb74e23df00b admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:48.247501 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 864/1672] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Oct 14 13:01:48 2022] POST /identity/v3/projects => generated 385 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:01:48.251943 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbccb6d-eb73-4b20-82a6-bb74e23df00b admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:48.288934 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 809/1673] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:01:48 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:01:48.298005 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76866be4-8f4e-4d02-badf-2869c9299443 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:48.303982 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-76866be4-8f4e-4d02-badf-2869c9299443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:48.352088 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbccb6d-eb73-4b20-82a6-bb74e23df00b admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:48.359593 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5006d5d7-2000-49a8-aeba-d32e3d758c75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:48.360344 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5006d5d7-2000-49a8-aeba-d32e3d758c75 admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:48.360687 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5006d5d7-2000-49a8-aeba-d32e3d758c75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:48.361130 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5006d5d7-2000-49a8-aeba-d32e3d758c75 admin admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:48.361881 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5006d5d7-2000-49a8-aeba-d32e3d758c75 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:48.364151 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5006d5d7-2000-49a8-aeba-d32e3d758c75 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:48.378829 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:01:48.397145 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 865/1674] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Oct 14 13:01:48 2022] POST /identity/v3/users => generated 299 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:01:48.399107 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5006d5d7-2000-49a8-aeba-d32e3d758c75 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:48.401111 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-5006d5d7-2000-49a8-aeba-d32e3d758c75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:48.417809 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76866be4-8f4e-4d02-badf-2869c9299443 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:48.420535 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5006d5d7-2000-49a8-aeba-d32e3d758c75 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:48.425776 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df26daec-e1bd-4ca7-8122-fffc28d4f3c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:48.426587 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df26daec-e1bd-4ca7-8122-fffc28d4f3c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:48.426946 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df26daec-e1bd-4ca7-8122-fffc28d4f3c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:48.427130 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df26daec-e1bd-4ca7-8122-fffc28d4f3c7 admin admin] PATH_INFO: `/v3/projects/8a23c3534048472abccfb2a42cc80ab4` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:48.428381 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df26daec-e1bd-4ca7-8122-fffc28d4f3c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a23c3534048472abccfb2a42cc80ab4)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:48.430528 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df26daec-e1bd-4ca7-8122-fffc28d4f3c7 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:48.480572 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:01:48.488199 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-df26daec-e1bd-4ca7-8122-fffc28d4f3c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a23c3534048472abccfb2a42cc80ab4', 'request_id': 'req-df26daec-e1bd-4ca7-8122-fffc28d4f3c7'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:48.491621 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca423796-6f0e-47f2-8141-978081726bf8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c3c564b8c548e4beef1cbfba2ad343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:48.493342 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca423796-6f0e-47f2-8141-978081726bf8 service cinder] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:48.493659 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca423796-6f0e-47f2-8141-978081726bf8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:48.493942 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca423796-6f0e-47f2-8141-978081726bf8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:48.494410 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-df26daec-e1bd-4ca7-8122-fffc28d4f3c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a23c3534048472abccfb2a42cc80ab4', 'request_id': 'req-df26daec-e1bd-4ca7-8122-fffc28d4f3c7'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:48.502390 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-df26daec-e1bd-4ca7-8122-fffc28d4f3c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a23c3534048472abccfb2a42cc80ab4', 'request_id': 'req-df26daec-e1bd-4ca7-8122-fffc28d4f3c7'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:48.516845 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-df26daec-e1bd-4ca7-8122-fffc28d4f3c7 admin admin] The token cache is being invalidate because project 8a23c3534048472abccfb2a42cc80ab4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:01:48.517161 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-df26daec-e1bd-4ca7-8122-fffc28d4f3c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:48.517813 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-df26daec-e1bd-4ca7-8122-fffc28d4f3c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:48.519402 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 866/1675] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Oct 14 13:01:48 2022] DELETE /identity/v3/projects/8a23c3534048472abccfb2a42cc80ab4 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:01:48.520221 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df26daec-e1bd-4ca7-8122-fffc28d4f3c7 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:48.521936 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-df26daec-e1bd-4ca7-8122-fffc28d4f3c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:48.566613 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca423796-6f0e-47f2-8141-978081726bf8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:48.568488 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca423796-6f0e-47f2-8141-978081726bf8 service cinder] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:48.579720 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 810/1676] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:01:48 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:01:48.580425 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca423796-6f0e-47f2-8141-978081726bf8 service cinder] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:48.592841 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca423796-6f0e-47f2-8141-978081726bf8 service cinder] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:48.643497 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df26daec-e1bd-4ca7-8122-fffc28d4f3c7 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:48.649807 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de795e61-8f4d-4a08-b698-b83cbfa9052e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:48.650585 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de795e61-8f4d-4a08-b698-b83cbfa9052e admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:48.650871 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de795e61-8f4d-4a08-b698-b83cbfa9052e admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:48.651146 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de795e61-8f4d-4a08-b698-b83cbfa9052e admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:48.651803 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de795e61-8f4d-4a08-b698-b83cbfa9052e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:48.653956 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de795e61-8f4d-4a08-b698-b83cbfa9052e admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:48.668020 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 867/1677] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:01:48 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:01:48.668020 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de795e61-8f4d-4a08-b698-b83cbfa9052e admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:48.668020 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-de795e61-8f4d-4a08-b698-b83cbfa9052e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:48.675641 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72dc1c7-871f-4ee3-bde4-88533d08acb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:48.676554 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72dc1c7-871f-4ee3-bde4-88533d08acb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:48.676889 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72dc1c7-871f-4ee3-bde4-88533d08acb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:48.677235 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72dc1c7-871f-4ee3-bde4-88533d08acb1 admin admin] PATH_INFO: `/v3/users/b4258d3af6204e8eb9793295348b3997` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:48.678613 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72dc1c7-871f-4ee3-bde4-88533d08acb1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4258d3af6204e8eb9793295348b3997)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:48.680710 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72dc1c7-871f-4ee3-bde4-88533d08acb1 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:48.756980 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de795e61-8f4d-4a08-b698-b83cbfa9052e admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:48.760734 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-f72dc1c7-871f-4ee3-bde4-88533d08acb1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4258d3af6204e8eb9793295348b3997'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:48.762074 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bbecaf-c51e-4085-a2a9-9677ae357aad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c3c564b8c548e4beef1cbfba2ad343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:48.762943 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bbecaf-c51e-4085-a2a9-9677ae357aad service cinder] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:48.763662 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bbecaf-c51e-4085-a2a9-9677ae357aad service cinder] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:48.763944 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bbecaf-c51e-4085-a2a9-9677ae357aad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:48.766586 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-16bbecaf-c51e-4085-a2a9-9677ae357aad service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:48.786663 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-f72dc1c7-871f-4ee3-bde4-88533d08acb1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4258d3af6204e8eb9793295348b3997'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:48.788029 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-f72dc1c7-871f-4ee3-bde4-88533d08acb1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4258d3af6204e8eb9793295348b3997'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:48.804894 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-f72dc1c7-871f-4ee3-bde4-88533d08acb1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4258d3af6204e8eb9793295348b3997'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:48.808154 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:INSERT=3,keystone:SELECT=90,keystone:DELETE=7 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:01:48.828170 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-f72dc1c7-871f-4ee3-bde4-88533d08acb1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4258d3af6204e8eb9793295348b3997'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:48.841255 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 811/1678] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Oct 14 13:01:48 2022] DELETE /identity/v3/users/b4258d3af6204e8eb9793295348b3997 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:01:48.842219 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72dc1c7-871f-4ee3-bde4-88533d08acb1 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:48.846451 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-f72dc1c7-871f-4ee3-bde4-88533d08acb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:48.877876 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bbecaf-c51e-4085-a2a9-9677ae357aad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:48.879411 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bbecaf-c51e-4085-a2a9-9677ae357aad service cinder] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:48.888635 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:01:48.894105 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 868/1679] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:01:48 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:01:49.002589 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72dc1c7-871f-4ee3-bde4-88533d08acb1 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:49.014337 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf0810b-41f4-4996-bcd3-702661f3516f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:49.015092 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf0810b-41f4-4996-bcd3-702661f3516f admin admin] REQUEST_METHOD: `PUT` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:49.017314 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf0810b-41f4-4996-bcd3-702661f3516f admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:49.017962 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf0810b-41f4-4996-bcd3-702661f3516f admin admin] PATH_INFO: `/v3/projects/9841c9e66bce4b028cfe7f06b67f3381/users/37df367446b54457858a93db6a5981c2/roles/7f6e29e390bc41f7a9af17659a2e95d1` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:49.061119 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf0810b-41f4-4996-bcd3-702661f3516f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9841c9e66bce4b028cfe7f06b67f3381, user_id=37df367446b54457858a93db6a5981c2, role_id=7f6e29e390bc41f7a9af17659a2e95d1)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:49.068114 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf0810b-41f4-4996-bcd3-702661f3516f admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:49.119235 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 812/1680] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Oct 14 13:01:48 2022] PUT /identity/v3/projects/9841c9e66bce4b028cfe7f06b67f3381/users/37df367446b54457858a93db6a5981c2/roles/7f6e29e390bc41f7a9af17659a2e95d1 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:01:49.124581 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bbecaf-c51e-4085-a2a9-9677ae357aad service cinder] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:49.141073 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bbecaf-c51e-4085-a2a9-9677ae357aad service cinder] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:49.237630 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cefa58-f872-4b50-9e35-e4cbd7c902a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:49.238493 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cefa58-f872-4b50-9e35-e4cbd7c902a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:49.238883 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cefa58-f872-4b50-9e35-e4cbd7c902a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:49.239463 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cefa58-f872-4b50-9e35-e4cbd7c902a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:49.240215 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cefa58-f872-4b50-9e35-e4cbd7c902a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:49.242171 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cefa58-f872-4b50-9e35-e4cbd7c902a1 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:49.258605 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 869/1681] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:01:49 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:01:49.260089 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf0810b-41f4-4996-bcd3-702661f3516f admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:49.272018 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf0810b-41f4-4996-bcd3-702661f3516f admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:49.279033 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0f7b72-1759-4dd5-884e-041259027af2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:49.279769 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0f7b72-1759-4dd5-884e-041259027af2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:49.280184 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0f7b72-1759-4dd5-884e-041259027af2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:49.280575 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0f7b72-1759-4dd5-884e-041259027af2 admin admin] PATH_INFO: `/v3/projects/9841c9e66bce4b028cfe7f06b67f3381/users/37df367446b54457858a93db6a5981c2/roles/7f6e29e390bc41f7a9af17659a2e95d1` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:49.284998 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0f7b72-1759-4dd5-884e-041259027af2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9841c9e66bce4b028cfe7f06b67f3381, user_id=37df367446b54457858a93db6a5981c2, role_id=7f6e29e390bc41f7a9af17659a2e95d1)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:49.288085 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0f7b72-1759-4dd5-884e-041259027af2 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:49.300985 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 813/1682] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Oct 14 13:01:49 2022] PUT /identity/v3/projects/9841c9e66bce4b028cfe7f06b67f3381/users/37df367446b54457858a93db6a5981c2/roles/7f6e29e390bc41f7a9af17659a2e95d1 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 13:01:49.312539 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc216328-f9ac-442b-9abe-faa91f4302ea None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:49.312825 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc216328-f9ac-442b-9abe-faa91f4302ea None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:49.313099 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc216328-f9ac-442b-9abe-faa91f4302ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:49.341929 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-cc216328-f9ac-442b-9abe-faa91f4302ea None None] MFA Rules not processed for user `37df367446b54457858a93db6a5981c2`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:01:49.343350 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-cc216328-f9ac-442b-9abe-faa91f4302ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:49.374728 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0f7b72-1759-4dd5-884e-041259027af2 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:49.376606 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-ca0f7b72-1759-4dd5-884e-041259027af2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:49.427416 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 870/1683] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:01:49 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:01:49.438162 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc216328-f9ac-442b-9abe-faa91f4302ea None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:49.439518 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-cc216328-f9ac-442b-9abe-faa91f4302ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:49.447996 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0f7b72-1759-4dd5-884e-041259027af2 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:49.453116 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e131462-8167-4578-81ca-41da0f69835e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:49.453749 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e131462-8167-4578-81ca-41da0f69835e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:49.454027 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e131462-8167-4578-81ca-41da0f69835e admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:49.454333 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e131462-8167-4578-81ca-41da0f69835e admin admin] PATH_INFO: `/v3/projects/3d2e01e6f9464eb99cf5c083962272c8` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:49.455455 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e131462-8167-4578-81ca-41da0f69835e admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d2e01e6f9464eb99cf5c083962272c8)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:49.457362 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e131462-8167-4578-81ca-41da0f69835e admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:49.486240 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:01:49.499021 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc216328-f9ac-442b-9abe-faa91f4302ea None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:49.507513 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-5e131462-8167-4578-81ca-41da0f69835e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d2e01e6f9464eb99cf5c083962272c8', 'request_id': 'req-5e131462-8167-4578-81ca-41da0f69835e'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:49.513887 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-5e131462-8167-4578-81ca-41da0f69835e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d2e01e6f9464eb99cf5c083962272c8', 'request_id': 'req-5e131462-8167-4578-81ca-41da0f69835e'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:49.520302 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-5e131462-8167-4578-81ca-41da0f69835e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d2e01e6f9464eb99cf5c083962272c8', 'request_id': 'req-5e131462-8167-4578-81ca-41da0f69835e'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:49.534533 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-5e131462-8167-4578-81ca-41da0f69835e admin admin] The token cache is being invalidate because project 3d2e01e6f9464eb99cf5c083962272c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:01:49.534814 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-5e131462-8167-4578-81ca-41da0f69835e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:49.535543 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-5e131462-8167-4578-81ca-41da0f69835e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:49.537053 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 814/1684] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Oct 14 13:01:49 2022] DELETE /identity/v3/projects/3d2e01e6f9464eb99cf5c083962272c8 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 13:01:49.542218 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45b40d1-8933-4969-8263-b81012c317b7 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:49.542637 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45b40d1-8933-4969-8263-b81012c317b7 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:49.542816 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45b40d1-8933-4969-8263-b81012c317b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:49.551675 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8661b46b-b975-45be-a529-fd3e4628242b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c3c564b8c548e4beef1cbfba2ad343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:49.552284 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8661b46b-b975-45be-a529-fd3e4628242b service cinder] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:49.552564 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8661b46b-b975-45be-a529-fd3e4628242b service cinder] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:49.552833 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8661b46b-b975-45be-a529-fd3e4628242b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:49.554601 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-8661b46b-b975-45be-a529-fd3e4628242b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:49.564089 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-f45b40d1-8933-4969-8263-b81012c317b7 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:01:49.565279 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-f45b40d1-8933-4969-8263-b81012c317b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:49.579209 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:01:49.626587 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8661b46b-b975-45be-a529-fd3e4628242b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:49.628095 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8661b46b-b975-45be-a529-fd3e4628242b service cinder] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:49.633127 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 815/1685] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:01:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 13:01:49.641947 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 871/1686] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:01:49 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 14 13:01:49.645087 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace11a2e-0c38-4e7a-9cab-e8f19b301127 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:49.645087 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace11a2e-0c38-4e7a-9cab-e8f19b301127 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:49.645087 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace11a2e-0c38-4e7a-9cab-e8f19b301127 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:49.674421 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-ace11a2e-0c38-4e7a-9cab-e8f19b301127 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:01:49.675934 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-ace11a2e-0c38-4e7a-9cab-e8f19b301127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:49.686054 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 816/1687] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:01:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:01:49.690376 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8661b46b-b975-45be-a529-fd3e4628242b service cinder] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:49.703095 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8661b46b-b975-45be-a529-fd3e4628242b service cinder] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:49.710100 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fcc9a5-781f-4081-bb60-e821f1e90afc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:49.711394 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fcc9a5-781f-4081-bb60-e821f1e90afc admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:49.711394 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fcc9a5-781f-4081-bb60-e821f1e90afc admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:49.711394 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fcc9a5-781f-4081-bb60-e821f1e90afc admin admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:49.711955 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fcc9a5-781f-4081-bb60-e821f1e90afc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 13:01:49.712263 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fcc9a5-781f-4081-bb60-e821f1e90afc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:49.718159 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fcc9a5-781f-4081-bb60-e821f1e90afc admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:49.733688 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 872/1688] 10.222.0.17 () {58 vars in 1153 bytes} [Fri Oct 14 13:01:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 13:01:49.737795 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace11a2e-0c38-4e7a-9cab-e8f19b301127 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:49.749063 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace11a2e-0c38-4e7a-9cab-e8f19b301127 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:49.754069 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adfecc6-ab28-4b60-b26c-988a1aa7eaf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:49.754721 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adfecc6-ab28-4b60-b26c-988a1aa7eaf0 admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:49.755004 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adfecc6-ab28-4b60-b26c-988a1aa7eaf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:49.755279 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adfecc6-ab28-4b60-b26c-988a1aa7eaf0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:49.755921 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adfecc6-ab28-4b60-b26c-988a1aa7eaf0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:49.758112 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adfecc6-ab28-4b60-b26c-988a1aa7eaf0 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:49.802381 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 817/1689] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Oct 14 13:01:49 2022] POST /identity/v3/projects => generated 375 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:01:49.806342 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fcc9a5-781f-4081-bb60-e821f1e90afc admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:49.817694 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fcc9a5-781f-4081-bb60-e821f1e90afc admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:49.879289 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e245b3-c9ef-4986-ade2-7e14afe0d8fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:49.879907 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e245b3-c9ef-4986-ade2-7e14afe0d8fc admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:49.880191 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e245b3-c9ef-4986-ade2-7e14afe0d8fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:49.880468 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e245b3-c9ef-4986-ade2-7e14afe0d8fc admin admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:49.881118 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e245b3-c9ef-4986-ade2-7e14afe0d8fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:49.883230 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e245b3-c9ef-4986-ade2-7e14afe0d8fc admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:49.905962 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 873/1690] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Oct 14 13:01:49 2022] POST /identity/v3/users => generated 288 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 13:01:49.910193 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adfecc6-ab28-4b60-b26c-988a1aa7eaf0 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:49.921032 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adfecc6-ab28-4b60-b26c-988a1aa7eaf0 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:49.925754 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349d799f-6a50-45da-a35b-001ebf5f8678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:49.926466 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349d799f-6a50-45da-a35b-001ebf5f8678 admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:49.926753 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349d799f-6a50-45da-a35b-001ebf5f8678 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:49.927024 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349d799f-6a50-45da-a35b-001ebf5f8678 admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:49.927668 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349d799f-6a50-45da-a35b-001ebf5f8678 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:49.929260 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349d799f-6a50-45da-a35b-001ebf5f8678 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:49.939684 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 818/1691] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:01:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:01:49.944758 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e245b3-c9ef-4986-ade2-7e14afe0d8fc admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:49.958741 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e245b3-c9ef-4986-ade2-7e14afe0d8fc admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:49.965490 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eab386-b883-4e48-ac88-007fedbd3536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:49.966335 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eab386-b883-4e48-ac88-007fedbd3536 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:49.966621 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eab386-b883-4e48-ac88-007fedbd3536 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:49.967081 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eab386-b883-4e48-ac88-007fedbd3536 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:49.967742 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4eab386-b883-4e48-ac88-007fedbd3536 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:49.969770 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4eab386-b883-4e48-ac88-007fedbd3536 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:49.986194 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 874/1692] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:01:49 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 14 13:01:49.990505 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349d799f-6a50-45da-a35b-001ebf5f8678 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:50.010593 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349d799f-6a50-45da-a35b-001ebf5f8678 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:50.016703 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fbe5f4-7baf-44ac-8776-4299d01bf832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:50.017529 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fbe5f4-7baf-44ac-8776-4299d01bf832 admin admin] REQUEST_METHOD: `PUT` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:50.018067 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fbe5f4-7baf-44ac-8776-4299d01bf832 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:50.018469 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fbe5f4-7baf-44ac-8776-4299d01bf832 admin admin] PATH_INFO: `/v3/projects/b8c87f5bebf54161b9193c449b486c51/users/18f06fc13ba34a03a0ba265ca0c04d8f/roles/5e8849303a75425b9eaa2681cc031af1` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:50.036008 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fbe5f4-7baf-44ac-8776-4299d01bf832 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8c87f5bebf54161b9193c449b486c51, user_id=18f06fc13ba34a03a0ba265ca0c04d8f, role_id=5e8849303a75425b9eaa2681cc031af1)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:50.038871 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fbe5f4-7baf-44ac-8776-4299d01bf832 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:50.070561 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 819/1693] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Oct 14 13:01:49 2022] PUT /identity/v3/projects/b8c87f5bebf54161b9193c449b486c51/users/18f06fc13ba34a03a0ba265ca0c04d8f/roles/5e8849303a75425b9eaa2681cc031af1 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:01:50.082622 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1971478c-5863-4604-900e-09f9d3ecc407 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:50.083105 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1971478c-5863-4604-900e-09f9d3ecc407 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:50.083438 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1971478c-5863-4604-900e-09f9d3ecc407 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:50.144804 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:01:50.158064 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-1971478c-5863-4604-900e-09f9d3ecc407 None None] MFA Rules not processed for user `18f06fc13ba34a03a0ba265ca0c04d8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:01:50.162914 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-1971478c-5863-4604-900e-09f9d3ecc407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:50.302625 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 875/1694] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:01:50 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:01:50.311939 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fbe5f4-7baf-44ac-8776-4299d01bf832 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:50.314177 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-16fbe5f4-7baf-44ac-8776-4299d01bf832 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:50.458541 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1971478c-5863-4604-900e-09f9d3ecc407 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:50.465165 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-1971478c-5863-4604-900e-09f9d3ecc407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:50.516334 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fbe5f4-7baf-44ac-8776-4299d01bf832 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:50.525344 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6330e7cf-db21-4502-bb12-e40e1a95f531 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0de24488ed54df29d8da344d76651d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:50.526486 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6330e7cf-db21-4502-bb12-e40e1a95f531 service glance] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:50.526720 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6330e7cf-db21-4502-bb12-e40e1a95f531 service glance] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:50.526995 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6330e7cf-db21-4502-bb12-e40e1a95f531 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:50.542099 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1971478c-5863-4604-900e-09f9d3ecc407 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:50.545286 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6330e7cf-db21-4502-bb12-e40e1a95f531 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:50.546751 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027a1161-0e42-4887-bd31-ac012e2cc6f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c3c564b8c548e4beef1cbfba2ad343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:50.547487 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027a1161-0e42-4887-bd31-ac012e2cc6f2 service cinder] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:50.547658 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027a1161-0e42-4887-bd31-ac012e2cc6f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:50.547964 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027a1161-0e42-4887-bd31-ac012e2cc6f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:50.549215 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6330e7cf-db21-4502-bb12-e40e1a95f531 service glance] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:50.549758 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-027a1161-0e42-4887-bd31-ac012e2cc6f2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:50.570408 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 820/1695] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:01:50 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:01:50.636577 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027a1161-0e42-4887-bd31-ac012e2cc6f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:50.638603 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027a1161-0e42-4887-bd31-ac012e2cc6f2 service cinder] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:50.649341 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 876/1696] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:01:50 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 14 13:01:53.781749 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6330e7cf-db21-4502-bb12-e40e1a95f531 service glance] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:53.783875 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-6330e7cf-db21-4502-bb12-e40e1a95f531 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:53.854304 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:01:53.893193 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6330e7cf-db21-4502-bb12-e40e1a95f531 service glance] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:53.898098 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d58dba0-94aa-4dcb-a26f-f63492cbcda2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:53.898919 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d58dba0-94aa-4dcb-a26f-f63492cbcda2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:53.899104 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d58dba0-94aa-4dcb-a26f-f63492cbcda2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:53.899350 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d58dba0-94aa-4dcb-a26f-f63492cbcda2 admin admin] PATH_INFO: `/v3/users/3430dac2c2b94d21a7657c94356016c6` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:53.900645 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d58dba0-94aa-4dcb-a26f-f63492cbcda2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3430dac2c2b94d21a7657c94356016c6)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:53.902629 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d58dba0-94aa-4dcb-a26f-f63492cbcda2 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:53.961628 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-4d58dba0-94aa-4dcb-a26f-f63492cbcda2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3430dac2c2b94d21a7657c94356016c6'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:53.970250 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-4d58dba0-94aa-4dcb-a26f-f63492cbcda2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3430dac2c2b94d21a7657c94356016c6'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:53.971144 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-4d58dba0-94aa-4dcb-a26f-f63492cbcda2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3430dac2c2b94d21a7657c94356016c6'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:53.988029 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-4d58dba0-94aa-4dcb-a26f-f63492cbcda2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3430dac2c2b94d21a7657c94356016c6'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:54.014407 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-4d58dba0-94aa-4dcb-a26f-f63492cbcda2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3430dac2c2b94d21a7657c94356016c6'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:54.023702 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 821/1697] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Oct 14 13:01:53 2022] DELETE /identity/v3/users/3430dac2c2b94d21a7657c94356016c6 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:01:54.030864 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a6cd62-5326-4b07-9d03-1e1b216edb46 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:54.031363 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a6cd62-5326-4b07-9d03-1e1b216edb46 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:54.031740 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a6cd62-5326-4b07-9d03-1e1b216edb46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:54.060092 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-13a6cd62-5326-4b07-9d03-1e1b216edb46 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:01:54.061603 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-13a6cd62-5326-4b07-9d03-1e1b216edb46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:54.203499 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:01:54.230702 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 877/1698] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:01:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:01:54.239073 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d58dba0-94aa-4dcb-a26f-f63492cbcda2 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:54.254564 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-4d58dba0-94aa-4dcb-a26f-f63492cbcda2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:54.377222 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d58dba0-94aa-4dcb-a26f-f63492cbcda2 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:54.384494 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73319ded-7001-433b-a2f2-d33cfe379f22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d483292f3a4794848fcacfba5b107e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:54.385398 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73319ded-7001-433b-a2f2-d33cfe379f22 service neutron] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:54.385815 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73319ded-7001-433b-a2f2-d33cfe379f22 service neutron] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:54.386277 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73319ded-7001-433b-a2f2-d33cfe379f22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:54.401797 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73319ded-7001-433b-a2f2-d33cfe379f22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:54.403481 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73319ded-7001-433b-a2f2-d33cfe379f22 service neutron] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:54.415221 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 822/1699] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:01:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:01:54.777734 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a6cd62-5326-4b07-9d03-1e1b216edb46 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:54.780226 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-13a6cd62-5326-4b07-9d03-1e1b216edb46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:54.795688 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a6cd62-5326-4b07-9d03-1e1b216edb46 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:54.800379 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59393b0d-d710-4013-a0e1-de228de4ae2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:54.801015 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59393b0d-d710-4013-a0e1-de228de4ae2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:54.801295 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59393b0d-d710-4013-a0e1-de228de4ae2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:54.801715 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59393b0d-d710-4013-a0e1-de228de4ae2c admin admin] PATH_INFO: `/v3/projects/84d13241455a4e53949413289f428e10` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:54.802999 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59393b0d-d710-4013-a0e1-de228de4ae2c admin admin] RBAC: Authorizing `identity:delete_project(project_id=84d13241455a4e53949413289f428e10)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:54.804928 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59393b0d-d710-4013-a0e1-de228de4ae2c admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:54.884475 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-59393b0d-d710-4013-a0e1-de228de4ae2c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84d13241455a4e53949413289f428e10', 'request_id': 'req-59393b0d-d710-4013-a0e1-de228de4ae2c'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:54.891326 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-59393b0d-d710-4013-a0e1-de228de4ae2c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84d13241455a4e53949413289f428e10', 'request_id': 'req-59393b0d-d710-4013-a0e1-de228de4ae2c'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:54.900088 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-59393b0d-d710-4013-a0e1-de228de4ae2c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84d13241455a4e53949413289f428e10', 'request_id': 'req-59393b0d-d710-4013-a0e1-de228de4ae2c'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:54.928095 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-59393b0d-d710-4013-a0e1-de228de4ae2c admin admin] The token cache is being invalidate because project 84d13241455a4e53949413289f428e10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:01:54.928325 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-59393b0d-d710-4013-a0e1-de228de4ae2c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:54.929091 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-59393b0d-d710-4013-a0e1-de228de4ae2c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:54.931257 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 878/1700] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Oct 14 13:01:54 2022] DELETE /identity/v3/projects/84d13241455a4e53949413289f428e10 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:01:54.935608 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73319ded-7001-433b-a2f2-d33cfe379f22 service neutron] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:54.955238 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73319ded-7001-433b-a2f2-d33cfe379f22 service neutron] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:55.035970 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5091a41-70f3-4938-aba2-c142e2b1495a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:55.036660 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5091a41-70f3-4938-aba2-c142e2b1495a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:55.036938 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5091a41-70f3-4938-aba2-c142e2b1495a admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:55.037213 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5091a41-70f3-4938-aba2-c142e2b1495a admin admin] PATH_INFO: `/v3/users/a3a8a5f6f2e34c4abf577f2506c46688` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:55.038433 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5091a41-70f3-4938-aba2-c142e2b1495a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3a8a5f6f2e34c4abf577f2506c46688)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:55.040406 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5091a41-70f3-4938-aba2-c142e2b1495a admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:55.042166 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:01:55.113319 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-c5091a41-70f3-4938-aba2-c142e2b1495a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3a8a5f6f2e34c4abf577f2506c46688'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:55.121484 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-c5091a41-70f3-4938-aba2-c142e2b1495a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3a8a5f6f2e34c4abf577f2506c46688'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:55.122266 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-c5091a41-70f3-4938-aba2-c142e2b1495a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3a8a5f6f2e34c4abf577f2506c46688'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:55.130576 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-c5091a41-70f3-4938-aba2-c142e2b1495a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3a8a5f6f2e34c4abf577f2506c46688'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:55.148170 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-c5091a41-70f3-4938-aba2-c142e2b1495a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3a8a5f6f2e34c4abf577f2506c46688'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:55.156783 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 823/1701] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Oct 14 13:01:54 2022] DELETE /identity/v3/users/a3a8a5f6f2e34c4abf577f2506c46688 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:01:55.444664 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59393b0d-d710-4013-a0e1-de228de4ae2c admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:55.446923 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-59393b0d-d710-4013-a0e1-de228de4ae2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:55.558097 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59393b0d-d710-4013-a0e1-de228de4ae2c admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:55.656468 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5091a41-70f3-4938-aba2-c142e2b1495a admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:55.660454 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-c5091a41-70f3-4938-aba2-c142e2b1495a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:55.661328 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f825989a-e087-45c7-b242-032db850b36e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c3c564b8c548e4beef1cbfba2ad343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:55.662016 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f825989a-e087-45c7-b242-032db850b36e service cinder] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:55.662331 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f825989a-e087-45c7-b242-032db850b36e service cinder] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:55.662606 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f825989a-e087-45c7-b242-032db850b36e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:55.664421 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-f825989a-e087-45c7-b242-032db850b36e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:55.728047 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:01:55.741662 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f825989a-e087-45c7-b242-032db850b36e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:55.757118 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f825989a-e087-45c7-b242-032db850b36e service cinder] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:55.783358 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 879/1702] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:01:55 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:01:55.786028 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5091a41-70f3-4938-aba2-c142e2b1495a admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:55.799642 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80386170-ae30-4d9d-9927-5db259ab3865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:55.800769 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80386170-ae30-4d9d-9927-5db259ab3865 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:55.801433 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80386170-ae30-4d9d-9927-5db259ab3865 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:55.802534 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80386170-ae30-4d9d-9927-5db259ab3865 admin admin] PATH_INFO: `/v3/projects/2a7f7d969063485992be17b65c7b3b0b` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:55.808063 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80386170-ae30-4d9d-9927-5db259ab3865 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a7f7d969063485992be17b65c7b3b0b)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:55.810089 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80386170-ae30-4d9d-9927-5db259ab3865 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:55.904917 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-80386170-ae30-4d9d-9927-5db259ab3865 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a7f7d969063485992be17b65c7b3b0b', 'request_id': 'req-80386170-ae30-4d9d-9927-5db259ab3865'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:55.914905 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-80386170-ae30-4d9d-9927-5db259ab3865 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a7f7d969063485992be17b65c7b3b0b', 'request_id': 'req-80386170-ae30-4d9d-9927-5db259ab3865'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:55.924014 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-80386170-ae30-4d9d-9927-5db259ab3865 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a7f7d969063485992be17b65c7b3b0b', 'request_id': 'req-80386170-ae30-4d9d-9927-5db259ab3865'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:55.940101 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-80386170-ae30-4d9d-9927-5db259ab3865 admin admin] The token cache is being invalidate because project 2a7f7d969063485992be17b65c7b3b0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:01:55.940916 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-80386170-ae30-4d9d-9927-5db259ab3865 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:55.941165 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-80386170-ae30-4d9d-9927-5db259ab3865 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:55.946264 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 824/1703] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Oct 14 13:01:55 2022] DELETE /identity/v3/projects/2a7f7d969063485992be17b65c7b3b0b => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:01:55.949183 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574eff7f-1bdd-46a8-879c-92c5bc4b6a5c None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:55.949536 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574eff7f-1bdd-46a8-879c-92c5bc4b6a5c None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:55.950604 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574eff7f-1bdd-46a8-879c-92c5bc4b6a5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:55.975638 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-574eff7f-1bdd-46a8-879c-92c5bc4b6a5c None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:01:55.977002 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-574eff7f-1bdd-46a8-879c-92c5bc4b6a5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:56.113136 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 880/1704] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:01:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:01:56.115147 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4218115f-eaf8-432e-8649-9c506e3ac299 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:56.115545 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4218115f-eaf8-432e-8649-9c506e3ac299 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:56.115840 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4218115f-eaf8-432e-8649-9c506e3ac299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:56.156996 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-4218115f-eaf8-432e-8649-9c506e3ac299 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:01:56.158299 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-4218115f-eaf8-432e-8649-9c506e3ac299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:56.182575 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 825/1705] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:01:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:01:56.183777 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574eff7f-1bdd-46a8-879c-92c5bc4b6a5c None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:56.200835 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574eff7f-1bdd-46a8-879c-92c5bc4b6a5c None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:56.216024 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a839dd95-b271-43f2-96fa-d355e8d75816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:56.217840 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a839dd95-b271-43f2-96fa-d355e8d75816 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:56.218409 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a839dd95-b271-43f2-96fa-d355e8d75816 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:56.218852 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a839dd95-b271-43f2-96fa-d355e8d75816 admin admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:56.219891 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a839dd95-b271-43f2-96fa-d355e8d75816 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 13:01:56.220399 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a839dd95-b271-43f2-96fa-d355e8d75816 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:56.223171 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a839dd95-b271-43f2-96fa-d355e8d75816 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:56.248977 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 881/1706] 10.222.0.17 () {58 vars in 1153 bytes} [Fri Oct 14 13:01:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 13:01:56.251078 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4218115f-eaf8-432e-8649-9c506e3ac299 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:56.256062 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:01:56.268679 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4218115f-eaf8-432e-8649-9c506e3ac299 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:56.288055 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9855a551-ceda-44f5-b069-f745f6c108cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:56.289066 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9855a551-ceda-44f5-b069-f745f6c108cd admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:56.289355 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9855a551-ceda-44f5-b069-f745f6c108cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:56.289636 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9855a551-ceda-44f5-b069-f745f6c108cd admin admin] PATH_INFO: `/v3/projects` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:56.290324 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9855a551-ceda-44f5-b069-f745f6c108cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:56.292285 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9855a551-ceda-44f5-b069-f745f6c108cd admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:56.345683 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 826/1707] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Oct 14 13:01:56 2022] POST /identity/v3/projects => generated 367 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:01:56.353414 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a839dd95-b271-43f2-96fa-d355e8d75816 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:56.379287 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a839dd95-b271-43f2-96fa-d355e8d75816 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:56.561726 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186256cc-1031-4465-b310-a97e80bc32ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:56.563052 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186256cc-1031-4465-b310-a97e80bc32ad admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:56.563337 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186256cc-1031-4465-b310-a97e80bc32ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:56.564004 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186256cc-1031-4465-b310-a97e80bc32ad admin admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:56.564654 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186256cc-1031-4465-b310-a97e80bc32ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:56.567646 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186256cc-1031-4465-b310-a97e80bc32ad admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:56.622838 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 882/1708] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Oct 14 13:01:56 2022] POST /identity/v3/users => generated 284 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:01:56.627022 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9855a551-ceda-44f5-b069-f745f6c108cd admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:56.644189 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9855a551-ceda-44f5-b069-f745f6c108cd admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:56.655177 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a426fa7-45f2-4044-a042-5d9e5f57038e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:56.655821 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a426fa7-45f2-4044-a042-5d9e5f57038e admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:56.656110 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a426fa7-45f2-4044-a042-5d9e5f57038e admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:56.656390 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a426fa7-45f2-4044-a042-5d9e5f57038e admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:56.657054 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a426fa7-45f2-4044-a042-5d9e5f57038e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:56.658769 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a426fa7-45f2-4044-a042-5d9e5f57038e admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:56.706384 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 827/1709] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:01:56 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:01:56.706593 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186256cc-1031-4465-b310-a97e80bc32ad admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:56.718257 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186256cc-1031-4465-b310-a97e80bc32ad admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:56.723699 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5a9dea-4c28-4859-b10d-0509809058bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:56.724869 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5a9dea-4c28-4859-b10d-0509809058bf admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:56.725364 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5a9dea-4c28-4859-b10d-0509809058bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:56.725652 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5a9dea-4c28-4859-b10d-0509809058bf admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:56.726419 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5a9dea-4c28-4859-b10d-0509809058bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:56.728365 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5a9dea-4c28-4859-b10d-0509809058bf admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:56.749865 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a426fa7-45f2-4044-a042-5d9e5f57038e admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:56.761396 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 883/1710] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:01:56 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 14 13:01:56.764627 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a426fa7-45f2-4044-a042-5d9e5f57038e admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:56.775134 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f3cd9b-f727-43cd-a134-b18f882abed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:56.775895 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f3cd9b-f727-43cd-a134-b18f882abed7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:56.776183 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f3cd9b-f727-43cd-a134-b18f882abed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:56.776644 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f3cd9b-f727-43cd-a134-b18f882abed7 admin admin] PATH_INFO: `/v3/projects/498ff59b31f24179a98d7df4c9b93707/users/b33c56096bb94acf80683c9ebb87b733/roles/5e8849303a75425b9eaa2681cc031af1` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:56.808128 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f3cd9b-f727-43cd-a134-b18f882abed7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=498ff59b31f24179a98d7df4c9b93707, user_id=b33c56096bb94acf80683c9ebb87b733, role_id=5e8849303a75425b9eaa2681cc031af1)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:56.814235 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f3cd9b-f727-43cd-a134-b18f882abed7 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:56.868835 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b37dbe-3c41-43af-99c4-db974587a077 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:56.869142 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b37dbe-3c41-43af-99c4-db974587a077 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:56.869359 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b37dbe-3c41-43af-99c4-db974587a077 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:56.874071 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 828/1711] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Oct 14 13:01:56 2022] PUT /identity/v3/projects/498ff59b31f24179a98d7df4c9b93707/users/b33c56096bb94acf80683c9ebb87b733/roles/5e8849303a75425b9eaa2681cc031af1 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:01:56.944479 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-c3b37dbe-3c41-43af-99c4-db974587a077 None None] MFA Rules not processed for user `b33c56096bb94acf80683c9ebb87b733`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:01:56.945053 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-c3b37dbe-3c41-43af-99c4-db974587a077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:57.117005 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:01:57.179502 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f3cd9b-f727-43cd-a134-b18f882abed7 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:57.182418 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 884/1712] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:01:56 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:01:57.343228 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f3cd9b-f727-43cd-a134-b18f882abed7 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:57.351625 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6606f4-8d1b-4109-8f49-72267a3b972e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:57.352425 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6606f4-8d1b-4109-8f49-72267a3b972e admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:57.352886 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6606f4-8d1b-4109-8f49-72267a3b972e admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:57.353401 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6606f4-8d1b-4109-8f49-72267a3b972e admin admin] PATH_INFO: `/v3/projects` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:57.354106 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6606f4-8d1b-4109-8f49-72267a3b972e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:57.357038 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6606f4-8d1b-4109-8f49-72267a3b972e admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:57.389522 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 829/1713] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Oct 14 13:01:57 2022] POST /identity/v3/projects => generated 367 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:01:57.393509 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b37dbe-3c41-43af-99c4-db974587a077 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:57.410882 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b37dbe-3c41-43af-99c4-db974587a077 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:57.475649 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f44c312-af4f-4539-a34e-99f3dd60ec4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:57.476421 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f44c312-af4f-4539-a34e-99f3dd60ec4e admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:57.476705 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f44c312-af4f-4539-a34e-99f3dd60ec4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:57.476979 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f44c312-af4f-4539-a34e-99f3dd60ec4e admin admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:57.477630 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f44c312-af4f-4539-a34e-99f3dd60ec4e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:57.479855 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f44c312-af4f-4539-a34e-99f3dd60ec4e admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:57.517145 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 885/1714] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Oct 14 13:01:57 2022] POST /identity/v3/users => generated 290 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:01:57.519703 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6606f4-8d1b-4109-8f49-72267a3b972e admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:57.532878 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6606f4-8d1b-4109-8f49-72267a3b972e admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:57.537960 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1eb3ce-be55-4396-8e58-c682a1105edf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:57.538660 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1eb3ce-be55-4396-8e58-c682a1105edf admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:57.538944 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1eb3ce-be55-4396-8e58-c682a1105edf admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:57.539222 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1eb3ce-be55-4396-8e58-c682a1105edf admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:57.539864 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1eb3ce-be55-4396-8e58-c682a1105edf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:57.541465 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1eb3ce-be55-4396-8e58-c682a1105edf admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:57.553617 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 830/1715] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:01:57 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 14 13:01:57.558525 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f44c312-af4f-4539-a34e-99f3dd60ec4e admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:57.570417 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f44c312-af4f-4539-a34e-99f3dd60ec4e admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:57.576884 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f14d15-906f-4f22-88fa-f618b3e24456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:57.577826 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f14d15-906f-4f22-88fa-f618b3e24456 admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:57.578413 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f14d15-906f-4f22-88fa-f618b3e24456 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:57.579132 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f14d15-906f-4f22-88fa-f618b3e24456 admin admin] PATH_INFO: `/v3/projects/0f331896a2fb4bca93f336cf433b1996/users/0003c8bbb7ad46618debf23303646238/roles/7f6e29e390bc41f7a9af17659a2e95d1` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:57.602070 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f14d15-906f-4f22-88fa-f618b3e24456 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f331896a2fb4bca93f336cf433b1996, user_id=0003c8bbb7ad46618debf23303646238, role_id=7f6e29e390bc41f7a9af17659a2e95d1)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:57.608428 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f14d15-906f-4f22-88fa-f618b3e24456 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:57.636954 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 886/1716] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Oct 14 13:01:57 2022] PUT /identity/v3/projects/0f331896a2fb4bca93f336cf433b1996/users/0003c8bbb7ad46618debf23303646238/roles/7f6e29e390bc41f7a9af17659a2e95d1 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:01:57.638475 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1eb3ce-be55-4396-8e58-c682a1105edf admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:57.652880 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1eb3ce-be55-4396-8e58-c682a1105edf admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:57.752699 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d00b9b-3ca7-41a9-97af-6dc1607df5d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:57.753646 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d00b9b-3ca7-41a9-97af-6dc1607df5d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:57.754286 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d00b9b-3ca7-41a9-97af-6dc1607df5d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:57.754755 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d00b9b-3ca7-41a9-97af-6dc1607df5d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:57.755796 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d00b9b-3ca7-41a9-97af-6dc1607df5d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:57.757563 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d00b9b-3ca7-41a9-97af-6dc1607df5d5 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:57.773323 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 831/1717] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:01:57 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:01:57.775021 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f14d15-906f-4f22-88fa-f618b3e24456 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:57.787975 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f14d15-906f-4f22-88fa-f618b3e24456 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:57.794797 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f817a67b-c7ee-4fe7-a179-6f183851cd16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:57.795682 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f817a67b-c7ee-4fe7-a179-6f183851cd16 admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:57.796075 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f817a67b-c7ee-4fe7-a179-6f183851cd16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:57.796459 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f817a67b-c7ee-4fe7-a179-6f183851cd16 admin admin] PATH_INFO: `/v3/projects/0f331896a2fb4bca93f336cf433b1996/users/0003c8bbb7ad46618debf23303646238/roles/7f6e29e390bc41f7a9af17659a2e95d1` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:57.798911 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f817a67b-c7ee-4fe7-a179-6f183851cd16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f331896a2fb4bca93f336cf433b1996, user_id=0003c8bbb7ad46618debf23303646238, role_id=7f6e29e390bc41f7a9af17659a2e95d1)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:57.802552 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f817a67b-c7ee-4fe7-a179-6f183851cd16 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:57.816731 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 887/1718] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Oct 14 13:01:57 2022] PUT /identity/v3/projects/0f331896a2fb4bca93f336cf433b1996/users/0003c8bbb7ad46618debf23303646238/roles/7f6e29e390bc41f7a9af17659a2e95d1 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:01:57.828045 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896d189c-7c15-49fd-b5b5-ad0465d42d14 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:57.828328 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896d189c-7c15-49fd-b5b5-ad0465d42d14 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:57.828905 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896d189c-7c15-49fd-b5b5-ad0465d42d14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:57.862141 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-896d189c-7c15-49fd-b5b5-ad0465d42d14 None None] MFA Rules not processed for user `0003c8bbb7ad46618debf23303646238`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:01:57.863400 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-896d189c-7c15-49fd-b5b5-ad0465d42d14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:57.867806 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:01:57.961502 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 832/1719] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:01:57 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:01:57.977624 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f817a67b-c7ee-4fe7-a179-6f183851cd16 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:57.979609 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-f817a67b-c7ee-4fe7-a179-6f183851cd16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:58.048527 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f817a67b-c7ee-4fe7-a179-6f183851cd16 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:58.066304 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0506d1b-74f3-4aab-8b87-fcb3f5f10f00 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c3c564b8c548e4beef1cbfba2ad343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:58.067886 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0506d1b-74f3-4aab-8b87-fcb3f5f10f00 service cinder] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:58.068415 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0506d1b-74f3-4aab-8b87-fcb3f5f10f00 service cinder] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:58.068900 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0506d1b-74f3-4aab-8b87-fcb3f5f10f00 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:58.089860 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0506d1b-74f3-4aab-8b87-fcb3f5f10f00 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:58.092818 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0506d1b-74f3-4aab-8b87-fcb3f5f10f00 service cinder] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:58.107250 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 888/1720] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:01:57 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:01:58.219099 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896d189c-7c15-49fd-b5b5-ad0465d42d14 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:58.230585 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896d189c-7c15-49fd-b5b5-ad0465d42d14 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:58.238365 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3559113-fa02-4825-9d69-186787b0f0ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c3c564b8c548e4beef1cbfba2ad343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:58.239176 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3559113-fa02-4825-9d69-186787b0f0ef service cinder] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:58.240093 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3559113-fa02-4825-9d69-186787b0f0ef service cinder] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:58.240653 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3559113-fa02-4825-9d69-186787b0f0ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:58.342333 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3559113-fa02-4825-9d69-186787b0f0ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:58.344302 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3559113-fa02-4825-9d69-186787b0f0ef service cinder] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:58.390408 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 833/1721] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:01:58 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:01:59.169366 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0506d1b-74f3-4aab-8b87-fcb3f5f10f00 service cinder] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:59.170913 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-f0506d1b-74f3-4aab-8b87-fcb3f5f10f00 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:59.302878 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:01:59.340852 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0506d1b-74f3-4aab-8b87-fcb3f5f10f00 service cinder] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:59.355076 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ebcccd-a9fb-43ef-a79a-9fbca7ae28b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:59.355920 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ebcccd-a9fb-43ef-a79a-9fbca7ae28b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:59.356906 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ebcccd-a9fb-43ef-a79a-9fbca7ae28b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:59.357706 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ebcccd-a9fb-43ef-a79a-9fbca7ae28b7 admin admin] PATH_INFO: `/v3/users/8fbc0d331576460ebbdcdeb1ccb60e47` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:59.359639 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ebcccd-a9fb-43ef-a79a-9fbca7ae28b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8fbc0d331576460ebbdcdeb1ccb60e47)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:59.361669 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ebcccd-a9fb-43ef-a79a-9fbca7ae28b7 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:59.441415 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-46ebcccd-a9fb-43ef-a79a-9fbca7ae28b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8fbc0d331576460ebbdcdeb1ccb60e47'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:59.451974 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-46ebcccd-a9fb-43ef-a79a-9fbca7ae28b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8fbc0d331576460ebbdcdeb1ccb60e47'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:59.452773 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-46ebcccd-a9fb-43ef-a79a-9fbca7ae28b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8fbc0d331576460ebbdcdeb1ccb60e47'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:59.463543 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-46ebcccd-a9fb-43ef-a79a-9fbca7ae28b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8fbc0d331576460ebbdcdeb1ccb60e47'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:59.479425 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-46ebcccd-a9fb-43ef-a79a-9fbca7ae28b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8fbc0d331576460ebbdcdeb1ccb60e47'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:01:59.489422 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 889/1722] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Oct 14 13:01:59 2022] DELETE /identity/v3/users/8fbc0d331576460ebbdcdeb1ccb60e47 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:01:59.495714 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987a3b94-fa23-44f6-b428-66608e2e6c9c None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:59.496249 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987a3b94-fa23-44f6-b428-66608e2e6c9c None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:59.496650 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987a3b94-fa23-44f6-b428-66608e2e6c9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:59.537641 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-987a3b94-fa23-44f6-b428-66608e2e6c9c None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:01:59.539036 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-987a3b94-fa23-44f6-b428-66608e2e6c9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:59.612661 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 834/1723] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:01:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:01:59.624961 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ebcccd-a9fb-43ef-a79a-9fbca7ae28b7 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:01:59.626828 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-46ebcccd-a9fb-43ef-a79a-9fbca7ae28b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:01:59.706933 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ebcccd-a9fb-43ef-a79a-9fbca7ae28b7 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:01:59.711255 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7eaeeed-523f-498a-be5d-b5ee30a0adf8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d483292f3a4794848fcacfba5b107e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:01:59.712177 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eaeeed-523f-498a-be5d-b5ee30a0adf8 service neutron] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:01:59.712471 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eaeeed-523f-498a-be5d-b5ee30a0adf8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:01:59.712999 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eaeeed-523f-498a-be5d-b5ee30a0adf8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:01:59.729520 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7eaeeed-523f-498a-be5d-b5ee30a0adf8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:01:59.735973 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7eaeeed-523f-498a-be5d-b5ee30a0adf8 service neutron] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:01:59.747019 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 890/1724] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:01:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:02:00.277158 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987a3b94-fa23-44f6-b428-66608e2e6c9c None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:00.280221 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-987a3b94-fa23-44f6-b428-66608e2e6c9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:02:00.331003 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987a3b94-fa23-44f6-b428-66608e2e6c9c None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:00.344626 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d61626f-b436-4c71-a1b7-f1064fbae82f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:00.345483 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d61626f-b436-4c71-a1b7-f1064fbae82f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:00.345837 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d61626f-b436-4c71-a1b7-f1064fbae82f admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:00.346333 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d61626f-b436-4c71-a1b7-f1064fbae82f admin admin] PATH_INFO: `/v3/projects/1dc665d05152444b962d5de34e8148a2` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:00.348105 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d61626f-b436-4c71-a1b7-f1064fbae82f admin admin] RBAC: Authorizing `identity:delete_project(project_id=1dc665d05152444b962d5de34e8148a2)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:00.351219 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d61626f-b436-4c71-a1b7-f1064fbae82f admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:00.438096 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:02:00.458938 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-7d61626f-b436-4c71-a1b7-f1064fbae82f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1dc665d05152444b962d5de34e8148a2', 'request_id': 'req-7d61626f-b436-4c71-a1b7-f1064fbae82f'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:00.467176 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-7d61626f-b436-4c71-a1b7-f1064fbae82f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1dc665d05152444b962d5de34e8148a2', 'request_id': 'req-7d61626f-b436-4c71-a1b7-f1064fbae82f'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:00.483531 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-7d61626f-b436-4c71-a1b7-f1064fbae82f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1dc665d05152444b962d5de34e8148a2', 'request_id': 'req-7d61626f-b436-4c71-a1b7-f1064fbae82f'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:00.500505 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-7d61626f-b436-4c71-a1b7-f1064fbae82f admin admin] The token cache is being invalidate because project 1dc665d05152444b962d5de34e8148a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:02:00.500505 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-7d61626f-b436-4c71-a1b7-f1064fbae82f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:00.501161 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-7d61626f-b436-4c71-a1b7-f1064fbae82f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:00.503624 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 835/1725] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Oct 14 13:02:00 2022] DELETE /identity/v3/projects/1dc665d05152444b962d5de34e8148a2 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:02:00.508096 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7eaeeed-523f-498a-be5d-b5ee30a0adf8 service neutron] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:00.534872 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7eaeeed-523f-498a-be5d-b5ee30a0adf8 service neutron] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:00.673190 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a45138-9d21-4002-aac2-adde48e93a91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:00.674113 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a45138-9d21-4002-aac2-adde48e93a91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:00.674557 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a45138-9d21-4002-aac2-adde48e93a91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:00.675507 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a45138-9d21-4002-aac2-adde48e93a91 admin admin] PATH_INFO: `/v3/users/be7a733aea914024b64bb67390855f6a` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:00.678680 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a45138-9d21-4002-aac2-adde48e93a91 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be7a733aea914024b64bb67390855f6a)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:00.685371 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a45138-9d21-4002-aac2-adde48e93a91 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:00.700556 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:02:00.799500 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-00a45138-9d21-4002-aac2-adde48e93a91 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be7a733aea914024b64bb67390855f6a'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:00.816484 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-00a45138-9d21-4002-aac2-adde48e93a91 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be7a733aea914024b64bb67390855f6a'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:00.817553 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-00a45138-9d21-4002-aac2-adde48e93a91 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be7a733aea914024b64bb67390855f6a'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:00.830181 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-00a45138-9d21-4002-aac2-adde48e93a91 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be7a733aea914024b64bb67390855f6a'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:00.872856 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-00a45138-9d21-4002-aac2-adde48e93a91 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be7a733aea914024b64bb67390855f6a'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:00.891438 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 891/1726] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Oct 14 13:02:00 2022] DELETE /identity/v3/users/be7a733aea914024b64bb67390855f6a => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:02:01.835170 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d61626f-b436-4c71-a1b7-f1064fbae82f admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:01.837775 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-7d61626f-b436-4c71-a1b7-f1064fbae82f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:02:01.863215 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d61626f-b436-4c71-a1b7-f1064fbae82f admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:01.993625 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7027e641-116f-418f-baf4-41e72510271e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:01.994505 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7027e641-116f-418f-baf4-41e72510271e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:01.994887 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7027e641-116f-418f-baf4-41e72510271e admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:01.995298 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7027e641-116f-418f-baf4-41e72510271e admin admin] PATH_INFO: `/v3/projects/955eafdb1fdc482983d7058c9e06df01` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:01.997601 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7027e641-116f-418f-baf4-41e72510271e admin admin] RBAC: Authorizing `identity:delete_project(project_id=955eafdb1fdc482983d7058c9e06df01)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:02.000218 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7027e641-116f-418f-baf4-41e72510271e admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:02.073870 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-7027e641-116f-418f-baf4-41e72510271e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '955eafdb1fdc482983d7058c9e06df01', 'request_id': 'req-7027e641-116f-418f-baf4-41e72510271e'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:02.083388 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-7027e641-116f-418f-baf4-41e72510271e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '955eafdb1fdc482983d7058c9e06df01', 'request_id': 'req-7027e641-116f-418f-baf4-41e72510271e'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:02.108529 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-7027e641-116f-418f-baf4-41e72510271e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '955eafdb1fdc482983d7058c9e06df01', 'request_id': 'req-7027e641-116f-418f-baf4-41e72510271e'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:02.125629 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-7027e641-116f-418f-baf4-41e72510271e admin admin] The token cache is being invalidate because project 955eafdb1fdc482983d7058c9e06df01 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:02:02.126213 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-7027e641-116f-418f-baf4-41e72510271e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:02.127153 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-7027e641-116f-418f-baf4-41e72510271e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:02.128968 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 836/1727] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Oct 14 13:02:01 2022] DELETE /identity/v3/projects/955eafdb1fdc482983d7058c9e06df01 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:02:02.133374 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a45138-9d21-4002-aac2-adde48e93a91 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:02.135169 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-00a45138-9d21-4002-aac2-adde48e93a91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:02:02.164291 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a45138-9d21-4002-aac2-adde48e93a91 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:02.256539 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9fcb6e-ff2c-4b96-98bc-eb52e6d6742d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:02.257333 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9fcb6e-ff2c-4b96-98bc-eb52e6d6742d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:02.257700 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9fcb6e-ff2c-4b96-98bc-eb52e6d6742d admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:02.258108 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9fcb6e-ff2c-4b96-98bc-eb52e6d6742d admin admin] PATH_INFO: `/v3/users/37df367446b54457858a93db6a5981c2` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:02.259444 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9fcb6e-ff2c-4b96-98bc-eb52e6d6742d admin admin] RBAC: Authorizing `identity:delete_user(user_id=37df367446b54457858a93db6a5981c2)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:02.262754 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9fcb6e-ff2c-4b96-98bc-eb52e6d6742d admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:02.344119 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-6b9fcb6e-ff2c-4b96-98bc-eb52e6d6742d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37df367446b54457858a93db6a5981c2'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:02.354767 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-6b9fcb6e-ff2c-4b96-98bc-eb52e6d6742d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37df367446b54457858a93db6a5981c2'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:02.355760 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-6b9fcb6e-ff2c-4b96-98bc-eb52e6d6742d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37df367446b54457858a93db6a5981c2'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:02.367943 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-6b9fcb6e-ff2c-4b96-98bc-eb52e6d6742d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37df367446b54457858a93db6a5981c2'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:02.383604 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-6b9fcb6e-ff2c-4b96-98bc-eb52e6d6742d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37df367446b54457858a93db6a5981c2'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:02.392836 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 892/1728] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Oct 14 13:02:02 2022] DELETE /identity/v3/users/37df367446b54457858a93db6a5981c2 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 13:02:03.173387 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7027e641-116f-418f-baf4-41e72510271e admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:03.176494 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-7027e641-116f-418f-baf4-41e72510271e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:02:03.254238 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7027e641-116f-418f-baf4-41e72510271e admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:03.372405 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:02:03.396578 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86804fb6-7714-47ab-9814-2fd082ffe654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:03.397242 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86804fb6-7714-47ab-9814-2fd082ffe654 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:03.397603 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86804fb6-7714-47ab-9814-2fd082ffe654 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:03.398286 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86804fb6-7714-47ab-9814-2fd082ffe654 admin admin] PATH_INFO: `/v3/projects/9841c9e66bce4b028cfe7f06b67f3381` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:03.403596 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86804fb6-7714-47ab-9814-2fd082ffe654 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9841c9e66bce4b028cfe7f06b67f3381)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:03.407505 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86804fb6-7714-47ab-9814-2fd082ffe654 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:03.475520 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-86804fb6-7714-47ab-9814-2fd082ffe654 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9841c9e66bce4b028cfe7f06b67f3381', 'request_id': 'req-86804fb6-7714-47ab-9814-2fd082ffe654'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:03.484482 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-86804fb6-7714-47ab-9814-2fd082ffe654 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9841c9e66bce4b028cfe7f06b67f3381', 'request_id': 'req-86804fb6-7714-47ab-9814-2fd082ffe654'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:03.504247 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-86804fb6-7714-47ab-9814-2fd082ffe654 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9841c9e66bce4b028cfe7f06b67f3381', 'request_id': 'req-86804fb6-7714-47ab-9814-2fd082ffe654'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:03.545142 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-86804fb6-7714-47ab-9814-2fd082ffe654 admin admin] The token cache is being invalidate because project 9841c9e66bce4b028cfe7f06b67f3381 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:02:03.545542 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-86804fb6-7714-47ab-9814-2fd082ffe654 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:03.547961 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-86804fb6-7714-47ab-9814-2fd082ffe654 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:03.561369 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 837/1729] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Oct 14 13:02:03 2022] DELETE /identity/v3/projects/9841c9e66bce4b028cfe7f06b67f3381 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:02:03.562822 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f213d5b-0eb6-4fd5-bb4b-742e8a7e70fe None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:03.563740 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f213d5b-0eb6-4fd5-bb4b-742e8a7e70fe None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:03.564184 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f213d5b-0eb6-4fd5-bb4b-742e8a7e70fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:03.582244 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:02:03.606827 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-0f213d5b-0eb6-4fd5-bb4b-742e8a7e70fe None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:02:03.609140 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-0f213d5b-0eb6-4fd5-bb4b-742e8a7e70fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:02:03.726180 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 893/1730] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:02:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:02:03.735743 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24393ca1-0f4d-484b-bfff-f35d0e47a4ce None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:03.736464 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24393ca1-0f4d-484b-bfff-f35d0e47a4ce None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:03.738153 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24393ca1-0f4d-484b-bfff-f35d0e47a4ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:03.763650 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-24393ca1-0f4d-484b-bfff-f35d0e47a4ce None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:02:03.765470 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-24393ca1-0f4d-484b-bfff-f35d0e47a4ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:02:03.778506 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 838/1731] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:02:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:02:03.782014 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f213d5b-0eb6-4fd5-bb4b-742e8a7e70fe None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:03.799163 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f213d5b-0eb6-4fd5-bb4b-742e8a7e70fe None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:03.817596 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148ce710-ea9d-47aa-9bb9-118f88e45bf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:03.824843 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148ce710-ea9d-47aa-9bb9-118f88e45bf4 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:03.825204 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148ce710-ea9d-47aa-9bb9-118f88e45bf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:03.825434 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148ce710-ea9d-47aa-9bb9-118f88e45bf4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:03.826143 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148ce710-ea9d-47aa-9bb9-118f88e45bf4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 13:02:03.826477 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148ce710-ea9d-47aa-9bb9-118f88e45bf4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:03.828455 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148ce710-ea9d-47aa-9bb9-118f88e45bf4 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:03.844696 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 894/1732] 10.222.0.17 () {58 vars in 1153 bytes} [Fri Oct 14 13:02:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 13:02:03.850789 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24393ca1-0f4d-484b-bfff-f35d0e47a4ce None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:03.863492 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24393ca1-0f4d-484b-bfff-f35d0e47a4ce None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:03.869354 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ca327d-308e-433c-bf00-679fb8d37afc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:03.870089 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ca327d-308e-433c-bf00-679fb8d37afc admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:03.870398 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ca327d-308e-433c-bf00-679fb8d37afc admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:03.870672 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ca327d-308e-433c-bf00-679fb8d37afc admin admin] PATH_INFO: `/v3/projects` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:03.871889 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ca327d-308e-433c-bf00-679fb8d37afc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:03.873877 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ca327d-308e-433c-bf00-679fb8d37afc admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:03.911078 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 839/1733] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Oct 14 13:02:03 2022] POST /identity/v3/projects => generated 389 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:02:03.916275 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148ce710-ea9d-47aa-9bb9-118f88e45bf4 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:03.940015 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148ce710-ea9d-47aa-9bb9-118f88e45bf4 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:04.025438 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d026a3e6-5b4e-4fe0-bdb7-12fdbb164bdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:04.026297 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d026a3e6-5b4e-4fe0-bdb7-12fdbb164bdf admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:04.026674 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d026a3e6-5b4e-4fe0-bdb7-12fdbb164bdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:04.028039 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d026a3e6-5b4e-4fe0-bdb7-12fdbb164bdf admin admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:04.028039 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d026a3e6-5b4e-4fe0-bdb7-12fdbb164bdf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:04.030567 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d026a3e6-5b4e-4fe0-bdb7-12fdbb164bdf admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:04.062395 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 895/1734] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Oct 14 13:02:03 2022] POST /identity/v3/users => generated 295 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:02:04.063895 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ca327d-308e-433c-bf00-679fb8d37afc admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:04.075749 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ca327d-308e-433c-bf00-679fb8d37afc admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:04.081383 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7edb6e-d8c8-455c-a83e-77340380c02e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:04.082418 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7edb6e-d8c8-455c-a83e-77340380c02e admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:04.082722 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7edb6e-d8c8-455c-a83e-77340380c02e admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:04.089978 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7edb6e-d8c8-455c-a83e-77340380c02e admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:04.090943 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7edb6e-d8c8-455c-a83e-77340380c02e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:04.106144 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7edb6e-d8c8-455c-a83e-77340380c02e admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:04.122371 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 840/1735] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:02:04 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:02:04.125338 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d026a3e6-5b4e-4fe0-bdb7-12fdbb164bdf admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:04.139525 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d026a3e6-5b4e-4fe0-bdb7-12fdbb164bdf admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:04.147048 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3972738f-50be-4914-924e-ccc6905b884b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:04.147878 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3972738f-50be-4914-924e-ccc6905b884b admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:04.148252 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3972738f-50be-4914-924e-ccc6905b884b admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:04.148645 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3972738f-50be-4914-924e-ccc6905b884b admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:04.149480 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3972738f-50be-4914-924e-ccc6905b884b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:04.151533 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3972738f-50be-4914-924e-ccc6905b884b admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:04.166855 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 896/1736] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:02:04 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:02:04.171975 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7edb6e-d8c8-455c-a83e-77340380c02e admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:04.201315 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7edb6e-d8c8-455c-a83e-77340380c02e admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:04.213444 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1d34b1-b82f-447a-9d80-d2d53d5ff9a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:04.218106 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1d34b1-b82f-447a-9d80-d2d53d5ff9a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:04.218822 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1d34b1-b82f-447a-9d80-d2d53d5ff9a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:04.219249 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1d34b1-b82f-447a-9d80-d2d53d5ff9a9 admin admin] PATH_INFO: `/v3/projects/f9a995b50a0844e7af95b89212ec36c6/users/a4364212eb1848e390670bb673fbc902/roles/5e8849303a75425b9eaa2681cc031af1` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:04.243622 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1d34b1-b82f-447a-9d80-d2d53d5ff9a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9a995b50a0844e7af95b89212ec36c6, user_id=a4364212eb1848e390670bb673fbc902, role_id=5e8849303a75425b9eaa2681cc031af1)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:04.249352 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1d34b1-b82f-447a-9d80-d2d53d5ff9a9 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:04.279299 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 841/1737] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Oct 14 13:02:04 2022] PUT /identity/v3/projects/f9a995b50a0844e7af95b89212ec36c6/users/a4364212eb1848e390670bb673fbc902/roles/5e8849303a75425b9eaa2681cc031af1 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 13:02:04.295866 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712c78a1-a727-4920-a2a3-4e68d5d3cef0 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:04.296155 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712c78a1-a727-4920-a2a3-4e68d5d3cef0 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:04.296436 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712c78a1-a727-4920-a2a3-4e68d5d3cef0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:04.365583 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-712c78a1-a727-4920-a2a3-4e68d5d3cef0 None None] MFA Rules not processed for user `a4364212eb1848e390670bb673fbc902`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:02:04.365583 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-712c78a1-a727-4920-a2a3-4e68d5d3cef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:02:04.472701 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:02:04.522950 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 897/1738] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:02:04 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:02:04.524683 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1d34b1-b82f-447a-9d80-d2d53d5ff9a9 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:04.597912 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712c78a1-a727-4920-a2a3-4e68d5d3cef0 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:04.599760 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-712c78a1-a727-4920-a2a3-4e68d5d3cef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:02:04.662879 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1d34b1-b82f-447a-9d80-d2d53d5ff9a9 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:04.676930 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b3e9e4-3020-4dde-bd8e-3af7b9e46348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:04.678251 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b3e9e4-3020-4dde-bd8e-3af7b9e46348 admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:04.679015 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b3e9e4-3020-4dde-bd8e-3af7b9e46348 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:04.679812 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b3e9e4-3020-4dde-bd8e-3af7b9e46348 admin admin] PATH_INFO: `/v3/projects` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:04.681204 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b3e9e4-3020-4dde-bd8e-3af7b9e46348 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:04.683616 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b3e9e4-3020-4dde-bd8e-3af7b9e46348 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:04.725523 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 842/1739] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Oct 14 13:02:04 2022] POST /identity/v3/projects => generated 389 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 13:02:04.732197 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b3e9e4-3020-4dde-bd8e-3af7b9e46348 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:04.744714 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:02:04.755181 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712c78a1-a727-4920-a2a3-4e68d5d3cef0 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:04.872405 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4aaa2a-f9b5-4d68-926d-6efa3bee00fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:04.873225 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4aaa2a-f9b5-4d68-926d-6efa3bee00fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:04.873521 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4aaa2a-f9b5-4d68-926d-6efa3bee00fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:04.873798 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4aaa2a-f9b5-4d68-926d-6efa3bee00fd admin admin] PATH_INFO: `/v3/users/b33c56096bb94acf80683c9ebb87b733` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:04.875089 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4aaa2a-f9b5-4d68-926d-6efa3bee00fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=b33c56096bb94acf80683c9ebb87b733)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:04.877063 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4aaa2a-f9b5-4d68-926d-6efa3bee00fd admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:04.895996 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b3e9e4-3020-4dde-bd8e-3af7b9e46348 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:04.901890 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f012d8-08b6-4638-b5d5-cd479732aea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:04.903060 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f012d8-08b6-4638-b5d5-cd479732aea6 admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:04.903616 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f012d8-08b6-4638-b5d5-cd479732aea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:04.903961 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f012d8-08b6-4638-b5d5-cd479732aea6 admin admin] PATH_INFO: `/v3/users` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:04.904973 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f012d8-08b6-4638-b5d5-cd479732aea6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:04.907461 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f012d8-08b6-4638-b5d5-cd479732aea6 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:04.950073 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-fb4aaa2a-f9b5-4d68-926d-6efa3bee00fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b33c56096bb94acf80683c9ebb87b733'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:04.959191 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 843/1740] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Oct 14 13:02:04 2022] POST /identity/v3/users => generated 301 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:02:04.960483 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f012d8-08b6-4638-b5d5-cd479732aea6 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:04.960890 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-fb4aaa2a-f9b5-4d68-926d-6efa3bee00fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b33c56096bb94acf80683c9ebb87b733'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:04.961835 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-fb4aaa2a-f9b5-4d68-926d-6efa3bee00fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b33c56096bb94acf80683c9ebb87b733'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:04.975333 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-fb4aaa2a-f9b5-4d68-926d-6efa3bee00fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b33c56096bb94acf80683c9ebb87b733'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:04.981896 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f012d8-08b6-4638-b5d5-cd479732aea6 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:04.991096 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344a3677-d445-4de5-a1b3-f4e25b82ed99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:04.991901 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344a3677-d445-4de5-a1b3-f4e25b82ed99 admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:04.992288 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344a3677-d445-4de5-a1b3-f4e25b82ed99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:04.992915 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344a3677-d445-4de5-a1b3-f4e25b82ed99 admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:04.993594 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344a3677-d445-4de5-a1b3-f4e25b82ed99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:04.995738 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344a3677-d445-4de5-a1b3-f4e25b82ed99 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:05.003128 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-fb4aaa2a-f9b5-4d68-926d-6efa3bee00fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b33c56096bb94acf80683c9ebb87b733'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:05.016876 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 844/1741] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:02:04 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:02:05.018814 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344a3677-d445-4de5-a1b3-f4e25b82ed99 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:05.022353 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-344a3677-d445-4de5-a1b3-f4e25b82ed99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:02:05.030806 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 898/1742] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Oct 14 13:02:04 2022] DELETE /identity/v3/users/b33c56096bb94acf80683c9ebb87b733 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:02:05.040457 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6945a834-3dd4-4f4d-8d63-240976da4f6b None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:05.040964 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6945a834-3dd4-4f4d-8d63-240976da4f6b None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:05.041307 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6945a834-3dd4-4f4d-8d63-240976da4f6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:05.066859 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344a3677-d445-4de5-a1b3-f4e25b82ed99 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:05.075909 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-6945a834-3dd4-4f4d-8d63-240976da4f6b None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:02:05.077457 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-6945a834-3dd4-4f4d-8d63-240976da4f6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:02:05.109778 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:02:05.163498 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d244147-f186-4cee-8bc5-2632cee9b76e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:05.164238 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d244147-f186-4cee-8bc5-2632cee9b76e admin admin] REQUEST_METHOD: `PUT` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:05.164539 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d244147-f186-4cee-8bc5-2632cee9b76e admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:05.165007 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d244147-f186-4cee-8bc5-2632cee9b76e admin admin] PATH_INFO: `/v3/projects/4b5d6bf7ad1c40a794f188eb759b7663/users/63fc64ab69e048b684d9df00f96425f5/roles/7f6e29e390bc41f7a9af17659a2e95d1` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:05.200556 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d244147-f186-4cee-8bc5-2632cee9b76e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b5d6bf7ad1c40a794f188eb759b7663, user_id=63fc64ab69e048b684d9df00f96425f5, role_id=7f6e29e390bc41f7a9af17659a2e95d1)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:05.203330 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 899/1743] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:02:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:02:05.203546 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d244147-f186-4cee-8bc5-2632cee9b76e admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:05.218511 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6945a834-3dd4-4f4d-8d63-240976da4f6b None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:05.220379 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-6945a834-3dd4-4f4d-8d63-240976da4f6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:02:05.225741 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 845/1744] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Oct 14 13:02:05 2022] PUT /identity/v3/projects/4b5d6bf7ad1c40a794f188eb759b7663/users/63fc64ab69e048b684d9df00f96425f5/roles/7f6e29e390bc41f7a9af17659a2e95d1 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:02:05.234580 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d244147-f186-4cee-8bc5-2632cee9b76e admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:05.353253 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d244147-f186-4cee-8bc5-2632cee9b76e admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:05.361815 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71af486a-6ba3-4b46-b4af-50920464bf57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:05.362890 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71af486a-6ba3-4b46-b4af-50920464bf57 admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:05.363330 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71af486a-6ba3-4b46-b4af-50920464bf57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:05.364443 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71af486a-6ba3-4b46-b4af-50920464bf57 admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:05.365108 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71af486a-6ba3-4b46-b4af-50920464bf57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:05.367101 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71af486a-6ba3-4b46-b4af-50920464bf57 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:05.372612 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6945a834-3dd4-4f4d-8d63-240976da4f6b None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:05.382165 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 846/1745] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:02:05 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:02:05.384057 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71af486a-6ba3-4b46-b4af-50920464bf57 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:05.392052 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:02:05.398830 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71af486a-6ba3-4b46-b4af-50920464bf57 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:05.408076 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e957cee-e700-4466-ba22-bcc7f7655bbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:05.408754 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e957cee-e700-4466-ba22-bcc7f7655bbf admin admin] REQUEST_METHOD: `PUT` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:05.409036 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e957cee-e700-4466-ba22-bcc7f7655bbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:05.409309 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e957cee-e700-4466-ba22-bcc7f7655bbf admin admin] PATH_INFO: `/v3/projects/4b5d6bf7ad1c40a794f188eb759b7663/users/63fc64ab69e048b684d9df00f96425f5/roles/7f6e29e390bc41f7a9af17659a2e95d1` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:05.411373 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e957cee-e700-4466-ba22-bcc7f7655bbf admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b5d6bf7ad1c40a794f188eb759b7663, user_id=63fc64ab69e048b684d9df00f96425f5, role_id=7f6e29e390bc41f7a9af17659a2e95d1)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:05.414326 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e957cee-e700-4466-ba22-bcc7f7655bbf admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:05.430352 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 847/1746] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Oct 14 13:02:05 2022] PUT /identity/v3/projects/4b5d6bf7ad1c40a794f188eb759b7663/users/63fc64ab69e048b684d9df00f96425f5/roles/7f6e29e390bc41f7a9af17659a2e95d1 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:02:05.440779 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5414393-aea2-44a0-857e-6ba37235354f None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:05.441104 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5414393-aea2-44a0-857e-6ba37235354f None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:05.441393 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5414393-aea2-44a0-857e-6ba37235354f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:05.445725 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb67e91-09f4-4018-b7f8-a8b634f7d046 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d483292f3a4794848fcacfba5b107e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:05.446725 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb67e91-09f4-4018-b7f8-a8b634f7d046 service neutron] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:05.447324 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb67e91-09f4-4018-b7f8-a8b634f7d046 service neutron] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:05.447610 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb67e91-09f4-4018-b7f8-a8b634f7d046 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:05.461006 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb67e91-09f4-4018-b7f8-a8b634f7d046 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:05.463745 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb67e91-09f4-4018-b7f8-a8b634f7d046 service neutron] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:05.478272 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 900/1747] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:02:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 14 13:02:05.480071 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-d5414393-aea2-44a0-857e-6ba37235354f None None] MFA Rules not processed for user `63fc64ab69e048b684d9df00f96425f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:02:05.482190 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-d5414393-aea2-44a0-857e-6ba37235354f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:02:05.603573 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 848/1748] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:02:05 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 13:02:05.618000 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb67e91-09f4-4018-b7f8-a8b634f7d046 service neutron] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:05.619548 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-edb67e91-09f4-4018-b7f8-a8b634f7d046 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:02:05.733908 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb67e91-09f4-4018-b7f8-a8b634f7d046 service neutron] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:05.806242 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:02:05.818805 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d4464b-b2f6-4600-9fb0-8dfc80bee2da service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c3c564b8c548e4beef1cbfba2ad343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:05.819537 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d4464b-b2f6-4600-9fb0-8dfc80bee2da service cinder] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:05.819814 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d4464b-b2f6-4600-9fb0-8dfc80bee2da service cinder] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:05.820092 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d4464b-b2f6-4600-9fb0-8dfc80bee2da service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:05.833486 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d4464b-b2f6-4600-9fb0-8dfc80bee2da service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:05.835279 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d4464b-b2f6-4600-9fb0-8dfc80bee2da service cinder] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:05.866542 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 901/1749] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:02:05 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 14 13:02:05.947948 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5414393-aea2-44a0-857e-6ba37235354f None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:05.950296 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-d5414393-aea2-44a0-857e-6ba37235354f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:02:06.040065 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d4464b-b2f6-4600-9fb0-8dfc80bee2da service cinder] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:06.044048 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5414393-aea2-44a0-857e-6ba37235354f None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:06.049094 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca84df2-003c-4f96-a0f6-ecea327dcad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:06.049754 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca84df2-003c-4f96-a0f6-ecea327dcad8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:06.050029 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca84df2-003c-4f96-a0f6-ecea327dcad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:06.050348 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca84df2-003c-4f96-a0f6-ecea327dcad8 admin admin] PATH_INFO: `/v3/projects/498ff59b31f24179a98d7df4c9b93707` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:06.051577 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca84df2-003c-4f96-a0f6-ecea327dcad8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=498ff59b31f24179a98d7df4c9b93707)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:06.051686 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d4464b-b2f6-4600-9fb0-8dfc80bee2da service cinder] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:06.053525 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca84df2-003c-4f96-a0f6-ecea327dcad8 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:06.056449 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ff8b00-5a88-4251-8e14-3fee88f94637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:06.057107 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ff8b00-5a88-4251-8e14-3fee88f94637 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:06.057389 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ff8b00-5a88-4251-8e14-3fee88f94637 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:06.057668 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ff8b00-5a88-4251-8e14-3fee88f94637 admin admin] PATH_INFO: `/v3/users/a4364212eb1848e390670bb673fbc902` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:06.059537 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ff8b00-5a88-4251-8e14-3fee88f94637 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4364212eb1848e390670bb673fbc902)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:06.061726 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ff8b00-5a88-4251-8e14-3fee88f94637 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:06.128810 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-74ff8b00-5a88-4251-8e14-3fee88f94637 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4364212eb1848e390670bb673fbc902'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:06.130529 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-8ca84df2-003c-4f96-a0f6-ecea327dcad8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '498ff59b31f24179a98d7df4c9b93707', 'request_id': 'req-8ca84df2-003c-4f96-a0f6-ecea327dcad8'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:06.136741 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-74ff8b00-5a88-4251-8e14-3fee88f94637 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4364212eb1848e390670bb673fbc902'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:06.136914 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-8ca84df2-003c-4f96-a0f6-ecea327dcad8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '498ff59b31f24179a98d7df4c9b93707', 'request_id': 'req-8ca84df2-003c-4f96-a0f6-ecea327dcad8'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:06.137601 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-74ff8b00-5a88-4251-8e14-3fee88f94637 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4364212eb1848e390670bb673fbc902'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:06.145051 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-8ca84df2-003c-4f96-a0f6-ecea327dcad8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '498ff59b31f24179a98d7df4c9b93707', 'request_id': 'req-8ca84df2-003c-4f96-a0f6-ecea327dcad8'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:06.148488 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-74ff8b00-5a88-4251-8e14-3fee88f94637 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4364212eb1848e390670bb673fbc902'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:06.165147 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-74ff8b00-5a88-4251-8e14-3fee88f94637 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4364212eb1848e390670bb673fbc902'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:06.169806 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-8ca84df2-003c-4f96-a0f6-ecea327dcad8 admin admin] The token cache is being invalidate because project 498ff59b31f24179a98d7df4c9b93707 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:02:06.170148 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-8ca84df2-003c-4f96-a0f6-ecea327dcad8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:06.171571 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-8ca84df2-003c-4f96-a0f6-ecea327dcad8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:06.174593 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 849/1750] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Oct 14 13:02:05 2022] DELETE /identity/v3/projects/498ff59b31f24179a98d7df4c9b93707 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:02:06.174751 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 902/1751] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Oct 14 13:02:06 2022] DELETE /identity/v3/users/a4364212eb1848e390670bb673fbc902 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 13:02:06.176567 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca84df2-003c-4f96-a0f6-ecea327dcad8 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:06.178305 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-8ca84df2-003c-4f96-a0f6-ecea327dcad8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:02:06.179860 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c1bef8-80c4-4ec7-b94e-40daa8fe1636 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:06.180203 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c1bef8-80c4-4ec7-b94e-40daa8fe1636 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:06.180668 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c1bef8-80c4-4ec7-b94e-40daa8fe1636 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:06.185375 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:02:06.204536 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-a8c1bef8-80c4-4ec7-b94e-40daa8fe1636 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:02:06.211740 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-a8c1bef8-80c4-4ec7-b94e-40daa8fe1636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:02:06.290308 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca84df2-003c-4f96-a0f6-ecea327dcad8 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:06.296167 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 903/1752] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:02:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:02:06.297276 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8587e4ff-ede9-47ad-b81b-f860ffac7299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:06.298085 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8587e4ff-ede9-47ad-b81b-f860ffac7299 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:06.298569 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8587e4ff-ede9-47ad-b81b-f860ffac7299 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:06.298969 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8587e4ff-ede9-47ad-b81b-f860ffac7299 admin admin] PATH_INFO: `/v3/users/0003c8bbb7ad46618debf23303646238` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:06.300630 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8587e4ff-ede9-47ad-b81b-f860ffac7299 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0003c8bbb7ad46618debf23303646238)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:06.302451 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8587e4ff-ede9-47ad-b81b-f860ffac7299 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:06.306165 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c1bef8-80c4-4ec7-b94e-40daa8fe1636 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:06.307843 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-a8c1bef8-80c4-4ec7-b94e-40daa8fe1636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:02:06.373185 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-8587e4ff-ede9-47ad-b81b-f860ffac7299 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0003c8bbb7ad46618debf23303646238'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:06.381075 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c1bef8-80c4-4ec7-b94e-40daa8fe1636 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:06.381277 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-8587e4ff-ede9-47ad-b81b-f860ffac7299 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0003c8bbb7ad46618debf23303646238'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:06.382053 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-8587e4ff-ede9-47ad-b81b-f860ffac7299 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0003c8bbb7ad46618debf23303646238'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:06.386324 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9f1e15-3297-40a3-8756-f001fd449517 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d483292f3a4794848fcacfba5b107e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:06.388021 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9f1e15-3297-40a3-8756-f001fd449517 service neutron] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:06.388623 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9f1e15-3297-40a3-8756-f001fd449517 service neutron] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:06.388928 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9f1e15-3297-40a3-8756-f001fd449517 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:06.391037 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-3a9f1e15-3297-40a3-8756-f001fd449517 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:02:06.392505 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-8587e4ff-ede9-47ad-b81b-f860ffac7299 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0003c8bbb7ad46618debf23303646238'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:06.406665 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9f1e15-3297-40a3-8756-f001fd449517 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:06.408461 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9f1e15-3297-40a3-8756-f001fd449517 service neutron] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:06.409921 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-8587e4ff-ede9-47ad-b81b-f860ffac7299 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0003c8bbb7ad46618debf23303646238'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:06.414026 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:02:06.420986 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 850/1753] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Oct 14 13:02:06 2022] DELETE /identity/v3/users/0003c8bbb7ad46618debf23303646238 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:02:06.424088 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 904/1754] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:02:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 14 13:02:06.732121 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8587e4ff-ede9-47ad-b81b-f860ffac7299 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:06.733697 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-8587e4ff-ede9-47ad-b81b-f860ffac7299 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:02:06.763780 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9f1e15-3297-40a3-8756-f001fd449517 service neutron] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:06.765641 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-3a9f1e15-3297-40a3-8756-f001fd449517 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:02:06.812398 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9f1e15-3297-40a3-8756-f001fd449517 service neutron] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:06.832827 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8587e4ff-ede9-47ad-b81b-f860ffac7299 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:06.846418 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac55d633-1419-40d6-84cf-f3dc05e70c73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:06.847217 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac55d633-1419-40d6-84cf-f3dc05e70c73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:06.847756 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac55d633-1419-40d6-84cf-f3dc05e70c73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:06.848159 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac55d633-1419-40d6-84cf-f3dc05e70c73 admin admin] PATH_INFO: `/v3/projects/f9a995b50a0844e7af95b89212ec36c6` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:06.849735 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac55d633-1419-40d6-84cf-f3dc05e70c73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9a995b50a0844e7af95b89212ec36c6)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:06.851922 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac55d633-1419-40d6-84cf-f3dc05e70c73 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:06.899015 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:02:06.911178 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebda45c5-0c0d-461b-b768-2e487344e6f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:06.911908 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebda45c5-0c0d-461b-b768-2e487344e6f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:06.912258 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebda45c5-0c0d-461b-b768-2e487344e6f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:06.912624 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebda45c5-0c0d-461b-b768-2e487344e6f9 admin admin] PATH_INFO: `/v3/projects/0f331896a2fb4bca93f336cf433b1996` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:06.913871 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebda45c5-0c0d-461b-b768-2e487344e6f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f331896a2fb4bca93f336cf433b1996)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:06.916023 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebda45c5-0c0d-461b-b768-2e487344e6f9 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:06.961996 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-ac55d633-1419-40d6-84cf-f3dc05e70c73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9a995b50a0844e7af95b89212ec36c6', 'request_id': 'req-ac55d633-1419-40d6-84cf-f3dc05e70c73'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:06.974926 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-ac55d633-1419-40d6-84cf-f3dc05e70c73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9a995b50a0844e7af95b89212ec36c6', 'request_id': 'req-ac55d633-1419-40d6-84cf-f3dc05e70c73'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:06.983273 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-ebda45c5-0c0d-461b-b768-2e487344e6f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f331896a2fb4bca93f336cf433b1996', 'request_id': 'req-ebda45c5-0c0d-461b-b768-2e487344e6f9'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:06.990387 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-ebda45c5-0c0d-461b-b768-2e487344e6f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f331896a2fb4bca93f336cf433b1996', 'request_id': 'req-ebda45c5-0c0d-461b-b768-2e487344e6f9'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:06.995654 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-ac55d633-1419-40d6-84cf-f3dc05e70c73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9a995b50a0844e7af95b89212ec36c6', 'request_id': 'req-ac55d633-1419-40d6-84cf-f3dc05e70c73'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:06.997303 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-ebda45c5-0c0d-461b-b768-2e487344e6f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f331896a2fb4bca93f336cf433b1996', 'request_id': 'req-ebda45c5-0c0d-461b-b768-2e487344e6f9'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:07.012286 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-ebda45c5-0c0d-461b-b768-2e487344e6f9 admin admin] The token cache is being invalidate because project 0f331896a2fb4bca93f336cf433b1996 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:02:07.012731 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-ebda45c5-0c0d-461b-b768-2e487344e6f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:07.014093 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-ebda45c5-0c0d-461b-b768-2e487344e6f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:07.015385 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-ac55d633-1419-40d6-84cf-f3dc05e70c73 admin admin] The token cache is being invalidate because project f9a995b50a0844e7af95b89212ec36c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:02:07.016018 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 905/1755] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Oct 14 13:02:06 2022] DELETE /identity/v3/projects/0f331896a2fb4bca93f336cf433b1996 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:02:07.018375 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-ac55d633-1419-40d6-84cf-f3dc05e70c73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:07.019248 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-ac55d633-1419-40d6-84cf-f3dc05e70c73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:07.020807 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2d2f09-6ad6-4908-86c0-59a051effbd9 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:07.021035 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 851/1756] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Oct 14 13:02:06 2022] DELETE /identity/v3/projects/f9a995b50a0844e7af95b89212ec36c6 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:02:07.021465 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2d2f09-6ad6-4908-86c0-59a051effbd9 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:07.022002 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2d2f09-6ad6-4908-86c0-59a051effbd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:07.025071 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac55d633-1419-40d6-84cf-f3dc05e70c73 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:07.027038 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-ac55d633-1419-40d6-84cf-f3dc05e70c73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:02:07.053260 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-0a2d2f09-6ad6-4908-86c0-59a051effbd9 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:02:07.054550 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-0a2d2f09-6ad6-4908-86c0-59a051effbd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:02:07.126035 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac55d633-1419-40d6-84cf-f3dc05e70c73 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:07.141765 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 906/1757] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:02:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:02:07.150818 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b741b7-9d04-447e-b02f-e70fa7a3ca56 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:07.151361 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b741b7-9d04-447e-b02f-e70fa7a3ca56 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:07.151624 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b741b7-9d04-447e-b02f-e70fa7a3ca56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:07.183255 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-49b741b7-9d04-447e-b02f-e70fa7a3ca56 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:02:07.185222 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-49b741b7-9d04-447e-b02f-e70fa7a3ca56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:02:07.193716 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 907/1758] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:02:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:02:07.197912 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b741b7-9d04-447e-b02f-e70fa7a3ca56 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:07.198578 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59b853a-a263-41ac-9ad8-c483cf067da1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:07.199246 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59b853a-a263-41ac-9ad8-c483cf067da1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:07.199525 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59b853a-a263-41ac-9ad8-c483cf067da1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:07.199797 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59b853a-a263-41ac-9ad8-c483cf067da1 admin admin] PATH_INFO: `/v3/users/63fc64ab69e048b684d9df00f96425f5` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:07.200946 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59b853a-a263-41ac-9ad8-c483cf067da1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=63fc64ab69e048b684d9df00f96425f5)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:07.202978 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59b853a-a263-41ac-9ad8-c483cf067da1 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:07.207416 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b741b7-9d04-447e-b02f-e70fa7a3ca56 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:07.212205 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7ece3f-e5b6-4c47-85ad-5431b16f1b20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:07.212823 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7ece3f-e5b6-4c47-85ad-5431b16f1b20 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:07.213092 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7ece3f-e5b6-4c47-85ad-5431b16f1b20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:07.213361 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7ece3f-e5b6-4c47-85ad-5431b16f1b20 admin admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:07.214008 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7ece3f-e5b6-4c47-85ad-5431b16f1b20 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 13:02:07.214367 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7ece3f-e5b6-4c47-85ad-5431b16f1b20 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:07.216126 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7ece3f-e5b6-4c47-85ad-5431b16f1b20 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:07.228520 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 908/1759] 10.222.0.17 () {58 vars in 1153 bytes} [Fri Oct 14 13:02:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 13:02:07.233993 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7ece3f-e5b6-4c47-85ad-5431b16f1b20 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:07.248057 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7ece3f-e5b6-4c47-85ad-5431b16f1b20 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:07.253738 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a437fa1f-3757-4aa9-8db5-e5740a5e26d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:07.254463 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a437fa1f-3757-4aa9-8db5-e5740a5e26d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:07.254791 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a437fa1f-3757-4aa9-8db5-e5740a5e26d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:07.255113 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a437fa1f-3757-4aa9-8db5-e5740a5e26d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:07.255893 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a437fa1f-3757-4aa9-8db5-e5740a5e26d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:07.257336 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-c59b853a-a263-41ac-9ad8-c483cf067da1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63fc64ab69e048b684d9df00f96425f5'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:07.258113 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a437fa1f-3757-4aa9-8db5-e5740a5e26d0 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:07.265434 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:02:07.271304 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-c59b853a-a263-41ac-9ad8-c483cf067da1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63fc64ab69e048b684d9df00f96425f5'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:07.272260 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-c59b853a-a263-41ac-9ad8-c483cf067da1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63fc64ab69e048b684d9df00f96425f5'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:07.283670 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-c59b853a-a263-41ac-9ad8-c483cf067da1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63fc64ab69e048b684d9df00f96425f5'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:07.285560 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:02:07.302980 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 909/1760] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Oct 14 13:02:07 2022] POST /identity/v3/projects => generated 387 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 13:02:07.307857 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a437fa1f-3757-4aa9-8db5-e5740a5e26d0 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:07.309785 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-a437fa1f-3757-4aa9-8db5-e5740a5e26d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:02:07.311011 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-c59b853a-a263-41ac-9ad8-c483cf067da1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63fc64ab69e048b684d9df00f96425f5'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:07.326302 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 852/1761] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Oct 14 13:02:07 2022] DELETE /identity/v3/users/63fc64ab69e048b684d9df00f96425f5 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:02:07.412741 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a437fa1f-3757-4aa9-8db5-e5740a5e26d0 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:07.481892 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac12338-f4bf-46e0-992b-f70897e9224c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:07.482568 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac12338-f4bf-46e0-992b-f70897e9224c admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:07.482850 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac12338-f4bf-46e0-992b-f70897e9224c admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:07.483126 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac12338-f4bf-46e0-992b-f70897e9224c admin admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:07.483768 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac12338-f4bf-46e0-992b-f70897e9224c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:07.485791 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac12338-f4bf-46e0-992b-f70897e9224c admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:07.509144 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 910/1762] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Oct 14 13:02:07 2022] POST /identity/v3/users => generated 294 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:02:07.514371 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59b853a-a263-41ac-9ad8-c483cf067da1 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:07.525925 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59b853a-a263-41ac-9ad8-c483cf067da1 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:07.531750 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd7e221-6006-4d89-a76b-4d8f961b5334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:07.532736 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd7e221-6006-4d89-a76b-4d8f961b5334 admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:07.532945 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd7e221-6006-4d89-a76b-4d8f961b5334 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:07.533225 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd7e221-6006-4d89-a76b-4d8f961b5334 admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:07.546061 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd7e221-6006-4d89-a76b-4d8f961b5334 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:07.552193 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd7e221-6006-4d89-a76b-4d8f961b5334 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:07.566878 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 853/1763] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:02:07 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:02:07.568225 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac12338-f4bf-46e0-992b-f70897e9224c admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:07.579715 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac12338-f4bf-46e0-992b-f70897e9224c admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:07.584910 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeb05ca-c462-4b92-8dcd-10d16272fbef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:07.585756 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeb05ca-c462-4b92-8dcd-10d16272fbef admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:07.586034 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeb05ca-c462-4b92-8dcd-10d16272fbef admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:07.586330 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeb05ca-c462-4b92-8dcd-10d16272fbef admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:07.586980 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbeb05ca-c462-4b92-8dcd-10d16272fbef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:07.588593 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbeb05ca-c462-4b92-8dcd-10d16272fbef admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:07.602158 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 911/1764] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:02:07 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:02:07.607023 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd7e221-6006-4d89-a76b-4d8f961b5334 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:07.617586 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd7e221-6006-4d89-a76b-4d8f961b5334 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:07.622382 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa5b9ce-f20e-459b-9162-26763accff19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:07.623094 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa5b9ce-f20e-459b-9162-26763accff19 admin admin] REQUEST_METHOD: `PUT` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:07.623373 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa5b9ce-f20e-459b-9162-26763accff19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:07.623647 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa5b9ce-f20e-459b-9162-26763accff19 admin admin] PATH_INFO: `/v3/projects/0a6e13f79bba4a2fb20ec3115021af42/users/a5ca38fdf431446d844b9eb365da9319/roles/5e8849303a75425b9eaa2681cc031af1` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:07.639683 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa5b9ce-f20e-459b-9162-26763accff19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a6e13f79bba4a2fb20ec3115021af42, user_id=a5ca38fdf431446d844b9eb365da9319, role_id=5e8849303a75425b9eaa2681cc031af1)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:07.642389 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa5b9ce-f20e-459b-9162-26763accff19 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:07.659876 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 854/1765] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Oct 14 13:02:07 2022] PUT /identity/v3/projects/0a6e13f79bba4a2fb20ec3115021af42/users/a5ca38fdf431446d844b9eb365da9319/roles/5e8849303a75425b9eaa2681cc031af1 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:02:07.673199 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ce21dc-bb5d-4bf3-8b67-8072bf2b4714 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:07.673502 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ce21dc-bb5d-4bf3-8b67-8072bf2b4714 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:07.674073 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ce21dc-bb5d-4bf3-8b67-8072bf2b4714 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:07.705826 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-e3ce21dc-bb5d-4bf3-8b67-8072bf2b4714 None None] MFA Rules not processed for user `a5ca38fdf431446d844b9eb365da9319`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:02:07.707193 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-e3ce21dc-bb5d-4bf3-8b67-8072bf2b4714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:02:07.749804 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa5b9ce-f20e-459b-9162-26763accff19 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:07.753915 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-baa5b9ce-f20e-459b-9162-26763accff19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:02:07.793531 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 912/1766] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:02:07 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:02:07.798303 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ce21dc-bb5d-4bf3-8b67-8072bf2b4714 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:07.802509 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:02:07.831936 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa5b9ce-f20e-459b-9162-26763accff19 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:07.836835 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cda993-4228-428a-bdcf-18861f504937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:07.837474 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cda993-4228-428a-bdcf-18861f504937 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:07.837785 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cda993-4228-428a-bdcf-18861f504937 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:07.838064 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cda993-4228-428a-bdcf-18861f504937 admin admin] PATH_INFO: `/v3/projects/4b5d6bf7ad1c40a794f188eb759b7663` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:07.839267 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cda993-4228-428a-bdcf-18861f504937 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b5d6bf7ad1c40a794f188eb759b7663)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:07.841778 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cda993-4228-428a-bdcf-18861f504937 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:07.864507 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ce21dc-bb5d-4bf3-8b67-8072bf2b4714 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:07.871719 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1e4996-87cb-47f1-a60a-6f0c51e9e6d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:07.872399 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1e4996-87cb-47f1-a60a-6f0c51e9e6d7 admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:07.872680 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1e4996-87cb-47f1-a60a-6f0c51e9e6d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:07.873024 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1e4996-87cb-47f1-a60a-6f0c51e9e6d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:07.873624 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1e4996-87cb-47f1-a60a-6f0c51e9e6d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:07.875620 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1e4996-87cb-47f1-a60a-6f0c51e9e6d7 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:07.893606 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-a8cda993-4228-428a-bdcf-18861f504937 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b5d6bf7ad1c40a794f188eb759b7663', 'request_id': 'req-a8cda993-4228-428a-bdcf-18861f504937'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:07.900270 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-a8cda993-4228-428a-bdcf-18861f504937 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b5d6bf7ad1c40a794f188eb759b7663', 'request_id': 'req-a8cda993-4228-428a-bdcf-18861f504937'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:07.907965 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-a8cda993-4228-428a-bdcf-18861f504937 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b5d6bf7ad1c40a794f188eb759b7663', 'request_id': 'req-a8cda993-4228-428a-bdcf-18861f504937'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:07.908794 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 913/1767] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Oct 14 13:02:07 2022] POST /identity/v3/projects => generated 387 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 13:02:07.913006 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1e4996-87cb-47f1-a60a-6f0c51e9e6d7 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:07.930024 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-a8cda993-4228-428a-bdcf-18861f504937 admin admin] The token cache is being invalidate because project 4b5d6bf7ad1c40a794f188eb759b7663 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:02:07.930760 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-a8cda993-4228-428a-bdcf-18861f504937 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:07.931494 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-a8cda993-4228-428a-bdcf-18861f504937 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:07.946215 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 855/1768] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Oct 14 13:02:07 2022] DELETE /identity/v3/projects/4b5d6bf7ad1c40a794f188eb759b7663 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 13:02:07.946215 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06c97d9-7eec-412d-a5d9-2f1734245c47 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:07.946215 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06c97d9-7eec-412d-a5d9-2f1734245c47 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:07.946215 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06c97d9-7eec-412d-a5d9-2f1734245c47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:07.961085 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-f06c97d9-7eec-412d-a5d9-2f1734245c47 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:02:07.962362 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-f06c97d9-7eec-412d-a5d9-2f1734245c47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:02:07.982896 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1e4996-87cb-47f1-a60a-6f0c51e9e6d7 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:07.992162 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3ad473-bb43-4211-93af-462bb105fdd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:07.992791 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3ad473-bb43-4211-93af-462bb105fdd9 admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:07.993071 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3ad473-bb43-4211-93af-462bb105fdd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:07.993342 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3ad473-bb43-4211-93af-462bb105fdd9 admin admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:07.994172 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3ad473-bb43-4211-93af-462bb105fdd9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:07.996062 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3ad473-bb43-4211-93af-462bb105fdd9 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:08.001877 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:02:08.024337 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 914/1769] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Oct 14 13:02:07 2022] POST /identity/v3/users => generated 300 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 13:02:08.028778 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3ad473-bb43-4211-93af-462bb105fdd9 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:08.030906 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-fa3ad473-bb43-4211-93af-462bb105fdd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:02:08.050795 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3ad473-bb43-4211-93af-462bb105fdd9 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:08.056114 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 856/1770] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:02:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:02:08.056305 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce817826-5f82-4a16-92a3-26db017e5a86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:08.056596 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce817826-5f82-4a16-92a3-26db017e5a86 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:08.056870 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce817826-5f82-4a16-92a3-26db017e5a86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:08.057271 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce817826-5f82-4a16-92a3-26db017e5a86 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:08.058602 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce817826-5f82-4a16-92a3-26db017e5a86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:08.059871 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce817826-5f82-4a16-92a3-26db017e5a86 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:08.064083 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e30d4b2-52c1-48e7-a576-22dca7782b7c None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:08.064404 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e30d4b2-52c1-48e7-a576-22dca7782b7c None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:08.064661 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e30d4b2-52c1-48e7-a576-22dca7782b7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:08.075620 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 915/1771] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:02:08 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:02:08.077057 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce817826-5f82-4a16-92a3-26db017e5a86 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:08.087989 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-0e30d4b2-52c1-48e7-a576-22dca7782b7c None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:02:08.088282 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce817826-5f82-4a16-92a3-26db017e5a86 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:08.089257 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-0e30d4b2-52c1-48e7-a576-22dca7782b7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:02:08.093780 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0f39c8-e8c3-45cb-88ce-eea5f04ef927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:08.094802 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0f39c8-e8c3-45cb-88ce-eea5f04ef927 admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:08.095091 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0f39c8-e8c3-45cb-88ce-eea5f04ef927 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:08.095367 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0f39c8-e8c3-45cb-88ce-eea5f04ef927 admin admin] PATH_INFO: `/v3/projects/545f1f0e15884fed85e056af94b30a3d/users/e116b686538a47778c68d89f5f696ee1/roles/7f6e29e390bc41f7a9af17659a2e95d1` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:08.101075 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 857/1772] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:02:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 13:02:08.106327 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e30d4b2-52c1-48e7-a576-22dca7782b7c None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:08.112818 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0f39c8-e8c3-45cb-88ce-eea5f04ef927 admin admin] RBAC: Authorizing `identity:create_grant(project_id=545f1f0e15884fed85e056af94b30a3d, user_id=e116b686538a47778c68d89f5f696ee1, role_id=7f6e29e390bc41f7a9af17659a2e95d1)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:08.115767 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0f39c8-e8c3-45cb-88ce-eea5f04ef927 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:08.115981 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e30d4b2-52c1-48e7-a576-22dca7782b7c None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:08.121976 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f276be98-e14e-47a9-862c-3d286da3d3b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:08.122647 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f276be98-e14e-47a9-862c-3d286da3d3b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:08.122928 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f276be98-e14e-47a9-862c-3d286da3d3b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:08.123197 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f276be98-e14e-47a9-862c-3d286da3d3b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:08.123852 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f276be98-e14e-47a9-862c-3d286da3d3b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 13:02:08.124157 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f276be98-e14e-47a9-862c-3d286da3d3b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:08.125833 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f276be98-e14e-47a9-862c-3d286da3d3b5 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:08.131699 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 916/1773] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Oct 14 13:02:08 2022] PUT /identity/v3/projects/545f1f0e15884fed85e056af94b30a3d/users/e116b686538a47778c68d89f5f696ee1/roles/7f6e29e390bc41f7a9af17659a2e95d1 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 13:02:08.135720 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0f39c8-e8c3-45cb-88ce-eea5f04ef927 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:08.145120 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 858/1774] 10.222.0.17 () {58 vars in 1153 bytes} [Fri Oct 14 13:02:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 13:02:08.146219 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f276be98-e14e-47a9-862c-3d286da3d3b5 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:08.157752 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f276be98-e14e-47a9-862c-3d286da3d3b5 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:08.187230 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:02:08.208454 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0f39c8-e8c3-45cb-88ce-eea5f04ef927 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:08.215403 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820fc41e-97b8-454e-aaac-3127f2284736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:08.216317 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820fc41e-97b8-454e-aaac-3127f2284736 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:08.216601 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820fc41e-97b8-454e-aaac-3127f2284736 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:08.216873 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820fc41e-97b8-454e-aaac-3127f2284736 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:08.217549 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820fc41e-97b8-454e-aaac-3127f2284736 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:08.219568 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820fc41e-97b8-454e-aaac-3127f2284736 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:08.234171 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 917/1775] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:02:08 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 14 13:02:08.236544 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820fc41e-97b8-454e-aaac-3127f2284736 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:08.237025 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05751ccd-80e8-4429-9a2a-0697cf50897d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:08.237888 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05751ccd-80e8-4429-9a2a-0697cf50897d admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:08.238298 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05751ccd-80e8-4429-9a2a-0697cf50897d admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:08.238633 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05751ccd-80e8-4429-9a2a-0697cf50897d admin admin] PATH_INFO: `/v3/projects` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:08.239282 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05751ccd-80e8-4429-9a2a-0697cf50897d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:08.241267 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05751ccd-80e8-4429-9a2a-0697cf50897d admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:08.248325 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820fc41e-97b8-454e-aaac-3127f2284736 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:08.257663 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5445c7d2-71db-42ea-a6c7-64292496a3ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:08.257663 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5445c7d2-71db-42ea-a6c7-64292496a3ce admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:08.257663 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5445c7d2-71db-42ea-a6c7-64292496a3ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:08.258590 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5445c7d2-71db-42ea-a6c7-64292496a3ce admin admin] PATH_INFO: `/v3/projects/545f1f0e15884fed85e056af94b30a3d/users/e116b686538a47778c68d89f5f696ee1/roles/7f6e29e390bc41f7a9af17659a2e95d1` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:08.261378 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5445c7d2-71db-42ea-a6c7-64292496a3ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=545f1f0e15884fed85e056af94b30a3d, user_id=e116b686538a47778c68d89f5f696ee1, role_id=7f6e29e390bc41f7a9af17659a2e95d1)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:08.267327 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5445c7d2-71db-42ea-a6c7-64292496a3ce admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:08.280864 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 859/1776] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Oct 14 13:02:08 2022] POST /identity/v3/projects => generated 385 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 13:02:08.282680 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05751ccd-80e8-4429-9a2a-0697cf50897d admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:08.287848 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 918/1777] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Oct 14 13:02:08 2022] PUT /identity/v3/projects/545f1f0e15884fed85e056af94b30a3d/users/e116b686538a47778c68d89f5f696ee1/roles/7f6e29e390bc41f7a9af17659a2e95d1 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 13:02:08.306622 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b7af7c-0b9c-4f07-a064-417dbaa74de3 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:08.306983 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b7af7c-0b9c-4f07-a064-417dbaa74de3 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:08.307336 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b7af7c-0b9c-4f07-a064-417dbaa74de3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:08.338709 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-97b7af7c-0b9c-4f07-a064-417dbaa74de3 None None] MFA Rules not processed for user `e116b686538a47778c68d89f5f696ee1`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:02:08.340327 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-97b7af7c-0b9c-4f07-a064-417dbaa74de3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:02:08.379538 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05751ccd-80e8-4429-9a2a-0697cf50897d admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:08.423243 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 919/1778] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:02:08 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 13:02:08.435082 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b7af7c-0b9c-4f07-a064-417dbaa74de3 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:08.436485 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-97b7af7c-0b9c-4f07-a064-417dbaa74de3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:02:08.437954 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:02:08.453042 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a1bedc-ef67-4378-a006-b827aa3401c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:08.453660 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a1bedc-ef67-4378-a006-b827aa3401c2 admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:08.453941 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a1bedc-ef67-4378-a006-b827aa3401c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:08.454243 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a1bedc-ef67-4378-a006-b827aa3401c2 admin admin] PATH_INFO: `/v3/users` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:08.454882 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a1bedc-ef67-4378-a006-b827aa3401c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:08.456805 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a1bedc-ef67-4378-a006-b827aa3401c2 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:08.486289 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 860/1779] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Oct 14 13:02:08 2022] POST /identity/v3/users => generated 293 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:02:08.488347 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a1bedc-ef67-4378-a006-b827aa3401c2 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:08.500765 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a1bedc-ef67-4378-a006-b827aa3401c2 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:08.505581 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf6d303-955e-4d2f-9b36-e1a7dc1446f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:08.506275 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf6d303-955e-4d2f-9b36-e1a7dc1446f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:08.506557 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf6d303-955e-4d2f-9b36-e1a7dc1446f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:08.506827 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf6d303-955e-4d2f-9b36-e1a7dc1446f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:08.506924 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b7af7c-0b9c-4f07-a064-417dbaa74de3 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:08.507534 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf6d303-955e-4d2f-9b36-e1a7dc1446f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:08.509076 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf6d303-955e-4d2f-9b36-e1a7dc1446f0 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:08.511381 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056a342d-f912-4181-a4c4-a147e11162a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c3c564b8c548e4beef1cbfba2ad343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:08.512872 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056a342d-f912-4181-a4c4-a147e11162a5 service cinder] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:08.513157 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056a342d-f912-4181-a4c4-a147e11162a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:08.513429 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056a342d-f912-4181-a4c4-a147e11162a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:08.523676 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 861/1780] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:02:08 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 14 13:02:08.526723 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056a342d-f912-4181-a4c4-a147e11162a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:08.527871 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf6d303-955e-4d2f-9b36-e1a7dc1446f0 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:08.528467 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056a342d-f912-4181-a4c4-a147e11162a5 service cinder] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:08.540379 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf6d303-955e-4d2f-9b36-e1a7dc1446f0 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:08.540579 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 920/1781] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:02:08 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 14 13:02:08.548151 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a10332-8090-42ec-8da2-04d0ea17fa40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:08.548863 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a10332-8090-42ec-8da2-04d0ea17fa40 admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:08.549323 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a10332-8090-42ec-8da2-04d0ea17fa40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:08.549841 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a10332-8090-42ec-8da2-04d0ea17fa40 admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:08.550742 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a10332-8090-42ec-8da2-04d0ea17fa40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:08.554473 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a10332-8090-42ec-8da2-04d0ea17fa40 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:08.567163 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 862/1782] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:02:08 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 14 13:02:08.571829 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056a342d-f912-4181-a4c4-a147e11162a5 service cinder] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:08.593329 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056a342d-f912-4181-a4c4-a147e11162a5 service cinder] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:08.599529 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e772b012-12f5-46bc-bef0-be5df6d3e6d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:08.600716 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e772b012-12f5-46bc-bef0-be5df6d3e6d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:08.601072 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e772b012-12f5-46bc-bef0-be5df6d3e6d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:08.601422 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e772b012-12f5-46bc-bef0-be5df6d3e6d9 admin admin] PATH_INFO: `/v3/projects/fe4e7e95e6064df2afb2bbc92ce0bd1f/users/0524418da6ee45c2b5c1e376b674d8d7/roles/5e8849303a75425b9eaa2681cc031af1` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:08.622202 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e772b012-12f5-46bc-bef0-be5df6d3e6d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe4e7e95e6064df2afb2bbc92ce0bd1f, user_id=0524418da6ee45c2b5c1e376b674d8d7, role_id=5e8849303a75425b9eaa2681cc031af1)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:08.625341 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e772b012-12f5-46bc-bef0-be5df6d3e6d9 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:08.651566 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 921/1783] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Oct 14 13:02:08 2022] PUT /identity/v3/projects/fe4e7e95e6064df2afb2bbc92ce0bd1f/users/0524418da6ee45c2b5c1e376b674d8d7/roles/5e8849303a75425b9eaa2681cc031af1 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:02:08.667334 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83da88d-7bd0-4c5a-abad-050174a32e6f None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:08.667650 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83da88d-7bd0-4c5a-abad-050174a32e6f None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:08.668477 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83da88d-7bd0-4c5a-abad-050174a32e6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:08.715306 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-d83da88d-7bd0-4c5a-abad-050174a32e6f None None] MFA Rules not processed for user `0524418da6ee45c2b5c1e376b674d8d7`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:02:08.717001 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-d83da88d-7bd0-4c5a-abad-050174a32e6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:02:08.815789 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 863/1784] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:02:08 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:02:08.819659 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e772b012-12f5-46bc-bef0-be5df6d3e6d9 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:08.864936 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:02:08.925736 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e772b012-12f5-46bc-bef0-be5df6d3e6d9 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:08.935908 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d313531-e058-45a6-96e1-ef55232d253f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:08.937375 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d313531-e058-45a6-96e1-ef55232d253f admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:08.938086 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d313531-e058-45a6-96e1-ef55232d253f admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:08.938854 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d313531-e058-45a6-96e1-ef55232d253f admin admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:08.940286 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d313531-e058-45a6-96e1-ef55232d253f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:08.943421 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d313531-e058-45a6-96e1-ef55232d253f admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:08.990601 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83da88d-7bd0-4c5a-abad-050174a32e6f None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:09.001349 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 922/1785] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Oct 14 13:02:08 2022] POST /identity/v3/projects => generated 383 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:02:09.013713 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83da88d-7bd0-4c5a-abad-050174a32e6f None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:09.134550 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e62f8aa-0625-4f31-bdd3-aec472619e68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:09.135649 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e62f8aa-0625-4f31-bdd3-aec472619e68 admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:09.135649 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e62f8aa-0625-4f31-bdd3-aec472619e68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:09.135886 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e62f8aa-0625-4f31-bdd3-aec472619e68 admin admin] PATH_INFO: `/v3/users` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:09.137623 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e62f8aa-0625-4f31-bdd3-aec472619e68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:09.139406 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e62f8aa-0625-4f31-bdd3-aec472619e68 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:09.166157 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 864/1786] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Oct 14 13:02:08 2022] POST /identity/v3/users => generated 292 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:02:09.169881 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d313531-e058-45a6-96e1-ef55232d253f admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:09.181105 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d313531-e058-45a6-96e1-ef55232d253f admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:09.192894 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4598791-cf76-4ed7-995b-e8dc90036c5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:09.193699 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4598791-cf76-4ed7-995b-e8dc90036c5d admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:09.194053 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4598791-cf76-4ed7-995b-e8dc90036c5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:09.194660 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4598791-cf76-4ed7-995b-e8dc90036c5d admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:09.195394 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4598791-cf76-4ed7-995b-e8dc90036c5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:09.197108 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4598791-cf76-4ed7-995b-e8dc90036c5d admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:09.210983 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 923/1787] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:02:09 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:02:09.216114 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e62f8aa-0625-4f31-bdd3-aec472619e68 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:09.228224 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e62f8aa-0625-4f31-bdd3-aec472619e68 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:09.234272 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95792819-47ff-4211-9977-0b5221bb8faa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:09.235096 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95792819-47ff-4211-9977-0b5221bb8faa admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:09.235562 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95792819-47ff-4211-9977-0b5221bb8faa admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:09.235897 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95792819-47ff-4211-9977-0b5221bb8faa admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:09.236650 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95792819-47ff-4211-9977-0b5221bb8faa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:09.238478 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95792819-47ff-4211-9977-0b5221bb8faa admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:09.251511 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 865/1788] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:02:09 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 14 13:02:09.258171 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4598791-cf76-4ed7-995b-e8dc90036c5d admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:09.269479 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4598791-cf76-4ed7-995b-e8dc90036c5d admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:09.281271 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0fba0d-56e3-4950-b5ab-3cac1f009666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:09.282483 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0fba0d-56e3-4950-b5ab-3cac1f009666 admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:09.282956 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0fba0d-56e3-4950-b5ab-3cac1f009666 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:09.283532 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0fba0d-56e3-4950-b5ab-3cac1f009666 admin admin] PATH_INFO: `/v3/projects/185dae9da3fa4e1498391f35ae3804c7/users/23dbc3414cb5444b97586a487eeb0e35/roles/5e8849303a75425b9eaa2681cc031af1` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:09.303588 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0fba0d-56e3-4950-b5ab-3cac1f009666 admin admin] RBAC: Authorizing `identity:create_grant(project_id=185dae9da3fa4e1498391f35ae3804c7, user_id=23dbc3414cb5444b97586a487eeb0e35, role_id=5e8849303a75425b9eaa2681cc031af1)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:09.308024 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0fba0d-56e3-4950-b5ab-3cac1f009666 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:09.329246 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 924/1789] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Oct 14 13:02:09 2022] PUT /identity/v3/projects/185dae9da3fa4e1498391f35ae3804c7/users/23dbc3414cb5444b97586a487eeb0e35/roles/5e8849303a75425b9eaa2681cc031af1 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 13:02:09.339510 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e5314d-a421-4248-9297-6158240b12d5 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:09.340725 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e5314d-a421-4248-9297-6158240b12d5 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:09.341192 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e5314d-a421-4248-9297-6158240b12d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:09.377037 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-91e5314d-a421-4248-9297-6158240b12d5 None None] MFA Rules not processed for user `23dbc3414cb5444b97586a487eeb0e35`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:02:09.378475 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-91e5314d-a421-4248-9297-6158240b12d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:02:09.393117 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:02:09.393846 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0fba0d-56e3-4950-b5ab-3cac1f009666 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:09.470447 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 866/1790] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:02:09 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:02:09.475111 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e5314d-a421-4248-9297-6158240b12d5 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:09.477569 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0fba0d-56e3-4950-b5ab-3cac1f009666 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:09.482517 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801c329a-4e58-4d2e-846c-bc50f7e31d4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:09.483164 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801c329a-4e58-4d2e-846c-bc50f7e31d4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:09.483442 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801c329a-4e58-4d2e-846c-bc50f7e31d4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:09.483725 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801c329a-4e58-4d2e-846c-bc50f7e31d4c admin admin] PATH_INFO: `/v3/users/a5ca38fdf431446d844b9eb365da9319` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:09.484907 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801c329a-4e58-4d2e-846c-bc50f7e31d4c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5ca38fdf431446d844b9eb365da9319)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:09.486897 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801c329a-4e58-4d2e-846c-bc50f7e31d4c admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:09.488164 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e5314d-a421-4248-9297-6158240b12d5 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:09.494179 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bad0d32-99d4-4349-8999-0a8f351d6532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:09.495085 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bad0d32-99d4-4349-8999-0a8f351d6532 admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:09.495436 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bad0d32-99d4-4349-8999-0a8f351d6532 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:09.495958 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bad0d32-99d4-4349-8999-0a8f351d6532 admin admin] PATH_INFO: `/v3/projects` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:09.496796 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bad0d32-99d4-4349-8999-0a8f351d6532 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:09.498996 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bad0d32-99d4-4349-8999-0a8f351d6532 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:09.541216 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 867/1791] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Oct 14 13:02:09 2022] POST /identity/v3/projects => generated 383 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 13:02:09.546678 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bad0d32-99d4-4349-8999-0a8f351d6532 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:09.567851 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-801c329a-4e58-4d2e-846c-bc50f7e31d4c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5ca38fdf431446d844b9eb365da9319'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:09.581131 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-801c329a-4e58-4d2e-846c-bc50f7e31d4c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5ca38fdf431446d844b9eb365da9319'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:09.584921 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-801c329a-4e58-4d2e-846c-bc50f7e31d4c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5ca38fdf431446d844b9eb365da9319'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:09.598971 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-801c329a-4e58-4d2e-846c-bc50f7e31d4c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5ca38fdf431446d844b9eb365da9319'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:09.616928 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-801c329a-4e58-4d2e-846c-bc50f7e31d4c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5ca38fdf431446d844b9eb365da9319'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:09.618984 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:02:09.636721 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 925/1792] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Oct 14 13:02:09 2022] DELETE /identity/v3/users/a5ca38fdf431446d844b9eb365da9319 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:02:09.641539 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d72a26-89ce-4c5e-92a8-0b010965cbf0 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:09.642111 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d72a26-89ce-4c5e-92a8-0b010965cbf0 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:09.642876 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d72a26-89ce-4c5e-92a8-0b010965cbf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:09.658917 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bad0d32-99d4-4349-8999-0a8f351d6532 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:09.677116 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-42d72a26-89ce-4c5e-92a8-0b010965cbf0 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:02:09.680273 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-42d72a26-89ce-4c5e-92a8-0b010965cbf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:02:09.763177 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a346e0ab-7bf6-47f5-a3f8-597cd816a7a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:09.763826 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a346e0ab-7bf6-47f5-a3f8-597cd816a7a7 admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:09.764106 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a346e0ab-7bf6-47f5-a3f8-597cd816a7a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:09.764375 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a346e0ab-7bf6-47f5-a3f8-597cd816a7a7 admin admin] PATH_INFO: `/v3/users` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:09.765022 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a346e0ab-7bf6-47f5-a3f8-597cd816a7a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:09.767492 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a346e0ab-7bf6-47f5-a3f8-597cd816a7a7 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:09.801861 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 868/1793] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Oct 14 13:02:09 2022] POST /identity/v3/users => generated 298 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:02:09.803578 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a346e0ab-7bf6-47f5-a3f8-597cd816a7a7 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:09.805901 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-a346e0ab-7bf6-47f5-a3f8-597cd816a7a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:02:09.820780 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a346e0ab-7bf6-47f5-a3f8-597cd816a7a7 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:09.827775 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d786a6d4-7ba0-4d57-a635-8cd585574469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:09.831551 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d786a6d4-7ba0-4d57-a635-8cd585574469 admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:09.831551 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d786a6d4-7ba0-4d57-a635-8cd585574469 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:09.831551 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d786a6d4-7ba0-4d57-a635-8cd585574469 admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:09.831551 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d786a6d4-7ba0-4d57-a635-8cd585574469 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:09.832076 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d786a6d4-7ba0-4d57-a635-8cd585574469 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:09.840426 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 926/1794] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:02:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:02:09.844788 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d72a26-89ce-4c5e-92a8-0b010965cbf0 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:09.848360 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 869/1795] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:02:09 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:02:09.849904 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d786a6d4-7ba0-4d57-a635-8cd585574469 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:09.861483 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-42d72a26-89ce-4c5e-92a8-0b010965cbf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:02:09.865139 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d786a6d4-7ba0-4d57-a635-8cd585574469 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:09.884307 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be059537-2128-4407-853f-3ad598a9210e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:09.885047 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be059537-2128-4407-853f-3ad598a9210e admin admin] REQUEST_METHOD: `PUT` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:09.885322 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be059537-2128-4407-853f-3ad598a9210e admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:09.885595 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be059537-2128-4407-853f-3ad598a9210e admin admin] PATH_INFO: `/v3/projects/12e392000b904409ba3f9505d94e9098/users/e969ae067ed2478a9913aa605516cbea/roles/7f6e29e390bc41f7a9af17659a2e95d1` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:09.908027 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be059537-2128-4407-853f-3ad598a9210e admin admin] RBAC: Authorizing `identity:create_grant(project_id=12e392000b904409ba3f9505d94e9098, user_id=e969ae067ed2478a9913aa605516cbea, role_id=7f6e29e390bc41f7a9af17659a2e95d1)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:09.911234 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be059537-2128-4407-853f-3ad598a9210e admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:09.914896 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:02:09.938862 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 870/1796] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Oct 14 13:02:09 2022] PUT /identity/v3/projects/12e392000b904409ba3f9505d94e9098/users/e969ae067ed2478a9913aa605516cbea/roles/7f6e29e390bc41f7a9af17659a2e95d1 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:02:09.943630 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be059537-2128-4407-853f-3ad598a9210e admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:09.953887 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d72a26-89ce-4c5e-92a8-0b010965cbf0 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:10.068031 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0b6783-31ad-4e56-808a-07120342d7d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d483292f3a4794848fcacfba5b107e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:10.068697 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0b6783-31ad-4e56-808a-07120342d7d8 service neutron] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:10.069123 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0b6783-31ad-4e56-808a-07120342d7d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:10.069451 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0b6783-31ad-4e56-808a-07120342d7d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:10.083957 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be059537-2128-4407-853f-3ad598a9210e admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:10.103258 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def9df5e-c8a1-4d73-8e78-8eda6ef0b402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:10.104325 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def9df5e-c8a1-4d73-8e78-8eda6ef0b402 admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:10.104772 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def9df5e-c8a1-4d73-8e78-8eda6ef0b402 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:10.106204 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def9df5e-c8a1-4d73-8e78-8eda6ef0b402 admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:10.106983 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def9df5e-c8a1-4d73-8e78-8eda6ef0b402 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:10.109918 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0b6783-31ad-4e56-808a-07120342d7d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:10.111310 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def9df5e-c8a1-4d73-8e78-8eda6ef0b402 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:10.112990 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0b6783-31ad-4e56-808a-07120342d7d8 service neutron] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:10.142620 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 871/1797] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:02:09 2022] GET /identity/v3/roles => generated 1420 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:02:10.145156 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def9df5e-c8a1-4d73-8e78-8eda6ef0b402 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:10.170244 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def9df5e-c8a1-4d73-8e78-8eda6ef0b402 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:10.173131 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 927/1798] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:02:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:02:10.189636 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28135a91-d5b9-4035-9782-5bea6e36c1ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:10.190357 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28135a91-d5b9-4035-9782-5bea6e36c1ab admin admin] REQUEST_METHOD: `PUT` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:10.190637 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28135a91-d5b9-4035-9782-5bea6e36c1ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:10.190913 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28135a91-d5b9-4035-9782-5bea6e36c1ab admin admin] PATH_INFO: `/v3/projects/12e392000b904409ba3f9505d94e9098/users/e969ae067ed2478a9913aa605516cbea/roles/7f6e29e390bc41f7a9af17659a2e95d1` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:10.192947 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28135a91-d5b9-4035-9782-5bea6e36c1ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=12e392000b904409ba3f9505d94e9098, user_id=e969ae067ed2478a9913aa605516cbea, role_id=7f6e29e390bc41f7a9af17659a2e95d1)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:10.196534 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28135a91-d5b9-4035-9782-5bea6e36c1ab admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:10.214162 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 872/1799] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Oct 14 13:02:10 2022] PUT /identity/v3/projects/12e392000b904409ba3f9505d94e9098/users/e969ae067ed2478a9913aa605516cbea/roles/7f6e29e390bc41f7a9af17659a2e95d1 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:02:10.222110 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1619892c-b93a-4c04-a2ac-e73f5fc78d8f None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:10.222415 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1619892c-b93a-4c04-a2ac-e73f5fc78d8f None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:10.222692 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1619892c-b93a-4c04-a2ac-e73f5fc78d8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:10.285800 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-1619892c-b93a-4c04-a2ac-e73f5fc78d8f None None] MFA Rules not processed for user `e969ae067ed2478a9913aa605516cbea`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:02:10.287215 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-1619892c-b93a-4c04-a2ac-e73f5fc78d8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:02:10.364253 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:02:10.399336 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 928/1800] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:02:10 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:02:10.413263 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28135a91-d5b9-4035-9782-5bea6e36c1ab admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:10.416189 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-28135a91-d5b9-4035-9782-5bea6e36c1ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:02:10.539627 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28135a91-d5b9-4035-9782-5bea6e36c1ab admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:10.545376 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce94333-5c63-469c-afc9-988bb4eec33e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c3c564b8c548e4beef1cbfba2ad343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:10.546029 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce94333-5c63-469c-afc9-988bb4eec33e service cinder] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:10.546439 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce94333-5c63-469c-afc9-988bb4eec33e service cinder] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:10.546620 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce94333-5c63-469c-afc9-988bb4eec33e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:10.548767 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-0ce94333-5c63-469c-afc9-988bb4eec33e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:02:10.640252 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1619892c-b93a-4c04-a2ac-e73f5fc78d8f None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:10.644790 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-1619892c-b93a-4c04-a2ac-e73f5fc78d8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:02:10.698061 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce94333-5c63-469c-afc9-988bb4eec33e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:10.700077 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce94333-5c63-469c-afc9-988bb4eec33e service cinder] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:10.726916 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 873/1801] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:02:10 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:02:10.768669 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1619892c-b93a-4c04-a2ac-e73f5fc78d8f None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:10.786496 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6280b31d-4215-4fcf-bdef-96acfc1f7c06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:10.788382 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6280b31d-4215-4fcf-bdef-96acfc1f7c06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:10.788686 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6280b31d-4215-4fcf-bdef-96acfc1f7c06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:10.788966 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6280b31d-4215-4fcf-bdef-96acfc1f7c06 admin admin] PATH_INFO: `/v3/projects/0a6e13f79bba4a2fb20ec3115021af42` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:10.790590 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6280b31d-4215-4fcf-bdef-96acfc1f7c06 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a6e13f79bba4a2fb20ec3115021af42)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:10.792552 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6280b31d-4215-4fcf-bdef-96acfc1f7c06 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:10.906429 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-6280b31d-4215-4fcf-bdef-96acfc1f7c06 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a6e13f79bba4a2fb20ec3115021af42', 'request_id': 'req-6280b31d-4215-4fcf-bdef-96acfc1f7c06'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:10.926961 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-6280b31d-4215-4fcf-bdef-96acfc1f7c06 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a6e13f79bba4a2fb20ec3115021af42', 'request_id': 'req-6280b31d-4215-4fcf-bdef-96acfc1f7c06'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:10.941214 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-6280b31d-4215-4fcf-bdef-96acfc1f7c06 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a6e13f79bba4a2fb20ec3115021af42', 'request_id': 'req-6280b31d-4215-4fcf-bdef-96acfc1f7c06'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:10.971207 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-6280b31d-4215-4fcf-bdef-96acfc1f7c06 admin admin] The token cache is being invalidate because project 0a6e13f79bba4a2fb20ec3115021af42 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:02:10.971512 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-6280b31d-4215-4fcf-bdef-96acfc1f7c06 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:10.972222 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-6280b31d-4215-4fcf-bdef-96acfc1f7c06 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:10.979257 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 929/1802] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Oct 14 13:02:10 2022] DELETE /identity/v3/projects/0a6e13f79bba4a2fb20ec3115021af42 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:02:10.981233 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce94333-5c63-469c-afc9-988bb4eec33e service cinder] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:11.005845 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce94333-5c63-469c-afc9-988bb4eec33e service cinder] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:11.052656 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:02:11.111174 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2973158-79af-44b1-a43f-efcc19a3b883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:11.113120 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2973158-79af-44b1-a43f-efcc19a3b883 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:11.114254 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2973158-79af-44b1-a43f-efcc19a3b883 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:11.114754 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2973158-79af-44b1-a43f-efcc19a3b883 admin admin] PATH_INFO: `/v3/users/e116b686538a47778c68d89f5f696ee1` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:11.116896 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2973158-79af-44b1-a43f-efcc19a3b883 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e116b686538a47778c68d89f5f696ee1)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:11.120052 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2973158-79af-44b1-a43f-efcc19a3b883 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:11.231667 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-e2973158-79af-44b1-a43f-efcc19a3b883 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e116b686538a47778c68d89f5f696ee1'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:11.251833 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-e2973158-79af-44b1-a43f-efcc19a3b883 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e116b686538a47778c68d89f5f696ee1'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:11.253458 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-e2973158-79af-44b1-a43f-efcc19a3b883 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e116b686538a47778c68d89f5f696ee1'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:11.292236 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-e2973158-79af-44b1-a43f-efcc19a3b883 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e116b686538a47778c68d89f5f696ee1'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:11.328599 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-e2973158-79af-44b1-a43f-efcc19a3b883 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e116b686538a47778c68d89f5f696ee1'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:11.347531 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 874/1803] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Oct 14 13:02:10 2022] DELETE /identity/v3/users/e116b686538a47778c68d89f5f696ee1 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 13:02:11.846343 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6280b31d-4215-4fcf-bdef-96acfc1f7c06 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:11.848189 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-6280b31d-4215-4fcf-bdef-96acfc1f7c06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:02:11.869605 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6280b31d-4215-4fcf-bdef-96acfc1f7c06 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:11.961011 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ce357f-0c4e-4828-9783-21f8487026e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:11.961678 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ce357f-0c4e-4828-9783-21f8487026e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:11.962004 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ce357f-0c4e-4828-9783-21f8487026e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:11.962379 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ce357f-0c4e-4828-9783-21f8487026e0 admin admin] PATH_INFO: `/v3/projects/545f1f0e15884fed85e056af94b30a3d` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:11.963557 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ce357f-0c4e-4828-9783-21f8487026e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=545f1f0e15884fed85e056af94b30a3d)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:11.965643 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ce357f-0c4e-4828-9783-21f8487026e0 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:11.985651 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:02:12.035666 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-93ce357f-0c4e-4828-9783-21f8487026e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '545f1f0e15884fed85e056af94b30a3d', 'request_id': 'req-93ce357f-0c4e-4828-9783-21f8487026e0'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:12.043399 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-93ce357f-0c4e-4828-9783-21f8487026e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '545f1f0e15884fed85e056af94b30a3d', 'request_id': 'req-93ce357f-0c4e-4828-9783-21f8487026e0'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:12.050927 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-93ce357f-0c4e-4828-9783-21f8487026e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '545f1f0e15884fed85e056af94b30a3d', 'request_id': 'req-93ce357f-0c4e-4828-9783-21f8487026e0'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:12.065545 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-93ce357f-0c4e-4828-9783-21f8487026e0 admin admin] The token cache is being invalidate because project 545f1f0e15884fed85e056af94b30a3d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:02:12.065848 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-93ce357f-0c4e-4828-9783-21f8487026e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:12.066563 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-93ce357f-0c4e-4828-9783-21f8487026e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:12.068205 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 930/1804] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Oct 14 13:02:11 2022] DELETE /identity/v3/projects/545f1f0e15884fed85e056af94b30a3d => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:02:12.073696 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a58a06-8c05-4cec-b0cd-3ab64ca3b245 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:12.074883 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a58a06-8c05-4cec-b0cd-3ab64ca3b245 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:12.074883 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a58a06-8c05-4cec-b0cd-3ab64ca3b245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:12.110170 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-e6a58a06-8c05-4cec-b0cd-3ab64ca3b245 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:02:12.111769 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-e6a58a06-8c05-4cec-b0cd-3ab64ca3b245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:02:12.188650 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 875/1805] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:02:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:02:12.197600 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b24d56-542f-434c-a600-1d0a51efc2b2 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:12.198050 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b24d56-542f-434c-a600-1d0a51efc2b2 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:12.198428 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b24d56-542f-434c-a600-1d0a51efc2b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:12.221530 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-24b24d56-542f-434c-a600-1d0a51efc2b2 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:02:12.226180 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-24b24d56-542f-434c-a600-1d0a51efc2b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:02:12.234859 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 931/1806] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:02:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 13:02:12.239224 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a58a06-8c05-4cec-b0cd-3ab64ca3b245 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:12.250080 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a58a06-8c05-4cec-b0cd-3ab64ca3b245 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:12.255512 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226d7faa-3789-4ef9-b0b1-91086aeab8ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:12.256138 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226d7faa-3789-4ef9-b0b1-91086aeab8ec admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:12.256422 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226d7faa-3789-4ef9-b0b1-91086aeab8ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:12.256699 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226d7faa-3789-4ef9-b0b1-91086aeab8ec admin admin] PATH_INFO: `/v3/domains` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:12.257361 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226d7faa-3789-4ef9-b0b1-91086aeab8ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 13:02:12.257725 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226d7faa-3789-4ef9-b0b1-91086aeab8ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:12.259376 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226d7faa-3789-4ef9-b0b1-91086aeab8ec admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:12.272884 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 876/1807] 10.222.0.17 () {58 vars in 1153 bytes} [Fri Oct 14 13:02:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 13:02:12.277329 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b24d56-542f-434c-a600-1d0a51efc2b2 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:12.288354 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b24d56-542f-434c-a600-1d0a51efc2b2 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:12.302680 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd8dff3-e047-49c8-82f1-c77776a40db8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:12.303305 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd8dff3-e047-49c8-82f1-c77776a40db8 admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:12.303635 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd8dff3-e047-49c8-82f1-c77776a40db8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:12.303856 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd8dff3-e047-49c8-82f1-c77776a40db8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:12.304811 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd8dff3-e047-49c8-82f1-c77776a40db8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:12.307130 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd8dff3-e047-49c8-82f1-c77776a40db8 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:12.370654 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 932/1808] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Oct 14 13:02:12 2022] POST /identity/v3/projects => generated 375 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 13:02:12.375418 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226d7faa-3789-4ef9-b0b1-91086aeab8ec admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:12.390335 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226d7faa-3789-4ef9-b0b1-91086aeab8ec admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:12.456989 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:02:12.539075 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106da3a2-8103-4b44-80e2-1707249773d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:12.539887 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106da3a2-8103-4b44-80e2-1707249773d1 admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:12.540252 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106da3a2-8103-4b44-80e2-1707249773d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:12.540778 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106da3a2-8103-4b44-80e2-1707249773d1 admin admin] PATH_INFO: `/v3/users` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:12.541612 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106da3a2-8103-4b44-80e2-1707249773d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:12.549103 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106da3a2-8103-4b44-80e2-1707249773d1 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:12.586183 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 877/1809] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Oct 14 13:02:12 2022] POST /identity/v3/users => generated 288 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:02:12.597463 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd8dff3-e047-49c8-82f1-c77776a40db8 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:12.627703 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd8dff3-e047-49c8-82f1-c77776a40db8 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:12.632274 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a08bae-b081-4c7a-9419-924e65fe0344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:12.633000 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a08bae-b081-4c7a-9419-924e65fe0344 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:12.633492 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a08bae-b081-4c7a-9419-924e65fe0344 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:12.633984 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a08bae-b081-4c7a-9419-924e65fe0344 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:12.634774 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a08bae-b081-4c7a-9419-924e65fe0344 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:12.641729 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a08bae-b081-4c7a-9419-924e65fe0344 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:12.649613 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 933/1810] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:02:12 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:02:12.654195 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106da3a2-8103-4b44-80e2-1707249773d1 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:12.655958 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a08bae-b081-4c7a-9419-924e65fe0344 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:12.658169 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-02a08bae-b081-4c7a-9419-924e65fe0344 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:02:12.668953 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106da3a2-8103-4b44-80e2-1707249773d1 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:12.678944 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa193b7-5ba7-4648-bcc9-1ddc401cea5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:12.680518 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa193b7-5ba7-4648-bcc9-1ddc401cea5c admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:12.680885 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa193b7-5ba7-4648-bcc9-1ddc401cea5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:12.681347 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa193b7-5ba7-4648-bcc9-1ddc401cea5c admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:12.681982 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa193b7-5ba7-4648-bcc9-1ddc401cea5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:12.685587 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa193b7-5ba7-4648-bcc9-1ddc401cea5c admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:12.699092 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 878/1811] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:02:12 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:02:12.704472 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa193b7-5ba7-4648-bcc9-1ddc401cea5c admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:12.719586 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa193b7-5ba7-4648-bcc9-1ddc401cea5c admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:12.738973 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd78de1f-d77f-4c53-9dca-5bcaa491f1c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:12.741862 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd78de1f-d77f-4c53-9dca-5bcaa491f1c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:12.742447 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd78de1f-d77f-4c53-9dca-5bcaa491f1c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:12.742862 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd78de1f-d77f-4c53-9dca-5bcaa491f1c8 admin admin] PATH_INFO: `/v3/projects/9c4c73841c104a01b8a5a42111cbfa61/users/b33e817e81024aefa8ab6ba36c99325b/roles/5e8849303a75425b9eaa2681cc031af1` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:12.756481 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a08bae-b081-4c7a-9419-924e65fe0344 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:12.760818 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01dc86b-b457-4ba4-9953-81b56fa5b4d8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c3c564b8c548e4beef1cbfba2ad343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:12.762535 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01dc86b-b457-4ba4-9953-81b56fa5b4d8 service cinder] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:12.762909 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01dc86b-b457-4ba4-9953-81b56fa5b4d8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:12.763258 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01dc86b-b457-4ba4-9953-81b56fa5b4d8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:12.765656 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-a01dc86b-b457-4ba4-9953-81b56fa5b4d8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:02:12.771181 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd78de1f-d77f-4c53-9dca-5bcaa491f1c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c4c73841c104a01b8a5a42111cbfa61, user_id=b33e817e81024aefa8ab6ba36c99325b, role_id=5e8849303a75425b9eaa2681cc031af1)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:12.774920 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd78de1f-d77f-4c53-9dca-5bcaa491f1c8 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:12.795138 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 879/1812] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Oct 14 13:02:12 2022] PUT /identity/v3/projects/9c4c73841c104a01b8a5a42111cbfa61/users/b33e817e81024aefa8ab6ba36c99325b/roles/5e8849303a75425b9eaa2681cc031af1 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 13:02:12.806609 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a18b11-af5e-44f8-a029-ac86ff3e294e None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:12.806898 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a18b11-af5e-44f8-a029-ac86ff3e294e None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:12.807218 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a18b11-af5e-44f8-a029-ac86ff3e294e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:12.837442 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01dc86b-b457-4ba4-9953-81b56fa5b4d8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:12.840751 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01dc86b-b457-4ba4-9953-81b56fa5b4d8 service cinder] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:12.860385 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 934/1813] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:02:12 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:02:12.862748 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-38a18b11-af5e-44f8-a029-ac86ff3e294e None None] MFA Rules not processed for user `b33e817e81024aefa8ab6ba36c99325b`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:02:12.864909 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-38a18b11-af5e-44f8-a029-ac86ff3e294e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:02:12.965430 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 880/1814] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:02:12 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 13:02:12.969767 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01dc86b-b457-4ba4-9953-81b56fa5b4d8 service cinder] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:12.994580 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01dc86b-b457-4ba4-9953-81b56fa5b4d8 service cinder] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:13.013974 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:02:13.083359 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e52d75-1e30-4e17-a0b8-e6743030d1d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:13.083911 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e52d75-1e30-4e17-a0b8-e6743030d1d7 admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:13.084192 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e52d75-1e30-4e17-a0b8-e6743030d1d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:13.084463 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e52d75-1e30-4e17-a0b8-e6743030d1d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:13.085111 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e52d75-1e30-4e17-a0b8-e6743030d1d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:13.087071 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e52d75-1e30-4e17-a0b8-e6743030d1d7 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:13.125168 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 935/1815] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Oct 14 13:02:12 2022] POST /identity/v3/projects => generated 373 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 13:02:13.129422 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a18b11-af5e-44f8-a029-ac86ff3e294e None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:13.143201 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a18b11-af5e-44f8-a029-ac86ff3e294e None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:13.190261 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e52d75-1e30-4e17-a0b8-e6743030d1d7 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:13.192244 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-54e52d75-1e30-4e17-a0b8-e6743030d1d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:02:13.228413 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734c3a92-dd21-43d0-99d7-da08045d47d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:13.229324 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734c3a92-dd21-43d0-99d7-da08045d47d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:13.229690 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734c3a92-dd21-43d0-99d7-da08045d47d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:13.230164 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734c3a92-dd21-43d0-99d7-da08045d47d0 admin admin] PATH_INFO: `/v3/users` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:13.230976 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734c3a92-dd21-43d0-99d7-da08045d47d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:13.232868 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734c3a92-dd21-43d0-99d7-da08045d47d0 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:13.269900 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 881/1816] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Oct 14 13:02:13 2022] POST /identity/v3/users => generated 293 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:02:13.273707 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734c3a92-dd21-43d0-99d7-da08045d47d0 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:13.285712 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734c3a92-dd21-43d0-99d7-da08045d47d0 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:13.291174 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e52d75-1e30-4e17-a0b8-e6743030d1d7 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:13.293552 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e32722-dc4b-4aba-a9ae-9dc05be41d71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:13.294177 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e32722-dc4b-4aba-a9ae-9dc05be41d71 admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:13.294466 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e32722-dc4b-4aba-a9ae-9dc05be41d71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:13.294769 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e32722-dc4b-4aba-a9ae-9dc05be41d71 admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:13.295500 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e32722-dc4b-4aba-a9ae-9dc05be41d71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:13.297357 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e32722-dc4b-4aba-a9ae-9dc05be41d71 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:13.297683 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a5c70e-d9e1-4a2f-a9df-f575fc069dca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:13.298896 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a5c70e-d9e1-4a2f-a9df-f575fc069dca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:13.299393 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a5c70e-d9e1-4a2f-a9df-f575fc069dca admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:13.299957 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a5c70e-d9e1-4a2f-a9df-f575fc069dca admin admin] PATH_INFO: `/v3/users/c039b370575643338954f6de250d1ea9` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:13.302080 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a5c70e-d9e1-4a2f-a9df-f575fc069dca admin admin] RBAC: Authorizing `identity:delete_user(user_id=c039b370575643338954f6de250d1ea9)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:13.304774 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a5c70e-d9e1-4a2f-a9df-f575fc069dca admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:13.313529 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:02:13.324885 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 882/1817] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:02:13 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 14 13:02:13.325879 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e32722-dc4b-4aba-a9ae-9dc05be41d71 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:13.337027 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e32722-dc4b-4aba-a9ae-9dc05be41d71 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:13.343934 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d05e599-4775-47ad-a1e4-72784ced7d83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:13.344627 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d05e599-4775-47ad-a1e4-72784ced7d83 admin admin] REQUEST_METHOD: `PUT` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:13.344954 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d05e599-4775-47ad-a1e4-72784ced7d83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:13.345235 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d05e599-4775-47ad-a1e4-72784ced7d83 admin admin] PATH_INFO: `/v3/projects/3fe13341033f49ba89747f73e25d7ff7/users/f0a6f33e2e364343bb4201566cc07754/roles/7f6e29e390bc41f7a9af17659a2e95d1` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:13.366372 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d05e599-4775-47ad-a1e4-72784ced7d83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fe13341033f49ba89747f73e25d7ff7, user_id=f0a6f33e2e364343bb4201566cc07754, role_id=7f6e29e390bc41f7a9af17659a2e95d1)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:13.369530 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d05e599-4775-47ad-a1e4-72784ced7d83 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:13.381052 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-49a5c70e-d9e1-4a2f-a9df-f575fc069dca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c039b370575643338954f6de250d1ea9'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:13.384449 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 883/1818] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Oct 14 13:02:13 2022] PUT /identity/v3/projects/3fe13341033f49ba89747f73e25d7ff7/users/f0a6f33e2e364343bb4201566cc07754/roles/7f6e29e390bc41f7a9af17659a2e95d1 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:02:13.389729 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d05e599-4775-47ad-a1e4-72784ced7d83 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:13.394694 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-49a5c70e-d9e1-4a2f-a9df-f575fc069dca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c039b370575643338954f6de250d1ea9'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:13.395574 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-49a5c70e-d9e1-4a2f-a9df-f575fc069dca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c039b370575643338954f6de250d1ea9'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:13.405723 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-49a5c70e-d9e1-4a2f-a9df-f575fc069dca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c039b370575643338954f6de250d1ea9'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:13.424915 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-49a5c70e-d9e1-4a2f-a9df-f575fc069dca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c039b370575643338954f6de250d1ea9'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:13.431645 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 936/1819] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Oct 14 13:02:13 2022] DELETE /identity/v3/users/c039b370575643338954f6de250d1ea9 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 13:02:13.482613 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d05e599-4775-47ad-a1e4-72784ced7d83 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:13.568256 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24fff35-da2a-46f8-8b5c-0520c1bf7f59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:13.568874 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24fff35-da2a-46f8-8b5c-0520c1bf7f59 admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:13.569212 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24fff35-da2a-46f8-8b5c-0520c1bf7f59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:13.569899 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24fff35-da2a-46f8-8b5c-0520c1bf7f59 admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:13.571158 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24fff35-da2a-46f8-8b5c-0520c1bf7f59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:13.573222 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24fff35-da2a-46f8-8b5c-0520c1bf7f59 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:13.606174 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 884/1820] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:02:13 2022] GET /identity/v3/roles => generated 1420 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 14 13:02:13.608838 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a5c70e-d9e1-4a2f-a9df-f575fc069dca admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:13.610349 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-49a5c70e-d9e1-4a2f-a9df-f575fc069dca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:02:13.626448 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a5c70e-d9e1-4a2f-a9df-f575fc069dca admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:13.631242 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4edea9-2d4f-4626-b268-245787db4aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:13.632078 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4edea9-2d4f-4626-b268-245787db4aab admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:13.632447 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4edea9-2d4f-4626-b268-245787db4aab admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:13.633336 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4edea9-2d4f-4626-b268-245787db4aab admin admin] PATH_INFO: `/v3/projects/3fe13341033f49ba89747f73e25d7ff7/users/f0a6f33e2e364343bb4201566cc07754/roles/7f6e29e390bc41f7a9af17659a2e95d1` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:13.635318 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4edea9-2d4f-4626-b268-245787db4aab admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fe13341033f49ba89747f73e25d7ff7, user_id=f0a6f33e2e364343bb4201566cc07754, role_id=7f6e29e390bc41f7a9af17659a2e95d1)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:13.638249 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4edea9-2d4f-4626-b268-245787db4aab admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:13.649861 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 937/1821] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Oct 14 13:02:13 2022] PUT /identity/v3/projects/3fe13341033f49ba89747f73e25d7ff7/users/f0a6f33e2e364343bb4201566cc07754/roles/7f6e29e390bc41f7a9af17659a2e95d1 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:02:13.662478 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e79aba8-a94d-46af-97be-3db683dff974 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:13.662774 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e79aba8-a94d-46af-97be-3db683dff974 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:13.663390 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e79aba8-a94d-46af-97be-3db683dff974 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:13.669629 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4edea9-2d4f-4626-b268-245787db4aab admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:13.679547 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-cb4edea9-2d4f-4626-b268-245787db4aab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:02:13.711268 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:02:13.718164 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-8e79aba8-a94d-46af-97be-3db683dff974 None None] MFA Rules not processed for user `f0a6f33e2e364343bb4201566cc07754`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:02:13.719744 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-8e79aba8-a94d-46af-97be-3db683dff974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:02:13.801138 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4edea9-2d4f-4626-b268-245787db4aab admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:13.808537 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7ecb6b-39d2-45c3-aa9a-32ef25ab26b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:13.809523 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7ecb6b-39d2-45c3-aa9a-32ef25ab26b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:13.809815 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7ecb6b-39d2-45c3-aa9a-32ef25ab26b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:13.810092 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7ecb6b-39d2-45c3-aa9a-32ef25ab26b9 admin admin] PATH_INFO: `/v3/projects/192d1bb008c54cb39f95b399d026e062` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:13.811332 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7ecb6b-39d2-45c3-aa9a-32ef25ab26b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=192d1bb008c54cb39f95b399d026e062)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:13.813286 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7ecb6b-39d2-45c3-aa9a-32ef25ab26b9 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:13.821239 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 885/1822] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:02:13 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:02:13.822258 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e79aba8-a94d-46af-97be-3db683dff974 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:13.823614 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-8e79aba8-a94d-46af-97be-3db683dff974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:02:13.830690 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:02:13.872798 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-cb7ecb6b-39d2-45c3-aa9a-32ef25ab26b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '192d1bb008c54cb39f95b399d026e062', 'request_id': 'req-cb7ecb6b-39d2-45c3-aa9a-32ef25ab26b9'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:13.880218 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-cb7ecb6b-39d2-45c3-aa9a-32ef25ab26b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '192d1bb008c54cb39f95b399d026e062', 'request_id': 'req-cb7ecb6b-39d2-45c3-aa9a-32ef25ab26b9'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:13.888058 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-cb7ecb6b-39d2-45c3-aa9a-32ef25ab26b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '192d1bb008c54cb39f95b399d026e062', 'request_id': 'req-cb7ecb6b-39d2-45c3-aa9a-32ef25ab26b9'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:13.893768 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e79aba8-a94d-46af-97be-3db683dff974 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:13.907018 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-cb7ecb6b-39d2-45c3-aa9a-32ef25ab26b9 admin admin] The token cache is being invalidate because project 192d1bb008c54cb39f95b399d026e062 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:02:13.907867 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-cb7ecb6b-39d2-45c3-aa9a-32ef25ab26b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:13.908583 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-cb7ecb6b-39d2-45c3-aa9a-32ef25ab26b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:13.910435 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 938/1823] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Oct 14 13:02:13 2022] DELETE /identity/v3/projects/192d1bb008c54cb39f95b399d026e062 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:02:13.911257 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7ecb6b-39d2-45c3-aa9a-32ef25ab26b9 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:13.912597 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-cb7ecb6b-39d2-45c3-aa9a-32ef25ab26b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:02:13.960453 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89499962-f98c-4f53-a360-478fde309a33 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c3c564b8c548e4beef1cbfba2ad343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:13.961071 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89499962-f98c-4f53-a360-478fde309a33 service cinder] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:13.961827 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89499962-f98c-4f53-a360-478fde309a33 service cinder] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:13.962224 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89499962-f98c-4f53-a360-478fde309a33 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:13.965619 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-89499962-f98c-4f53-a360-478fde309a33 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:02:13.982952 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7ecb6b-39d2-45c3-aa9a-32ef25ab26b9 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:13.987434 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b249287-62b6-4fb1-889b-505a259e2638 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c3c564b8c548e4beef1cbfba2ad343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:13.988113 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b249287-62b6-4fb1-889b-505a259e2638 service cinder] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:13.988326 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b249287-62b6-4fb1-889b-505a259e2638 service cinder] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:13.988673 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b249287-62b6-4fb1-889b-505a259e2638 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:13.991887 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-7b249287-62b6-4fb1-889b-505a259e2638 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:02:14.035954 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89499962-f98c-4f53-a360-478fde309a33 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:14.037328 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89499962-f98c-4f53-a360-478fde309a33 service cinder] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:14.049164 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 886/1824] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:02:13 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:02:14.050680 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ec8f4f-b1b3-4277-8f0f-a8bf87de425b None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:14.050971 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ec8f4f-b1b3-4277-8f0f-a8bf87de425b None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:14.051244 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ec8f4f-b1b3-4277-8f0f-a8bf87de425b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:14.065942 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:02:14.069152 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b249287-62b6-4fb1-889b-505a259e2638 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:14.071290 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b249287-62b6-4fb1-889b-505a259e2638 service cinder] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:14.074351 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-a2ec8f4f-b1b3-4277-8f0f-a8bf87de425b None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:02:14.075567 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-a2ec8f4f-b1b3-4277-8f0f-a8bf87de425b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:02:14.084467 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 939/1825] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:02:13 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:02:14.164046 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 887/1826] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:02:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:02:14.173970 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c31f405-9491-49f8-ab14-6f864ef68823 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:14.174112 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c31f405-9491-49f8-ab14-6f864ef68823 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:14.174403 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c31f405-9491-49f8-ab14-6f864ef68823 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:14.197207 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-7c31f405-9491-49f8-ab14-6f864ef68823 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:02:14.198754 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-7c31f405-9491-49f8-ab14-6f864ef68823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:02:14.207829 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 940/1827] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:02:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:02:14.212147 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ec8f4f-b1b3-4277-8f0f-a8bf87de425b None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:14.223111 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ec8f4f-b1b3-4277-8f0f-a8bf87de425b None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:14.228371 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4737e7bc-2bb2-46db-ab39-f0daa4430f82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:14.229055 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4737e7bc-2bb2-46db-ab39-f0daa4430f82 admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:14.229263 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4737e7bc-2bb2-46db-ab39-f0daa4430f82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:14.229537 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4737e7bc-2bb2-46db-ab39-f0daa4430f82 admin admin] PATH_INFO: `/v3/domains` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:14.231046 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4737e7bc-2bb2-46db-ab39-f0daa4430f82 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 13:02:14.231566 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4737e7bc-2bb2-46db-ab39-f0daa4430f82 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:14.233233 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4737e7bc-2bb2-46db-ab39-f0daa4430f82 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:14.240927 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=100 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:02:14.248082 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 888/1828] 10.222.0.17 () {58 vars in 1153 bytes} [Fri Oct 14 13:02:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 13:02:14.253577 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c31f405-9491-49f8-ab14-6f864ef68823 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:14.265104 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c31f405-9491-49f8-ab14-6f864ef68823 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:14.271200 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d728385-ab99-46ac-acf4-7373bc5d2518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:14.271954 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d728385-ab99-46ac-acf4-7373bc5d2518 admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:14.272552 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d728385-ab99-46ac-acf4-7373bc5d2518 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:14.272552 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d728385-ab99-46ac-acf4-7373bc5d2518 admin admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:14.273435 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d728385-ab99-46ac-acf4-7373bc5d2518 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:14.275581 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d728385-ab99-46ac-acf4-7373bc5d2518 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:14.310650 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 941/1829] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Oct 14 13:02:14 2022] POST /identity/v3/projects => generated 385 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 13:02:14.315528 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4737e7bc-2bb2-46db-ab39-f0daa4430f82 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:14.327875 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4737e7bc-2bb2-46db-ab39-f0daa4430f82 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:14.411277 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf66af18-7240-4470-bef1-24408ef6c47b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:14.412139 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf66af18-7240-4470-bef1-24408ef6c47b admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:14.412541 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf66af18-7240-4470-bef1-24408ef6c47b admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:14.412893 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf66af18-7240-4470-bef1-24408ef6c47b admin admin] PATH_INFO: `/v3/users` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:14.413818 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf66af18-7240-4470-bef1-24408ef6c47b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:14.415979 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf66af18-7240-4470-bef1-24408ef6c47b admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:14.452759 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 889/1830] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Oct 14 13:02:14 2022] POST /identity/v3/users => generated 293 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:02:14.457730 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d728385-ab99-46ac-acf4-7373bc5d2518 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:14.473092 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d728385-ab99-46ac-acf4-7373bc5d2518 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:14.481271 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df269e86-9fc7-42a7-bac8-0ce12e7e7e80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:14.482203 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df269e86-9fc7-42a7-bac8-0ce12e7e7e80 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:14.482583 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df269e86-9fc7-42a7-bac8-0ce12e7e7e80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:14.483055 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df269e86-9fc7-42a7-bac8-0ce12e7e7e80 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:14.483770 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df269e86-9fc7-42a7-bac8-0ce12e7e7e80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:14.485833 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df269e86-9fc7-42a7-bac8-0ce12e7e7e80 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:14.505325 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 942/1831] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:02:14 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:02:14.507061 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf66af18-7240-4470-bef1-24408ef6c47b admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:14.529420 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf66af18-7240-4470-bef1-24408ef6c47b admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:14.536535 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac185f7-4412-4a50-a694-ca3da289af68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:14.537338 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac185f7-4412-4a50-a694-ca3da289af68 admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:14.537711 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac185f7-4412-4a50-a694-ca3da289af68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:14.538085 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac185f7-4412-4a50-a694-ca3da289af68 admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:14.538912 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac185f7-4412-4a50-a694-ca3da289af68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:14.540654 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac185f7-4412-4a50-a694-ca3da289af68 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:14.558163 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 890/1832] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:02:14 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:02:14.565338 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df269e86-9fc7-42a7-bac8-0ce12e7e7e80 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:14.583785 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df269e86-9fc7-42a7-bac8-0ce12e7e7e80 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:14.588747 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f329106-520e-4e01-acab-7e3e620a55f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:14.589517 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f329106-520e-4e01-acab-7e3e620a55f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:14.589837 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f329106-520e-4e01-acab-7e3e620a55f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:14.590206 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f329106-520e-4e01-acab-7e3e620a55f3 admin admin] PATH_INFO: `/v3/projects/afbcbc21db5e4dfead6d26ea178b8b11/users/016aa1318fe34ea6a474f384924d9a1b/roles/5e8849303a75425b9eaa2681cc031af1` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:14.607741 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f329106-520e-4e01-acab-7e3e620a55f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=afbcbc21db5e4dfead6d26ea178b8b11, user_id=016aa1318fe34ea6a474f384924d9a1b, role_id=5e8849303a75425b9eaa2681cc031af1)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:14.610532 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f329106-520e-4e01-acab-7e3e620a55f3 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:14.628190 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 943/1833] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Oct 14 13:02:14 2022] PUT /identity/v3/projects/afbcbc21db5e4dfead6d26ea178b8b11/users/016aa1318fe34ea6a474f384924d9a1b/roles/5e8849303a75425b9eaa2681cc031af1 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:02:14.638966 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d14f68-3c3d-4423-baf5-aa7fd5b4bd83 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:14.639191 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d14f68-3c3d-4423-baf5-aa7fd5b4bd83 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:14.639424 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d14f68-3c3d-4423-baf5-aa7fd5b4bd83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:14.675819 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-a5d14f68-3c3d-4423-baf5-aa7fd5b4bd83 None None] MFA Rules not processed for user `016aa1318fe34ea6a474f384924d9a1b`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:02:14.677204 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-a5d14f68-3c3d-4423-baf5-aa7fd5b4bd83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:02:14.751327 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 891/1834] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:02:14 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:02:14.766306 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f329106-520e-4e01-acab-7e3e620a55f3 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:14.766306 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-2f329106-520e-4e01-acab-7e3e620a55f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:02:14.843795 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f329106-520e-4e01-acab-7e3e620a55f3 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:14.849709 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62326282-eab0-48a9-a517-1e2df8fc700a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '931f4e32c8764514b5efed31b0785be7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:14.850351 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62326282-eab0-48a9-a517-1e2df8fc700a service nova] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:14.850633 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62326282-eab0-48a9-a517-1e2df8fc700a service nova] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:14.850908 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62326282-eab0-48a9-a517-1e2df8fc700a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:14.859677 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62326282-eab0-48a9-a517-1e2df8fc700a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:14.861360 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62326282-eab0-48a9-a517-1e2df8fc700a service nova] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:14.871345 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 944/1835] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:02:14 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:02:15.847066 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d14f68-3c3d-4423-baf5-aa7fd5b4bd83 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:15.848491 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-a5d14f68-3c3d-4423-baf5-aa7fd5b4bd83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:02:15.915612 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d14f68-3c3d-4423-baf5-aa7fd5b4bd83 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:15.922077 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6df8303-6a76-430a-be4d-453a1e1efad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:15.922775 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6df8303-6a76-430a-be4d-453a1e1efad4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:15.923060 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6df8303-6a76-430a-be4d-453a1e1efad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:15.923333 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6df8303-6a76-430a-be4d-453a1e1efad4 admin admin] PATH_INFO: `/v3/users/18f06fc13ba34a03a0ba265ca0c04d8f` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:15.924497 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6df8303-6a76-430a-be4d-453a1e1efad4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=18f06fc13ba34a03a0ba265ca0c04d8f)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:15.926484 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6df8303-6a76-430a-be4d-453a1e1efad4 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:15.932647 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:02:15.977469 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-f6df8303-6a76-430a-be4d-453a1e1efad4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18f06fc13ba34a03a0ba265ca0c04d8f'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:15.984928 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-f6df8303-6a76-430a-be4d-453a1e1efad4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18f06fc13ba34a03a0ba265ca0c04d8f'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:15.985679 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-f6df8303-6a76-430a-be4d-453a1e1efad4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18f06fc13ba34a03a0ba265ca0c04d8f'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:15.993248 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-f6df8303-6a76-430a-be4d-453a1e1efad4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18f06fc13ba34a03a0ba265ca0c04d8f'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:16.006256 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-f6df8303-6a76-430a-be4d-453a1e1efad4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18f06fc13ba34a03a0ba265ca0c04d8f'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:16.012898 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 892/1836] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Oct 14 13:02:15 2022] DELETE /identity/v3/users/18f06fc13ba34a03a0ba265ca0c04d8f => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:02:16.017379 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469dbac3-d3e6-4241-9523-44c8a7ebba00 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:16.017854 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469dbac3-d3e6-4241-9523-44c8a7ebba00 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:16.017941 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469dbac3-d3e6-4241-9523-44c8a7ebba00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:16.038963 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-469dbac3-d3e6-4241-9523-44c8a7ebba00 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:02:16.040187 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-469dbac3-d3e6-4241-9523-44c8a7ebba00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:02:16.100531 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 945/1837] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:02:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:02:16.110456 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6df8303-6a76-430a-be4d-453a1e1efad4 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:16.111845 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-f6df8303-6a76-430a-be4d-453a1e1efad4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:02:16.172038 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6df8303-6a76-430a-be4d-453a1e1efad4 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:16.175945 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d764ce9-ba75-4072-84a9-62294344c04b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d483292f3a4794848fcacfba5b107e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:16.176551 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d764ce9-ba75-4072-84a9-62294344c04b service neutron] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:16.176845 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d764ce9-ba75-4072-84a9-62294344c04b service neutron] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:16.177099 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d764ce9-ba75-4072-84a9-62294344c04b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:16.186285 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d764ce9-ba75-4072-84a9-62294344c04b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:16.187710 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d764ce9-ba75-4072-84a9-62294344c04b service neutron] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:16.196911 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 893/1838] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:02:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:02:16.697940 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469dbac3-d3e6-4241-9523-44c8a7ebba00 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:16.700207 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-469dbac3-d3e6-4241-9523-44c8a7ebba00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:02:16.726618 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469dbac3-d3e6-4241-9523-44c8a7ebba00 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:16.726618 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fefd3c-04aa-413d-b3fd-07cacccedf27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:16.726618 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fefd3c-04aa-413d-b3fd-07cacccedf27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:16.726618 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fefd3c-04aa-413d-b3fd-07cacccedf27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:16.727043 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fefd3c-04aa-413d-b3fd-07cacccedf27 admin admin] PATH_INFO: `/v3/projects/b8c87f5bebf54161b9193c449b486c51` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:16.727043 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fefd3c-04aa-413d-b3fd-07cacccedf27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8c87f5bebf54161b9193c449b486c51)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:16.728748 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fefd3c-04aa-413d-b3fd-07cacccedf27 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:16.759233 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:02:16.771740 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d764ce9-ba75-4072-84a9-62294344c04b service neutron] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:16.773299 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-6d764ce9-ba75-4072-84a9-62294344c04b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:02:16.791138 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d764ce9-ba75-4072-84a9-62294344c04b service neutron] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:16.814965 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3116fcc-13ca-4614-9924-0c796bc1c727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:16.815606 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3116fcc-13ca-4614-9924-0c796bc1c727 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:16.815886 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3116fcc-13ca-4614-9924-0c796bc1c727 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:16.816162 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3116fcc-13ca-4614-9924-0c796bc1c727 admin admin] PATH_INFO: `/v3/users/b33e817e81024aefa8ab6ba36c99325b` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:16.817974 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3116fcc-13ca-4614-9924-0c796bc1c727 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b33e817e81024aefa8ab6ba36c99325b)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:16.819980 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3116fcc-13ca-4614-9924-0c796bc1c727 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:16.837935 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-78fefd3c-04aa-413d-b3fd-07cacccedf27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8c87f5bebf54161b9193c449b486c51', 'request_id': 'req-78fefd3c-04aa-413d-b3fd-07cacccedf27'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:16.846318 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-78fefd3c-04aa-413d-b3fd-07cacccedf27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8c87f5bebf54161b9193c449b486c51', 'request_id': 'req-78fefd3c-04aa-413d-b3fd-07cacccedf27'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:16.857271 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-78fefd3c-04aa-413d-b3fd-07cacccedf27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8c87f5bebf54161b9193c449b486c51', 'request_id': 'req-78fefd3c-04aa-413d-b3fd-07cacccedf27'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:16.879197 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-78fefd3c-04aa-413d-b3fd-07cacccedf27 admin admin] The token cache is being invalidate because project b8c87f5bebf54161b9193c449b486c51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:02:16.879502 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-78fefd3c-04aa-413d-b3fd-07cacccedf27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:16.880434 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-78fefd3c-04aa-413d-b3fd-07cacccedf27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:16.882329 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 946/1839] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Oct 14 13:02:16 2022] DELETE /identity/v3/projects/b8c87f5bebf54161b9193c449b486c51 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:02:16.887157 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0308f567-364a-480f-b7f3-63851ab8963d None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:16.887579 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0308f567-364a-480f-b7f3-63851ab8963d None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:16.887926 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0308f567-364a-480f-b7f3-63851ab8963d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:16.888427 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-e3116fcc-13ca-4614-9924-0c796bc1c727 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b33e817e81024aefa8ab6ba36c99325b'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:16.896684 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-e3116fcc-13ca-4614-9924-0c796bc1c727 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b33e817e81024aefa8ab6ba36c99325b'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:16.897376 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-e3116fcc-13ca-4614-9924-0c796bc1c727 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b33e817e81024aefa8ab6ba36c99325b'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:16.905159 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-e3116fcc-13ca-4614-9924-0c796bc1c727 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b33e817e81024aefa8ab6ba36c99325b'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:16.914638 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-0308f567-364a-480f-b7f3-63851ab8963d None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:02:16.916036 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-0308f567-364a-480f-b7f3-63851ab8963d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:02:16.919295 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-e3116fcc-13ca-4614-9924-0c796bc1c727 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b33e817e81024aefa8ab6ba36c99325b'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:16.922685 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:02:16.930284 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 894/1840] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Oct 14 13:02:16 2022] DELETE /identity/v3/users/b33e817e81024aefa8ab6ba36c99325b => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:02:16.935802 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68760e97-657e-4144-90e8-71f736831e55 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:16.937325 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68760e97-657e-4144-90e8-71f736831e55 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:16.937605 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68760e97-657e-4144-90e8-71f736831e55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:16.963776 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-68760e97-657e-4144-90e8-71f736831e55 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:02:16.965120 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-68760e97-657e-4144-90e8-71f736831e55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:02:17.004439 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 947/1841] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:02:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 13:02:17.013943 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f252e3d8-8efd-4034-8ec7-c67896e3b09a None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:17.014274 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f252e3d8-8efd-4034-8ec7-c67896e3b09a None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:17.014557 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f252e3d8-8efd-4034-8ec7-c67896e3b09a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:17.035375 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-f252e3d8-8efd-4034-8ec7-c67896e3b09a None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:02:17.036803 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-f252e3d8-8efd-4034-8ec7-c67896e3b09a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:02:17.048006 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 895/1842] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:02:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 13:02:17.060929 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68760e97-657e-4144-90e8-71f736831e55 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:17.064144 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-68760e97-657e-4144-90e8-71f736831e55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:02:17.112754 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 948/1843] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:02:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:02:17.117130 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f252e3d8-8efd-4034-8ec7-c67896e3b09a None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:17.127492 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f252e3d8-8efd-4034-8ec7-c67896e3b09a None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:17.132809 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adc05c8-cbd2-4d93-b42e-360518c5cd3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:17.133445 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adc05c8-cbd2-4d93-b42e-360518c5cd3a admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:17.133748 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adc05c8-cbd2-4d93-b42e-360518c5cd3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:17.134066 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adc05c8-cbd2-4d93-b42e-360518c5cd3a admin admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:17.134665 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68760e97-657e-4144-90e8-71f736831e55 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:17.135346 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adc05c8-cbd2-4d93-b42e-360518c5cd3a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 13:02:17.135718 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adc05c8-cbd2-4d93-b42e-360518c5cd3a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:17.137478 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adc05c8-cbd2-4d93-b42e-360518c5cd3a admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:17.138811 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb357a4-4df5-42c3-8ae7-51cd40ccb510 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d483292f3a4794848fcacfba5b107e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:17.139598 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb357a4-4df5-42c3-8ae7-51cd40ccb510 service neutron] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:17.139876 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb357a4-4df5-42c3-8ae7-51cd40ccb510 service neutron] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:17.140149 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb357a4-4df5-42c3-8ae7-51cd40ccb510 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:17.149825 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb357a4-4df5-42c3-8ae7-51cd40ccb510 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:17.153249 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 949/1844] 10.222.0.17 () {58 vars in 1153 bytes} [Fri Oct 14 13:02:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 13:02:17.153403 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb357a4-4df5-42c3-8ae7-51cd40ccb510 service neutron] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:17.161821 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 896/1845] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:02:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 14 13:02:17.162023 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adc05c8-cbd2-4d93-b42e-360518c5cd3a admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:17.175437 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adc05c8-cbd2-4d93-b42e-360518c5cd3a admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:17.181770 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57f7db4-1d15-45b5-9129-d3f8371e1266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:17.182423 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57f7db4-1d15-45b5-9129-d3f8371e1266 admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:17.182703 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57f7db4-1d15-45b5-9129-d3f8371e1266 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:17.183102 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57f7db4-1d15-45b5-9129-d3f8371e1266 admin admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:17.183745 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57f7db4-1d15-45b5-9129-d3f8371e1266 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:17.185657 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57f7db4-1d15-45b5-9129-d3f8371e1266 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:17.215862 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 950/1846] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Oct 14 13:02:17 2022] POST /identity/v3/projects => generated 375 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 13:02:17.220858 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb357a4-4df5-42c3-8ae7-51cd40ccb510 service neutron] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:17.232684 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb357a4-4df5-42c3-8ae7-51cd40ccb510 service neutron] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:17.306686 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f6551d-3bbe-446a-91b0-78ece845768e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:17.307308 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f6551d-3bbe-446a-91b0-78ece845768e admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:17.307592 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f6551d-3bbe-446a-91b0-78ece845768e admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:17.307947 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f6551d-3bbe-446a-91b0-78ece845768e admin admin] PATH_INFO: `/v3/users` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:17.308609 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f6551d-3bbe-446a-91b0-78ece845768e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:17.310728 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f6551d-3bbe-446a-91b0-78ece845768e admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:17.336786 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 897/1847] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Oct 14 13:02:17 2022] POST /identity/v3/users => generated 288 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:02:17.343343 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57f7db4-1d15-45b5-9129-d3f8371e1266 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:17.350970 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:02:17.355472 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57f7db4-1d15-45b5-9129-d3f8371e1266 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:17.363075 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9d17dd-800e-42f2-90e0-05cd607c307d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:17.363690 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9d17dd-800e-42f2-90e0-05cd607c307d admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:17.364319 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9d17dd-800e-42f2-90e0-05cd607c307d admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:17.364665 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9d17dd-800e-42f2-90e0-05cd607c307d admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:17.365628 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9d17dd-800e-42f2-90e0-05cd607c307d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:17.367748 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9d17dd-800e-42f2-90e0-05cd607c307d admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:17.378156 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 951/1848] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:02:17 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:02:17.382050 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f6551d-3bbe-446a-91b0-78ece845768e admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:17.393095 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f6551d-3bbe-446a-91b0-78ece845768e admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:17.398105 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fdbd56-1d7e-4c1e-b9c0-881d5cdcb0f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:17.398746 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fdbd56-1d7e-4c1e-b9c0-881d5cdcb0f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:17.399024 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fdbd56-1d7e-4c1e-b9c0-881d5cdcb0f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:17.399296 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fdbd56-1d7e-4c1e-b9c0-881d5cdcb0f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:17.399932 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fdbd56-1d7e-4c1e-b9c0-881d5cdcb0f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:17.401550 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fdbd56-1d7e-4c1e-b9c0-881d5cdcb0f3 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:17.413117 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 898/1849] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:02:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:02:17.418707 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9d17dd-800e-42f2-90e0-05cd607c307d admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:17.428949 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9d17dd-800e-42f2-90e0-05cd607c307d admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:17.434293 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d985ed-ae98-451d-a873-1cf31b2aed3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:17.434949 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d985ed-ae98-451d-a873-1cf31b2aed3a admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:17.435516 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d985ed-ae98-451d-a873-1cf31b2aed3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:17.435795 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d985ed-ae98-451d-a873-1cf31b2aed3a admin admin] PATH_INFO: `/v3/projects/6c3c2b28728248bb88544d05674170ba/users/b1c40fa0550d43d7baf8821ffb170fc8/roles/5e8849303a75425b9eaa2681cc031af1` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:17.452888 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fdbd56-1d7e-4c1e-b9c0-881d5cdcb0f3 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:17.454998 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-13fdbd56-1d7e-4c1e-b9c0-881d5cdcb0f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:02:17.456859 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d985ed-ae98-451d-a873-1cf31b2aed3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c3c2b28728248bb88544d05674170ba, user_id=b1c40fa0550d43d7baf8821ffb170fc8, role_id=5e8849303a75425b9eaa2681cc031af1)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:17.459939 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d985ed-ae98-451d-a873-1cf31b2aed3a admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:17.473011 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fdbd56-1d7e-4c1e-b9c0-881d5cdcb0f3 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:17.478370 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15fe892-3ef9-4d07-9775-dbfe3b38932f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:17.479190 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15fe892-3ef9-4d07-9775-dbfe3b38932f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:17.479509 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15fe892-3ef9-4d07-9775-dbfe3b38932f admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:17.479848 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15fe892-3ef9-4d07-9775-dbfe3b38932f admin admin] PATH_INFO: `/v3/projects/9c4c73841c104a01b8a5a42111cbfa61` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:17.481720 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15fe892-3ef9-4d07-9775-dbfe3b38932f admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c4c73841c104a01b8a5a42111cbfa61)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:17.483872 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15fe892-3ef9-4d07-9775-dbfe3b38932f admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:17.497303 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 952/1850] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Oct 14 13:02:17 2022] PUT /identity/v3/projects/6c3c2b28728248bb88544d05674170ba/users/b1c40fa0550d43d7baf8821ffb170fc8/roles/5e8849303a75425b9eaa2681cc031af1 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:02:17.511648 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c184be-f0e8-43a2-8fc5-56fc36c535d4 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:17.512140 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c184be-f0e8-43a2-8fc5-56fc36c535d4 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:17.512421 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c184be-f0e8-43a2-8fc5-56fc36c535d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:17.514617 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:02:17.546919 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-f2c184be-f0e8-43a2-8fc5-56fc36c535d4 None None] MFA Rules not processed for user `b1c40fa0550d43d7baf8821ffb170fc8`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:02:17.548055 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-f2c184be-f0e8-43a2-8fc5-56fc36c535d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:02:17.556679 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-b15fe892-3ef9-4d07-9775-dbfe3b38932f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c4c73841c104a01b8a5a42111cbfa61', 'request_id': 'req-b15fe892-3ef9-4d07-9775-dbfe3b38932f'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:17.563968 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-b15fe892-3ef9-4d07-9775-dbfe3b38932f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c4c73841c104a01b8a5a42111cbfa61', 'request_id': 'req-b15fe892-3ef9-4d07-9775-dbfe3b38932f'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:17.571680 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-b15fe892-3ef9-4d07-9775-dbfe3b38932f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c4c73841c104a01b8a5a42111cbfa61', 'request_id': 'req-b15fe892-3ef9-4d07-9775-dbfe3b38932f'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:17.594997 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-b15fe892-3ef9-4d07-9775-dbfe3b38932f admin admin] The token cache is being invalidate because project 9c4c73841c104a01b8a5a42111cbfa61 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:02:17.595392 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-b15fe892-3ef9-4d07-9775-dbfe3b38932f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:17.596318 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-b15fe892-3ef9-4d07-9775-dbfe3b38932f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:17.597894 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 899/1851] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Oct 14 13:02:17 2022] DELETE /identity/v3/projects/9c4c73841c104a01b8a5a42111cbfa61 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 13:02:17.601944 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15fe892-3ef9-4d07-9775-dbfe3b38932f admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:17.603589 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-b15fe892-3ef9-4d07-9775-dbfe3b38932f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:02:17.624812 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 953/1852] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:02:17 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:02:17.636159 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c184be-f0e8-43a2-8fc5-56fc36c535d4 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:17.637851 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-f2c184be-f0e8-43a2-8fc5-56fc36c535d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:02:17.680067 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15fe892-3ef9-4d07-9775-dbfe3b38932f admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:17.686086 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c110bc-9a4e-4a81-a58c-e13ac8afc5b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:17.686806 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c110bc-9a4e-4a81-a58c-e13ac8afc5b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:17.687118 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c110bc-9a4e-4a81-a58c-e13ac8afc5b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:17.687549 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c110bc-9a4e-4a81-a58c-e13ac8afc5b7 admin admin] PATH_INFO: `/v3/users/f0a6f33e2e364343bb4201566cc07754` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:17.688757 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c110bc-9a4e-4a81-a58c-e13ac8afc5b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0a6f33e2e364343bb4201566cc07754)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:17.691013 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c110bc-9a4e-4a81-a58c-e13ac8afc5b7 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:17.702168 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c184be-f0e8-43a2-8fc5-56fc36c535d4 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:17.705831 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7b2f3f-5cf1-4a20-8bc1-995fdd407a39 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c3c564b8c548e4beef1cbfba2ad343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:17.706465 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7b2f3f-5cf1-4a20-8bc1-995fdd407a39 service cinder] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:17.706742 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7b2f3f-5cf1-4a20-8bc1-995fdd407a39 service cinder] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:17.707013 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7b2f3f-5cf1-4a20-8bc1-995fdd407a39 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:17.716473 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7b2f3f-5cf1-4a20-8bc1-995fdd407a39 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:17.718488 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7b2f3f-5cf1-4a20-8bc1-995fdd407a39 service cinder] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:17.731152 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 954/1853] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:02:17 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:02:17.747755 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-49c110bc-9a4e-4a81-a58c-e13ac8afc5b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0a6f33e2e364343bb4201566cc07754'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:17.755043 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-49c110bc-9a4e-4a81-a58c-e13ac8afc5b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0a6f33e2e364343bb4201566cc07754'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:17.755790 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-49c110bc-9a4e-4a81-a58c-e13ac8afc5b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0a6f33e2e364343bb4201566cc07754'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:17.764298 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-49c110bc-9a4e-4a81-a58c-e13ac8afc5b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0a6f33e2e364343bb4201566cc07754'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:17.776957 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-49c110bc-9a4e-4a81-a58c-e13ac8afc5b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0a6f33e2e364343bb4201566cc07754'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:17.783234 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 900/1854] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Oct 14 13:02:17 2022] DELETE /identity/v3/users/f0a6f33e2e364343bb4201566cc07754 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 13:02:18.173157 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7b2f3f-5cf1-4a20-8bc1-995fdd407a39 service cinder] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:18.187572 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7b2f3f-5cf1-4a20-8bc1-995fdd407a39 service cinder] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:18.190006 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c110bc-9a4e-4a81-a58c-e13ac8afc5b7 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:18.191681 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-49c110bc-9a4e-4a81-a58c-e13ac8afc5b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:02:18.222451 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:02:18.254565 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa9f4ed-b9c8-4906-a13c-00f1bf1889f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:18.255322 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa9f4ed-b9c8-4906-a13c-00f1bf1889f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:18.255600 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa9f4ed-b9c8-4906-a13c-00f1bf1889f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:18.255873 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa9f4ed-b9c8-4906-a13c-00f1bf1889f1 admin admin] PATH_INFO: `/v3/projects/3fe13341033f49ba89747f73e25d7ff7` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:18.257083 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa9f4ed-b9c8-4906-a13c-00f1bf1889f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3fe13341033f49ba89747f73e25d7ff7)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:18.259022 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa9f4ed-b9c8-4906-a13c-00f1bf1889f1 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:18.261481 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:02:18.268613 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c110bc-9a4e-4a81-a58c-e13ac8afc5b7 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:18.273357 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc4505f-7b14-496c-bd38-39130aaf7a7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:18.274185 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc4505f-7b14-496c-bd38-39130aaf7a7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:18.274474 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc4505f-7b14-496c-bd38-39130aaf7a7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:18.274773 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc4505f-7b14-496c-bd38-39130aaf7a7e admin admin] PATH_INFO: `/v3/users/0524418da6ee45c2b5c1e376b674d8d7` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:18.276128 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc4505f-7b14-496c-bd38-39130aaf7a7e admin admin] RBAC: Authorizing `identity:delete_user(user_id=0524418da6ee45c2b5c1e376b674d8d7)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:18.279079 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc4505f-7b14-496c-bd38-39130aaf7a7e admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:18.316663 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-aaa9f4ed-b9c8-4906-a13c-00f1bf1889f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3fe13341033f49ba89747f73e25d7ff7', 'request_id': 'req-aaa9f4ed-b9c8-4906-a13c-00f1bf1889f1'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:18.323965 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-aaa9f4ed-b9c8-4906-a13c-00f1bf1889f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3fe13341033f49ba89747f73e25d7ff7', 'request_id': 'req-aaa9f4ed-b9c8-4906-a13c-00f1bf1889f1'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:18.330893 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-aaa9f4ed-b9c8-4906-a13c-00f1bf1889f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3fe13341033f49ba89747f73e25d7ff7', 'request_id': 'req-aaa9f4ed-b9c8-4906-a13c-00f1bf1889f1'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:18.333553 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-7cc4505f-7b14-496c-bd38-39130aaf7a7e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0524418da6ee45c2b5c1e376b674d8d7'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:18.342187 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-7cc4505f-7b14-496c-bd38-39130aaf7a7e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0524418da6ee45c2b5c1e376b674d8d7'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:18.342880 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-7cc4505f-7b14-496c-bd38-39130aaf7a7e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0524418da6ee45c2b5c1e376b674d8d7'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:18.345029 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-aaa9f4ed-b9c8-4906-a13c-00f1bf1889f1 admin admin] The token cache is being invalidate because project 3fe13341033f49ba89747f73e25d7ff7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:02:18.345395 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-aaa9f4ed-b9c8-4906-a13c-00f1bf1889f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:18.346087 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-aaa9f4ed-b9c8-4906-a13c-00f1bf1889f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:18.347842 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 955/1855] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Oct 14 13:02:18 2022] DELETE /identity/v3/projects/3fe13341033f49ba89747f73e25d7ff7 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:02:18.351024 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-7cc4505f-7b14-496c-bd38-39130aaf7a7e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0524418da6ee45c2b5c1e376b674d8d7'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:18.353389 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44614892-64ca-4ef2-b204-590172183129 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:18.353766 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44614892-64ca-4ef2-b204-590172183129 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:18.354149 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44614892-64ca-4ef2-b204-590172183129 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:18.365791 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-7cc4505f-7b14-496c-bd38-39130aaf7a7e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0524418da6ee45c2b5c1e376b674d8d7'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:18.372707 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 901/1856] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Oct 14 13:02:18 2022] DELETE /identity/v3/users/0524418da6ee45c2b5c1e376b674d8d7 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 13:02:18.374737 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-44614892-64ca-4ef2-b204-590172183129 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:02:18.376040 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-44614892-64ca-4ef2-b204-590172183129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:02:18.377351 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b022978e-ba9f-4084-a0af-99b8f132a609 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:18.377738 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b022978e-ba9f-4084-a0af-99b8f132a609 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:18.378081 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b022978e-ba9f-4084-a0af-99b8f132a609 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:18.399250 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-b022978e-ba9f-4084-a0af-99b8f132a609 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:02:18.400393 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-b022978e-ba9f-4084-a0af-99b8f132a609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:02:18.438325 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 956/1857] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:02:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 13:02:18.446234 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037ec236-3e00-4e3f-92c2-cd9c962314d0 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:18.446524 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037ec236-3e00-4e3f-92c2-cd9c962314d0 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:18.446824 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037ec236-3e00-4e3f-92c2-cd9c962314d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:18.462436 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 902/1858] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:02:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 13:02:18.468109 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-037ec236-3e00-4e3f-92c2-cd9c962314d0 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:02:18.469339 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-037ec236-3e00-4e3f-92c2-cd9c962314d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:02:18.474241 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b022978e-ba9f-4084-a0af-99b8f132a609 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:18.475562 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-b022978e-ba9f-4084-a0af-99b8f132a609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:02:18.481420 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 957/1859] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:02:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 13:02:18.482103 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037ec236-3e00-4e3f-92c2-cd9c962314d0 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:18.491676 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037ec236-3e00-4e3f-92c2-cd9c962314d0 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:18.497878 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f33960b-6012-4766-a2fd-c9dde829294d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:18.498514 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f33960b-6012-4766-a2fd-c9dde829294d admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:18.498795 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f33960b-6012-4766-a2fd-c9dde829294d admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:18.499067 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f33960b-6012-4766-a2fd-c9dde829294d admin admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:18.499715 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f33960b-6012-4766-a2fd-c9dde829294d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 13:02:18.500016 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f33960b-6012-4766-a2fd-c9dde829294d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:18.501623 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f33960b-6012-4766-a2fd-c9dde829294d admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:18.518199 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 958/1860] 10.222.0.17 () {58 vars in 1153 bytes} [Fri Oct 14 13:02:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 13:02:18.519581 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f33960b-6012-4766-a2fd-c9dde829294d admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:18.532121 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f33960b-6012-4766-a2fd-c9dde829294d admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:18.535634 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:02:18.538305 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef67a12-93b6-4d7e-a607-6b9585b035d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:18.538994 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef67a12-93b6-4d7e-a607-6b9585b035d8 admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:18.539308 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef67a12-93b6-4d7e-a607-6b9585b035d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:18.539582 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef67a12-93b6-4d7e-a607-6b9585b035d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:18.540224 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef67a12-93b6-4d7e-a607-6b9585b035d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:18.542231 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef67a12-93b6-4d7e-a607-6b9585b035d8 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:18.548450 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b022978e-ba9f-4084-a0af-99b8f132a609 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:18.552531 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784dd246-7a25-4607-aee6-b02cc9bf127b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d483292f3a4794848fcacfba5b107e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:18.553145 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784dd246-7a25-4607-aee6-b02cc9bf127b service neutron] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:18.553441 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784dd246-7a25-4607-aee6-b02cc9bf127b service neutron] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:18.553712 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784dd246-7a25-4607-aee6-b02cc9bf127b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:18.563749 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784dd246-7a25-4607-aee6-b02cc9bf127b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:18.565315 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784dd246-7a25-4607-aee6-b02cc9bf127b service neutron] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:18.571707 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 959/1861] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Oct 14 13:02:18 2022] POST /identity/v3/projects => generated 375 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 13:02:18.576517 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef67a12-93b6-4d7e-a607-6b9585b035d8 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:18.578603 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 903/1862] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:02:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 14 13:02:18.632065 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:02:18.649095 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef67a12-93b6-4d7e-a607-6b9585b035d8 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:18.657511 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4626e2cd-fbfe-4e00-a3cb-c8ef2a79a67b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:18.658186 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4626e2cd-fbfe-4e00-a3cb-c8ef2a79a67b admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:18.658834 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4626e2cd-fbfe-4e00-a3cb-c8ef2a79a67b admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:18.658834 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4626e2cd-fbfe-4e00-a3cb-c8ef2a79a67b admin admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:18.659352 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4626e2cd-fbfe-4e00-a3cb-c8ef2a79a67b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:18.661561 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4626e2cd-fbfe-4e00-a3cb-c8ef2a79a67b admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:18.690073 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 960/1863] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Oct 14 13:02:18 2022] POST /identity/v3/users => generated 288 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 13:02:18.694008 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784dd246-7a25-4607-aee6-b02cc9bf127b service neutron] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:18.705418 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784dd246-7a25-4607-aee6-b02cc9bf127b service neutron] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:18.710224 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8273c31-2f47-4b9d-ace1-d9a565a8713c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:18.710817 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8273c31-2f47-4b9d-ace1-d9a565a8713c admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:18.711093 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8273c31-2f47-4b9d-ace1-d9a565a8713c admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:18.711362 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8273c31-2f47-4b9d-ace1-d9a565a8713c admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:18.712023 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8273c31-2f47-4b9d-ace1-d9a565a8713c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:18.713639 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8273c31-2f47-4b9d-ace1-d9a565a8713c admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:18.724384 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 904/1864] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:02:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 14 13:02:18.728239 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4626e2cd-fbfe-4e00-a3cb-c8ef2a79a67b admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:18.738324 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4626e2cd-fbfe-4e00-a3cb-c8ef2a79a67b admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:18.742934 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383501ac-f76f-47b1-ac2b-e8814934457b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:18.743529 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383501ac-f76f-47b1-ac2b-e8814934457b admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:18.743803 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383501ac-f76f-47b1-ac2b-e8814934457b admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:18.744073 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383501ac-f76f-47b1-ac2b-e8814934457b admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:18.744709 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383501ac-f76f-47b1-ac2b-e8814934457b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:18.747116 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383501ac-f76f-47b1-ac2b-e8814934457b admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:18.763397 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 961/1865] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:02:18 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:02:18.768555 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8273c31-2f47-4b9d-ace1-d9a565a8713c admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:18.784129 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8273c31-2f47-4b9d-ace1-d9a565a8713c admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:18.789007 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7282fce8-36bd-479a-8f2e-23d33ef1d6f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:18.789671 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7282fce8-36bd-479a-8f2e-23d33ef1d6f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:18.789951 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7282fce8-36bd-479a-8f2e-23d33ef1d6f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:18.790260 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7282fce8-36bd-479a-8f2e-23d33ef1d6f5 admin admin] PATH_INFO: `/v3/projects/4de1f98eda764690ac16acad95880fc7/users/a736106a67ad4a6a86e13c4eb6277854/roles/5e8849303a75425b9eaa2681cc031af1` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:18.808281 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7282fce8-36bd-479a-8f2e-23d33ef1d6f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4de1f98eda764690ac16acad95880fc7, user_id=a736106a67ad4a6a86e13c4eb6277854, role_id=5e8849303a75425b9eaa2681cc031af1)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:18.811562 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7282fce8-36bd-479a-8f2e-23d33ef1d6f5 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:18.828791 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 905/1866] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Oct 14 13:02:18 2022] PUT /identity/v3/projects/4de1f98eda764690ac16acad95880fc7/users/a736106a67ad4a6a86e13c4eb6277854/roles/5e8849303a75425b9eaa2681cc031af1 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 13:02:18.839243 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b198ee90-63d9-4679-bbd7-54c959b4753d None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:18.840222 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b198ee90-63d9-4679-bbd7-54c959b4753d None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:18.840699 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b198ee90-63d9-4679-bbd7-54c959b4753d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:18.873056 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-b198ee90-63d9-4679-bbd7-54c959b4753d None None] MFA Rules not processed for user `a736106a67ad4a6a86e13c4eb6277854`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:02:18.874354 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-b198ee90-63d9-4679-bbd7-54c959b4753d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:02:18.924976 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7282fce8-36bd-479a-8f2e-23d33ef1d6f5 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:18.929327 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-7282fce8-36bd-479a-8f2e-23d33ef1d6f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:02:18.991129 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 962/1867] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:02:18 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:02:19.002348 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b198ee90-63d9-4679-bbd7-54c959b4753d None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:19.003793 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-b198ee90-63d9-4679-bbd7-54c959b4753d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:02:19.013462 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7282fce8-36bd-479a-8f2e-23d33ef1d6f5 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:19.023123 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef99c3e-6a1f-44ca-9bdf-c946adf95ced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:19.024119 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef99c3e-6a1f-44ca-9bdf-c946adf95ced admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:19.024119 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef99c3e-6a1f-44ca-9bdf-c946adf95ced admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:19.024395 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef99c3e-6a1f-44ca-9bdf-c946adf95ced admin admin] PATH_INFO: `/v3/projects/fe4e7e95e6064df2afb2bbc92ce0bd1f` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:19.025956 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef99c3e-6a1f-44ca-9bdf-c946adf95ced admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe4e7e95e6064df2afb2bbc92ce0bd1f)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:19.028640 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef99c3e-6a1f-44ca-9bdf-c946adf95ced admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:19.086535 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-2ef99c3e-6a1f-44ca-9bdf-c946adf95ced admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe4e7e95e6064df2afb2bbc92ce0bd1f', 'request_id': 'req-2ef99c3e-6a1f-44ca-9bdf-c946adf95ced'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:19.095906 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b198ee90-63d9-4679-bbd7-54c959b4753d None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:19.104104 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-2ef99c3e-6a1f-44ca-9bdf-c946adf95ced admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe4e7e95e6064df2afb2bbc92ce0bd1f', 'request_id': 'req-2ef99c3e-6a1f-44ca-9bdf-c946adf95ced'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:19.112864 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-2ef99c3e-6a1f-44ca-9bdf-c946adf95ced admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe4e7e95e6064df2afb2bbc92ce0bd1f', 'request_id': 'req-2ef99c3e-6a1f-44ca-9bdf-c946adf95ced'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:19.135252 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-2ef99c3e-6a1f-44ca-9bdf-c946adf95ced admin admin] The token cache is being invalidate because project fe4e7e95e6064df2afb2bbc92ce0bd1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:02:19.135548 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-2ef99c3e-6a1f-44ca-9bdf-c946adf95ced admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:19.137380 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-2ef99c3e-6a1f-44ca-9bdf-c946adf95ced admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:19.139288 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 906/1868] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Oct 14 13:02:18 2022] DELETE /identity/v3/projects/fe4e7e95e6064df2afb2bbc92ce0bd1f => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:02:19.143316 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef99c3e-6a1f-44ca-9bdf-c946adf95ced admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:19.144723 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-2ef99c3e-6a1f-44ca-9bdf-c946adf95ced admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:02:19.160753 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136324a6-4f2a-4092-aeb7-bb1e0514f7c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c3c564b8c548e4beef1cbfba2ad343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:19.161522 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136324a6-4f2a-4092-aeb7-bb1e0514f7c7 service cinder] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:19.161993 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136324a6-4f2a-4092-aeb7-bb1e0514f7c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:19.162338 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136324a6-4f2a-4092-aeb7-bb1e0514f7c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:19.164224 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-136324a6-4f2a-4092-aeb7-bb1e0514f7c7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:02:19.204775 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:02:19.209655 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:02:19.239402 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef99c3e-6a1f-44ca-9bdf-c946adf95ced admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:19.246999 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9333c2-40f5-4755-9e72-63a00793681f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:19.247663 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9333c2-40f5-4755-9e72-63a00793681f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:19.248008 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9333c2-40f5-4755-9e72-63a00793681f admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:19.248313 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9333c2-40f5-4755-9e72-63a00793681f admin admin] PATH_INFO: `/v3/users/23dbc3414cb5444b97586a487eeb0e35` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:19.249587 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9333c2-40f5-4755-9e72-63a00793681f admin admin] RBAC: Authorizing `identity:delete_user(user_id=23dbc3414cb5444b97586a487eeb0e35)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:19.251662 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9333c2-40f5-4755-9e72-63a00793681f admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:19.259937 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136324a6-4f2a-4092-aeb7-bb1e0514f7c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:19.262005 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136324a6-4f2a-4092-aeb7-bb1e0514f7c7 service cinder] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:19.288886 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 963/1869] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:02:19 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 14 13:02:19.315501 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-be9333c2-40f5-4755-9e72-63a00793681f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23dbc3414cb5444b97586a487eeb0e35'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:19.324548 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-be9333c2-40f5-4755-9e72-63a00793681f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23dbc3414cb5444b97586a487eeb0e35'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:19.325292 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-be9333c2-40f5-4755-9e72-63a00793681f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23dbc3414cb5444b97586a487eeb0e35'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:19.335736 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-be9333c2-40f5-4755-9e72-63a00793681f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23dbc3414cb5444b97586a487eeb0e35'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:19.350908 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-be9333c2-40f5-4755-9e72-63a00793681f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23dbc3414cb5444b97586a487eeb0e35'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:19.359110 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 907/1870] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Oct 14 13:02:19 2022] DELETE /identity/v3/users/23dbc3414cb5444b97586a487eeb0e35 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:02:19.696985 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136324a6-4f2a-4092-aeb7-bb1e0514f7c7 service cinder] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:19.711696 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136324a6-4f2a-4092-aeb7-bb1e0514f7c7 service cinder] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:19.805608 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2182844d-1a46-44b7-ad8a-63bd3802a4d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:19.806475 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2182844d-1a46-44b7-ad8a-63bd3802a4d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:19.806807 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2182844d-1a46-44b7-ad8a-63bd3802a4d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:19.807059 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2182844d-1a46-44b7-ad8a-63bd3802a4d6 admin admin] PATH_INFO: `/v3/projects/185dae9da3fa4e1498391f35ae3804c7` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:19.808356 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2182844d-1a46-44b7-ad8a-63bd3802a4d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=185dae9da3fa4e1498391f35ae3804c7)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:19.810364 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2182844d-1a46-44b7-ad8a-63bd3802a4d6 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:19.863510 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-2182844d-1a46-44b7-ad8a-63bd3802a4d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '185dae9da3fa4e1498391f35ae3804c7', 'request_id': 'req-2182844d-1a46-44b7-ad8a-63bd3802a4d6'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:19.869550 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-2182844d-1a46-44b7-ad8a-63bd3802a4d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '185dae9da3fa4e1498391f35ae3804c7', 'request_id': 'req-2182844d-1a46-44b7-ad8a-63bd3802a4d6'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:19.876146 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-2182844d-1a46-44b7-ad8a-63bd3802a4d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '185dae9da3fa4e1498391f35ae3804c7', 'request_id': 'req-2182844d-1a46-44b7-ad8a-63bd3802a4d6'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:19.892092 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-2182844d-1a46-44b7-ad8a-63bd3802a4d6 admin admin] The token cache is being invalidate because project 185dae9da3fa4e1498391f35ae3804c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:02:19.892394 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-2182844d-1a46-44b7-ad8a-63bd3802a4d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:19.893168 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-2182844d-1a46-44b7-ad8a-63bd3802a4d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:19.901137 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 964/1871] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Oct 14 13:02:19 2022] DELETE /identity/v3/projects/185dae9da3fa4e1498391f35ae3804c7 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:02:19.901240 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9333c2-40f5-4755-9e72-63a00793681f admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:19.901240 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-be9333c2-40f5-4755-9e72-63a00793681f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:02:19.919962 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9333c2-40f5-4755-9e72-63a00793681f admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:20.037647 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0b8682-9fc1-46ba-89d0-b4781d7dade0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:20.038653 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0b8682-9fc1-46ba-89d0-b4781d7dade0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:20.038941 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0b8682-9fc1-46ba-89d0-b4781d7dade0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:20.039223 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0b8682-9fc1-46ba-89d0-b4781d7dade0 admin admin] PATH_INFO: `/v3/users/e969ae067ed2478a9913aa605516cbea` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:20.040412 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0b8682-9fc1-46ba-89d0-b4781d7dade0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e969ae067ed2478a9913aa605516cbea)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:20.043032 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0b8682-9fc1-46ba-89d0-b4781d7dade0 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:20.114038 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-7c0b8682-9fc1-46ba-89d0-b4781d7dade0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e969ae067ed2478a9913aa605516cbea'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:20.123635 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-7c0b8682-9fc1-46ba-89d0-b4781d7dade0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e969ae067ed2478a9913aa605516cbea'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:20.124452 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-7c0b8682-9fc1-46ba-89d0-b4781d7dade0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e969ae067ed2478a9913aa605516cbea'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:20.133295 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-7c0b8682-9fc1-46ba-89d0-b4781d7dade0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e969ae067ed2478a9913aa605516cbea'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:20.135021 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:02:20.156686 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-7c0b8682-9fc1-46ba-89d0-b4781d7dade0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e969ae067ed2478a9913aa605516cbea'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:20.163325 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 908/1872] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Oct 14 13:02:19 2022] DELETE /identity/v3/users/e969ae067ed2478a9913aa605516cbea => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 13:02:20.485798 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2182844d-1a46-44b7-ad8a-63bd3802a4d6 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:20.487222 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0b8682-9fc1-46ba-89d0-b4781d7dade0 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:20.487967 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-2182844d-1a46-44b7-ad8a-63bd3802a4d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:02:20.488861 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-7c0b8682-9fc1-46ba-89d0-b4781d7dade0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:02:20.500887 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2182844d-1a46-44b7-ad8a-63bd3802a4d6 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:20.562785 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0b8682-9fc1-46ba-89d0-b4781d7dade0 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:20.563006 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669df6ae-6a8b-4901-9886-67b631c654f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:20.563546 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669df6ae-6a8b-4901-9886-67b631c654f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:20.563823 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669df6ae-6a8b-4901-9886-67b631c654f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:20.564093 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669df6ae-6a8b-4901-9886-67b631c654f9 admin admin] PATH_INFO: `/v3/users/016aa1318fe34ea6a474f384924d9a1b` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:20.565515 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669df6ae-6a8b-4901-9886-67b631c654f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=016aa1318fe34ea6a474f384924d9a1b)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:20.567590 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669df6ae-6a8b-4901-9886-67b631c654f9 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:20.567731 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac12f02-2530-4533-9692-f202db2bd72d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:20.568467 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac12f02-2530-4533-9692-f202db2bd72d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:20.568746 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac12f02-2530-4533-9692-f202db2bd72d admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:20.569145 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:02:20.569281 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac12f02-2530-4533-9692-f202db2bd72d admin admin] PATH_INFO: `/v3/projects/12e392000b904409ba3f9505d94e9098` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:20.570544 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac12f02-2530-4533-9692-f202db2bd72d admin admin] RBAC: Authorizing `identity:delete_project(project_id=12e392000b904409ba3f9505d94e9098)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:20.572483 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac12f02-2530-4533-9692-f202db2bd72d admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:20.622869 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-669df6ae-6a8b-4901-9886-67b631c654f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '016aa1318fe34ea6a474f384924d9a1b'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:20.630252 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-669df6ae-6a8b-4901-9886-67b631c654f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '016aa1318fe34ea6a474f384924d9a1b'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:20.630944 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-669df6ae-6a8b-4901-9886-67b631c654f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '016aa1318fe34ea6a474f384924d9a1b'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:20.634912 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-eac12f02-2530-4533-9692-f202db2bd72d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12e392000b904409ba3f9505d94e9098', 'request_id': 'req-eac12f02-2530-4533-9692-f202db2bd72d'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:20.640664 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-669df6ae-6a8b-4901-9886-67b631c654f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '016aa1318fe34ea6a474f384924d9a1b'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:20.643409 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-eac12f02-2530-4533-9692-f202db2bd72d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12e392000b904409ba3f9505d94e9098', 'request_id': 'req-eac12f02-2530-4533-9692-f202db2bd72d'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:20.650356 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-eac12f02-2530-4533-9692-f202db2bd72d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12e392000b904409ba3f9505d94e9098', 'request_id': 'req-eac12f02-2530-4533-9692-f202db2bd72d'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:20.653819 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-669df6ae-6a8b-4901-9886-67b631c654f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '016aa1318fe34ea6a474f384924d9a1b'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:20.660551 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 965/1873] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Oct 14 13:02:20 2022] DELETE /identity/v3/users/016aa1318fe34ea6a474f384924d9a1b => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:02:20.665193 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe07747e-6641-4cea-8fe9-a025dd1e112b None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:20.665318 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-eac12f02-2530-4533-9692-f202db2bd72d admin admin] The token cache is being invalidate because project 12e392000b904409ba3f9505d94e9098 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:02:20.665477 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe07747e-6641-4cea-8fe9-a025dd1e112b None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:20.665609 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-eac12f02-2530-4533-9692-f202db2bd72d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:20.665814 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe07747e-6641-4cea-8fe9-a025dd1e112b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:20.666225 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-eac12f02-2530-4533-9692-f202db2bd72d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:20.668958 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 909/1874] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Oct 14 13:02:20 2022] DELETE /identity/v3/projects/12e392000b904409ba3f9505d94e9098 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:02:20.673738 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca9d12c-ec1b-441e-ad72-8ef4ce472ca8 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:20.674052 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca9d12c-ec1b-441e-ad72-8ef4ce472ca8 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:20.674352 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca9d12c-ec1b-441e-ad72-8ef4ce472ca8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:20.689535 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-fe07747e-6641-4cea-8fe9-a025dd1e112b None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:02:20.690712 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-fe07747e-6641-4cea-8fe9-a025dd1e112b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:02:20.699958 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-bca9d12c-ec1b-441e-ad72-8ef4ce472ca8 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:02:20.701173 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-bca9d12c-ec1b-441e-ad72-8ef4ce472ca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:02:20.770710 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 966/1875] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:02:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 13:02:20.776258 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 910/1876] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:02:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 13:02:20.783510 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe07747e-6641-4cea-8fe9-a025dd1e112b None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:20.785034 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-fe07747e-6641-4cea-8fe9-a025dd1e112b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:02:20.785285 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d338361f-8bf7-46f9-aa6a-b60dbae41008 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:20.785674 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d338361f-8bf7-46f9-aa6a-b60dbae41008 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:20.785950 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d338361f-8bf7-46f9-aa6a-b60dbae41008 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:20.807178 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-d338361f-8bf7-46f9-aa6a-b60dbae41008 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:02:20.808467 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-d338361f-8bf7-46f9-aa6a-b60dbae41008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:02:20.820479 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 911/1877] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:02:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:02:20.825930 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d338361f-8bf7-46f9-aa6a-b60dbae41008 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:20.832472 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:02:20.836827 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d338361f-8bf7-46f9-aa6a-b60dbae41008 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:20.844647 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5683019e-5740-402f-a261-46d49085a660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:20.845461 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5683019e-5740-402f-a261-46d49085a660 admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:20.845639 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5683019e-5740-402f-a261-46d49085a660 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:20.848392 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5683019e-5740-402f-a261-46d49085a660 admin admin] PATH_INFO: `/v3/domains` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:20.849466 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5683019e-5740-402f-a261-46d49085a660 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 13:02:20.849848 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5683019e-5740-402f-a261-46d49085a660 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:20.851630 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5683019e-5740-402f-a261-46d49085a660 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:20.871862 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 912/1878] 10.222.0.17 () {58 vars in 1153 bytes} [Fri Oct 14 13:02:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 13:02:20.872084 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe07747e-6641-4cea-8fe9-a025dd1e112b None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:20.873361 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac11220-8db6-4378-a2a8-a92b3add77ac None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:20.873650 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac11220-8db6-4378-a2a8-a92b3add77ac None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:20.873918 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac11220-8db6-4378-a2a8-a92b3add77ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:20.874153 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf48bbd-7ad1-4d70-93ed-abf463bf09d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d483292f3a4794848fcacfba5b107e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:20.874772 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf48bbd-7ad1-4d70-93ed-abf463bf09d4 service neutron] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:20.875060 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf48bbd-7ad1-4d70-93ed-abf463bf09d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:20.875338 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf48bbd-7ad1-4d70-93ed-abf463bf09d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:20.884966 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf48bbd-7ad1-4d70-93ed-abf463bf09d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:20.886496 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf48bbd-7ad1-4d70-93ed-abf463bf09d4 service neutron] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:20.892855 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-1ac11220-8db6-4378-a2a8-a92b3add77ac None None] MFA Rules not processed for user `a736106a67ad4a6a86e13c4eb6277854`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:02:20.894051 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-1ac11220-8db6-4378-a2a8-a92b3add77ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:02:20.896335 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 967/1879] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:02:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:02:20.897117 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf48bbd-7ad1-4d70-93ed-abf463bf09d4 service neutron] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:20.906728 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf48bbd-7ad1-4d70-93ed-abf463bf09d4 service neutron] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:20.911686 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2afadcf-af11-4426-b96b-7a2dbddab5d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:20.912477 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2afadcf-af11-4426-b96b-7a2dbddab5d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:20.912764 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2afadcf-af11-4426-b96b-7a2dbddab5d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:20.913210 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2afadcf-af11-4426-b96b-7a2dbddab5d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:20.914161 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2afadcf-af11-4426-b96b-7a2dbddab5d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:20.916137 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2afadcf-af11-4426-b96b-7a2dbddab5d5 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:20.943605 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:02:20.952530 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 968/1880] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Oct 14 13:02:20 2022] POST /identity/v3/projects => generated 385 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:02:20.956892 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2afadcf-af11-4426-b96b-7a2dbddab5d5 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:20.965259 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 913/1881] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:02:20 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:02:21.039099 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2afadcf-af11-4426-b96b-7a2dbddab5d5 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:21.045799 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91a190a-b7f6-4cb4-94dc-150542f11dbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:21.046470 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91a190a-b7f6-4cb4-94dc-150542f11dbb admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:21.046748 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91a190a-b7f6-4cb4-94dc-150542f11dbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:21.047021 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91a190a-b7f6-4cb4-94dc-150542f11dbb admin admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:21.047670 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91a190a-b7f6-4cb4-94dc-150542f11dbb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:21.049669 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91a190a-b7f6-4cb4-94dc-150542f11dbb admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:21.098835 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 969/1882] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Oct 14 13:02:20 2022] POST /identity/v3/users => generated 293 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 13:02:21.107692 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac11220-8db6-4378-a2a8-a92b3add77ac None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:21.120546 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac11220-8db6-4378-a2a8-a92b3add77ac None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:21.126412 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c86ab2b-4dba-45f8-91d3-8af69678abe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:21.127029 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c86ab2b-4dba-45f8-91d3-8af69678abe4 admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:21.127308 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c86ab2b-4dba-45f8-91d3-8af69678abe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:21.127578 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c86ab2b-4dba-45f8-91d3-8af69678abe4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:21.128372 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c86ab2b-4dba-45f8-91d3-8af69678abe4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:21.130008 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c86ab2b-4dba-45f8-91d3-8af69678abe4 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:21.142217 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 914/1883] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:02:21 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:02:21.146530 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91a190a-b7f6-4cb4-94dc-150542f11dbb admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:21.159115 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91a190a-b7f6-4cb4-94dc-150542f11dbb admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:21.164222 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1a3dff-831f-4bc5-87dd-02116be9a22d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:21.164851 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1a3dff-831f-4bc5-87dd-02116be9a22d admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:21.165131 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1a3dff-831f-4bc5-87dd-02116be9a22d admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:21.169027 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1a3dff-831f-4bc5-87dd-02116be9a22d admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:21.177610 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1a3dff-831f-4bc5-87dd-02116be9a22d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:21.183343 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1a3dff-831f-4bc5-87dd-02116be9a22d admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:21.202311 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 970/1884] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:02:21 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:02:21.202922 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c86ab2b-4dba-45f8-91d3-8af69678abe4 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:21.203427 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1a3dff-831f-4bc5-87dd-02116be9a22d admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:21.205346 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-6c86ab2b-4dba-45f8-91d3-8af69678abe4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:02:21.214971 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1a3dff-831f-4bc5-87dd-02116be9a22d admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:21.220205 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faff2df5-ae21-4582-a3c8-3443a06a4db1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:21.221162 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faff2df5-ae21-4582-a3c8-3443a06a4db1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:21.221568 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faff2df5-ae21-4582-a3c8-3443a06a4db1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:21.221944 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faff2df5-ae21-4582-a3c8-3443a06a4db1 admin admin] PATH_INFO: `/v3/projects/5a605b9ac6214846bd94462f3fba325b/users/a6e571ee68e443e5b3e31adc3477e80d/roles/5e8849303a75425b9eaa2681cc031af1` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:21.227340 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c86ab2b-4dba-45f8-91d3-8af69678abe4 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:21.235546 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663de261-d712-4f64-9035-27cdef42d963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:21.236932 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663de261-d712-4f64-9035-27cdef42d963 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:21.237526 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663de261-d712-4f64-9035-27cdef42d963 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:21.237962 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663de261-d712-4f64-9035-27cdef42d963 admin admin] PATH_INFO: `/v3/users/b1c40fa0550d43d7baf8821ffb170fc8` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:21.239756 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663de261-d712-4f64-9035-27cdef42d963 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1c40fa0550d43d7baf8821ffb170fc8)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:21.241930 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663de261-d712-4f64-9035-27cdef42d963 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:21.244384 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faff2df5-ae21-4582-a3c8-3443a06a4db1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a605b9ac6214846bd94462f3fba325b, user_id=a6e571ee68e443e5b3e31adc3477e80d, role_id=5e8849303a75425b9eaa2681cc031af1)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:21.248202 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faff2df5-ae21-4582-a3c8-3443a06a4db1 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:21.274603 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 971/1885] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Oct 14 13:02:21 2022] PUT /identity/v3/projects/5a605b9ac6214846bd94462f3fba325b/users/a6e571ee68e443e5b3e31adc3477e80d/roles/5e8849303a75425b9eaa2681cc031af1 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:02:21.287085 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46184d11-a017-4607-8f49-7757038d81ac None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:21.287394 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46184d11-a017-4607-8f49-7757038d81ac None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:21.287702 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46184d11-a017-4607-8f49-7757038d81ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:21.338766 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-663de261-d712-4f64-9035-27cdef42d963 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1c40fa0550d43d7baf8821ffb170fc8'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:21.352020 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-46184d11-a017-4607-8f49-7757038d81ac None None] MFA Rules not processed for user `a6e571ee68e443e5b3e31adc3477e80d`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:02:21.354453 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-46184d11-a017-4607-8f49-7757038d81ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:02:21.363262 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-663de261-d712-4f64-9035-27cdef42d963 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1c40fa0550d43d7baf8821ffb170fc8'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:21.364144 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-663de261-d712-4f64-9035-27cdef42d963 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1c40fa0550d43d7baf8821ffb170fc8'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:21.373710 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-663de261-d712-4f64-9035-27cdef42d963 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1c40fa0550d43d7baf8821ffb170fc8'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:21.389656 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-663de261-d712-4f64-9035-27cdef42d963 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1c40fa0550d43d7baf8821ffb170fc8'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:21.396497 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 915/1886] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Oct 14 13:02:21 2022] DELETE /identity/v3/users/b1c40fa0550d43d7baf8821ffb170fc8 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:02:21.398997 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663de261-d712-4f64-9035-27cdef42d963 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:21.401201 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-663de261-d712-4f64-9035-27cdef42d963 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:02:21.435548 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 972/1887] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:02:21 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:02:21.436847 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50756e53-3e68-4e8e-bd93-f3613d457488 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:21.441157 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50756e53-3e68-4e8e-bd93-f3613d457488 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:21.441157 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50756e53-3e68-4e8e-bd93-f3613d457488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:21.461885 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-50756e53-3e68-4e8e-bd93-f3613d457488 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:02:21.463135 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-50756e53-3e68-4e8e-bd93-f3613d457488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:02:21.475748 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:02:21.480833 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663de261-d712-4f64-9035-27cdef42d963 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:21.488283 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31fda9c-10a7-4081-9895-ad47ed281fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:21.489555 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31fda9c-10a7-4081-9895-ad47ed281fcc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:21.489917 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31fda9c-10a7-4081-9895-ad47ed281fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:21.490311 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31fda9c-10a7-4081-9895-ad47ed281fcc admin admin] PATH_INFO: `/v3/projects/afbcbc21db5e4dfead6d26ea178b8b11` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:21.492006 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31fda9c-10a7-4081-9895-ad47ed281fcc admin admin] RBAC: Authorizing `identity:delete_project(project_id=afbcbc21db5e4dfead6d26ea178b8b11)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:21.494263 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31fda9c-10a7-4081-9895-ad47ed281fcc admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:21.509932 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:02:21.535447 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 973/1888] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:02:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:02:21.539954 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50756e53-3e68-4e8e-bd93-f3613d457488 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:21.541324 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-50756e53-3e68-4e8e-bd93-f3613d457488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:02:21.546947 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-b31fda9c-10a7-4081-9895-ad47ed281fcc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'afbcbc21db5e4dfead6d26ea178b8b11', 'request_id': 'req-b31fda9c-10a7-4081-9895-ad47ed281fcc'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:21.554329 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-b31fda9c-10a7-4081-9895-ad47ed281fcc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'afbcbc21db5e4dfead6d26ea178b8b11', 'request_id': 'req-b31fda9c-10a7-4081-9895-ad47ed281fcc'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:21.554761 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50756e53-3e68-4e8e-bd93-f3613d457488 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:21.561604 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-b31fda9c-10a7-4081-9895-ad47ed281fcc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'afbcbc21db5e4dfead6d26ea178b8b11', 'request_id': 'req-b31fda9c-10a7-4081-9895-ad47ed281fcc'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:21.583152 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-b31fda9c-10a7-4081-9895-ad47ed281fcc admin admin] The token cache is being invalidate because project afbcbc21db5e4dfead6d26ea178b8b11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:02:21.583803 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-b31fda9c-10a7-4081-9895-ad47ed281fcc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:21.584689 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-b31fda9c-10a7-4081-9895-ad47ed281fcc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:21.590417 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 916/1889] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Oct 14 13:02:21 2022] DELETE /identity/v3/projects/afbcbc21db5e4dfead6d26ea178b8b11 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:02:21.590417 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31fda9c-10a7-4081-9895-ad47ed281fcc admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:21.590932 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-b31fda9c-10a7-4081-9895-ad47ed281fcc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:02:21.637233 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b7c3ea-b864-43b4-96ee-0565d9c96f32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:21.637945 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b7c3ea-b864-43b4-96ee-0565d9c96f32 admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:21.638327 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b7c3ea-b864-43b4-96ee-0565d9c96f32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:21.639080 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b7c3ea-b864-43b4-96ee-0565d9c96f32 admin admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:21.639372 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b7c3ea-b864-43b4-96ee-0565d9c96f32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:21.641370 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b7c3ea-b864-43b4-96ee-0565d9c96f32 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:21.665467 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31fda9c-10a7-4081-9895-ad47ed281fcc admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:21.670692 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b2d0a0-0001-41b2-bc56-a560b148710d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d483292f3a4794848fcacfba5b107e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:21.671371 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b2d0a0-0001-41b2-bc56-a560b148710d service neutron] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:21.671696 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b2d0a0-0001-41b2-bc56-a560b148710d service neutron] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:21.676699 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 974/1890] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Oct 14 13:02:21 2022] POST /identity/v3/projects => generated 385 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:02:21.678344 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b2d0a0-0001-41b2-bc56-a560b148710d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:21.678574 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223b3fe2-600c-4405-a3e5-69ca7509dbbe None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:21.678957 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223b3fe2-600c-4405-a3e5-69ca7509dbbe None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:21.680397 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223b3fe2-600c-4405-a3e5-69ca7509dbbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:21.682292 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-74b2d0a0-0001-41b2-bc56-a560b148710d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:02:21.699501 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b2d0a0-0001-41b2-bc56-a560b148710d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:21.701187 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b2d0a0-0001-41b2-bc56-a560b148710d service neutron] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:21.702927 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-223b3fe2-600c-4405-a3e5-69ca7509dbbe None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:02:21.704327 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-223b3fe2-600c-4405-a3e5-69ca7509dbbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:02:21.712606 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 917/1891] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:02:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:02:21.713518 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b2d0a0-0001-41b2-bc56-a560b148710d service neutron] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:21.715534 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-74b2d0a0-0001-41b2-bc56-a560b148710d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:02:21.730800 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b2d0a0-0001-41b2-bc56-a560b148710d service neutron] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:21.782643 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 975/1892] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:02:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:02:21.792856 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ea2131-8581-4df9-b464-dc8505a350aa None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:21.793265 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ea2131-8581-4df9-b464-dc8505a350aa None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:21.793554 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ea2131-8581-4df9-b464-dc8505a350aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:21.817253 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-b9ea2131-8581-4df9-b464-dc8505a350aa None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:02:21.818530 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-b9ea2131-8581-4df9-b464-dc8505a350aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:02:21.828170 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 976/1893] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:02:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:02:21.833289 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ea2131-8581-4df9-b464-dc8505a350aa None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:21.834805 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2695732-66ce-4d38-8ea6-6525e0f56aa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:21.835516 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2695732-66ce-4d38-8ea6-6525e0f56aa7 admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:21.835909 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2695732-66ce-4d38-8ea6-6525e0f56aa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:21.836237 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2695732-66ce-4d38-8ea6-6525e0f56aa7 admin admin] PATH_INFO: `/v3/users` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:21.837020 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2695732-66ce-4d38-8ea6-6525e0f56aa7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:21.840355 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2695732-66ce-4d38-8ea6-6525e0f56aa7 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:21.843180 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ea2131-8581-4df9-b464-dc8505a350aa None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:21.850641 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f5953b-4356-40c6-8cbf-065dccadaefe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:21.851266 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f5953b-4356-40c6-8cbf-065dccadaefe admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:21.851549 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f5953b-4356-40c6-8cbf-065dccadaefe admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:21.851827 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f5953b-4356-40c6-8cbf-065dccadaefe admin admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:21.852489 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f5953b-4356-40c6-8cbf-065dccadaefe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 13:02:21.852800 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f5953b-4356-40c6-8cbf-065dccadaefe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:21.855216 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f5953b-4356-40c6-8cbf-065dccadaefe admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:21.869990 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 977/1894] 10.222.0.17 () {58 vars in 1153 bytes} [Fri Oct 14 13:02:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 13:02:21.873079 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 918/1895] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Oct 14 13:02:21 2022] POST /identity/v3/users => generated 293 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:02:21.875321 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2695732-66ce-4d38-8ea6-6525e0f56aa7 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:21.889932 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f5953b-4356-40c6-8cbf-065dccadaefe admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:21.897033 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2695732-66ce-4d38-8ea6-6525e0f56aa7 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:21.903824 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f5953b-4356-40c6-8cbf-065dccadaefe admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:21.909787 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1de389-8362-4676-9889-a99c0b7dcd2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:21.910243 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1f06b2-6271-4230-99d1-9bd71d1f825a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:21.910872 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1f06b2-6271-4230-99d1-9bd71d1f825a admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:21.911153 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1f06b2-6271-4230-99d1-9bd71d1f825a admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:21.911429 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1f06b2-6271-4230-99d1-9bd71d1f825a admin admin] PATH_INFO: `/v3/projects` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:21.911660 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1de389-8362-4676-9889-a99c0b7dcd2c admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:21.912075 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1f06b2-6271-4230-99d1-9bd71d1f825a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:21.912313 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1de389-8362-4676-9889-a99c0b7dcd2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:21.912763 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1de389-8362-4676-9889-a99c0b7dcd2c admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:21.913607 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1de389-8362-4676-9889-a99c0b7dcd2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:21.914029 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1f06b2-6271-4230-99d1-9bd71d1f825a admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:21.915445 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1de389-8362-4676-9889-a99c0b7dcd2c admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:21.942910 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 978/1896] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:02:21 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 14 13:02:21.943973 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1de389-8362-4676-9889-a99c0b7dcd2c admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:21.954675 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1de389-8362-4676-9889-a99c0b7dcd2c admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:21.960196 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:02:21.960660 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2e4f10-e3c6-4002-aa50-b0cbbb92a8f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:21.961619 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2e4f10-e3c6-4002-aa50-b0cbbb92a8f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:21.961966 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2e4f10-e3c6-4002-aa50-b0cbbb92a8f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:21.962213 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2e4f10-e3c6-4002-aa50-b0cbbb92a8f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:21.963042 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2e4f10-e3c6-4002-aa50-b0cbbb92a8f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:21.965439 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2e4f10-e3c6-4002-aa50-b0cbbb92a8f6 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:21.975419 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 919/1897] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Oct 14 13:02:21 2022] POST /identity/v3/projects => generated 373 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 13:02:21.978935 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1f06b2-6271-4230-99d1-9bd71d1f825a admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:21.984516 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 979/1898] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:02:21 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 14 13:02:21.990831 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2e4f10-e3c6-4002-aa50-b0cbbb92a8f6 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:22.009869 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2e4f10-e3c6-4002-aa50-b0cbbb92a8f6 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:22.052415 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:02:22.072037 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1f06b2-6271-4230-99d1-9bd71d1f825a admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:22.078271 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45da44ba-ca3e-45b6-9d7c-230cccd2c7a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:22.079480 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45da44ba-ca3e-45b6-9d7c-230cccd2c7a0 admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:22.079919 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45da44ba-ca3e-45b6-9d7c-230cccd2c7a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:22.080521 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45da44ba-ca3e-45b6-9d7c-230cccd2c7a0 admin admin] PATH_INFO: `/v3/users` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:22.081467 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45da44ba-ca3e-45b6-9d7c-230cccd2c7a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:22.090963 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45da44ba-ca3e-45b6-9d7c-230cccd2c7a0 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:22.115068 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a589ec-23d3-4921-887a-2b733f3e1404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:22.116075 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a589ec-23d3-4921-887a-2b733f3e1404 admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:22.116677 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a589ec-23d3-4921-887a-2b733f3e1404 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:22.117255 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a589ec-23d3-4921-887a-2b733f3e1404 admin admin] PATH_INFO: `/v3/projects/afad328596c742bbb4e1f23b5f5e5068/users/4584a45396b1456db6c9d61bde0222fa/roles/5e8849303a75425b9eaa2681cc031af1` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:22.125269 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 920/1899] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Oct 14 13:02:21 2022] POST /identity/v3/users => generated 287 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:02:22.125269 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45da44ba-ca3e-45b6-9d7c-230cccd2c7a0 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:22.125886 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-45da44ba-ca3e-45b6-9d7c-230cccd2c7a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:02:22.138829 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a589ec-23d3-4921-887a-2b733f3e1404 admin admin] RBAC: Authorizing `identity:create_grant(project_id=afad328596c742bbb4e1f23b5f5e5068, user_id=4584a45396b1456db6c9d61bde0222fa, role_id=5e8849303a75425b9eaa2681cc031af1)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:22.139349 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45da44ba-ca3e-45b6-9d7c-230cccd2c7a0 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:22.142045 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a589ec-23d3-4921-887a-2b733f3e1404 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:22.144882 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa0c835-5848-4a35-9ddb-defbc5fb0fbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:22.145463 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa0c835-5848-4a35-9ddb-defbc5fb0fbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:22.145749 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa0c835-5848-4a35-9ddb-defbc5fb0fbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:22.146026 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa0c835-5848-4a35-9ddb-defbc5fb0fbf admin admin] PATH_INFO: `/v3/projects/6c3c2b28728248bb88544d05674170ba` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:22.147798 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa0c835-5848-4a35-9ddb-defbc5fb0fbf admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c3c2b28728248bb88544d05674170ba)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:22.150548 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa0c835-5848-4a35-9ddb-defbc5fb0fbf admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:22.167175 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 980/1900] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Oct 14 13:02:21 2022] PUT /identity/v3/projects/afad328596c742bbb4e1f23b5f5e5068/users/4584a45396b1456db6c9d61bde0222fa/roles/5e8849303a75425b9eaa2681cc031af1 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:02:22.168394 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a589ec-23d3-4921-887a-2b733f3e1404 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:22.229851 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-5fa0c835-5848-4a35-9ddb-defbc5fb0fbf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c3c2b28728248bb88544d05674170ba', 'request_id': 'req-5fa0c835-5848-4a35-9ddb-defbc5fb0fbf'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:22.236827 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-5fa0c835-5848-4a35-9ddb-defbc5fb0fbf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c3c2b28728248bb88544d05674170ba', 'request_id': 'req-5fa0c835-5848-4a35-9ddb-defbc5fb0fbf'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:22.249371 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-5fa0c835-5848-4a35-9ddb-defbc5fb0fbf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c3c2b28728248bb88544d05674170ba', 'request_id': 'req-5fa0c835-5848-4a35-9ddb-defbc5fb0fbf'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:22.265305 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-5fa0c835-5848-4a35-9ddb-defbc5fb0fbf admin admin] The token cache is being invalidate because project 6c3c2b28728248bb88544d05674170ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:02:22.265599 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-5fa0c835-5848-4a35-9ddb-defbc5fb0fbf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:22.267567 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-5fa0c835-5848-4a35-9ddb-defbc5fb0fbf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:22.267706 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a589ec-23d3-4921-887a-2b733f3e1404 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:22.269354 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 921/1901] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Oct 14 13:02:22 2022] DELETE /identity/v3/projects/6c3c2b28728248bb88544d05674170ba => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:02:22.270568 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571552a3-e4b8-48db-b4e3-d561df435f64 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:22.270849 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571552a3-e4b8-48db-b4e3-d561df435f64 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:22.271126 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571552a3-e4b8-48db-b4e3-d561df435f64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:22.300912 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-571552a3-e4b8-48db-b4e3-d561df435f64 None None] MFA Rules not processed for user `4584a45396b1456db6c9d61bde0222fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:02:22.302346 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-571552a3-e4b8-48db-b4e3-d561df435f64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:02:22.334784 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126d223f-378a-4ae6-b074-fca7ab99e638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:22.335638 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126d223f-378a-4ae6-b074-fca7ab99e638 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:22.335940 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126d223f-378a-4ae6-b074-fca7ab99e638 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:22.336212 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126d223f-378a-4ae6-b074-fca7ab99e638 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:22.336853 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126d223f-378a-4ae6-b074-fca7ab99e638 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:22.338750 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126d223f-378a-4ae6-b074-fca7ab99e638 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:22.352621 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 981/1902] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:02:22 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:02:22.352621 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad9c846-fca5-41db-9aa5-c6a2f2948883 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:22.352621 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad9c846-fca5-41db-9aa5-c6a2f2948883 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:22.352621 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad9c846-fca5-41db-9aa5-c6a2f2948883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:22.373568 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:02:22.375968 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-fad9c846-fca5-41db-9aa5-c6a2f2948883 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:02:22.377721 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-fad9c846-fca5-41db-9aa5-c6a2f2948883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:02:22.379591 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 922/1903] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:02:22 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:02:22.380424 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571552a3-e4b8-48db-b4e3-d561df435f64 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:22.381955 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-571552a3-e4b8-48db-b4e3-d561df435f64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:02:22.392049 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 982/1904] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:02:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:02:22.393317 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad9c846-fca5-41db-9aa5-c6a2f2948883 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:22.396446 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-fad9c846-fca5-41db-9aa5-c6a2f2948883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:02:22.409311 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571552a3-e4b8-48db-b4e3-d561df435f64 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:22.413910 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad9c846-fca5-41db-9aa5-c6a2f2948883 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:22.415935 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dfa974-bef9-48ae-9708-fa6b21df518d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:22.416637 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dfa974-bef9-48ae-9708-fa6b21df518d admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:22.417047 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dfa974-bef9-48ae-9708-fa6b21df518d admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:22.417475 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dfa974-bef9-48ae-9708-fa6b21df518d admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:22.418582 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dfa974-bef9-48ae-9708-fa6b21df518d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:22.420830 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dfa974-bef9-48ae-9708-fa6b21df518d admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:22.421050 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b429de-b41b-4894-b5ee-3c712ebad1ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:22.421839 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b429de-b41b-4894-b5ee-3c712ebad1ff admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:22.422335 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b429de-b41b-4894-b5ee-3c712ebad1ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:22.423087 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b429de-b41b-4894-b5ee-3c712ebad1ff admin admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:22.423995 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b429de-b41b-4894-b5ee-3c712ebad1ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:22.425983 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b429de-b41b-4894-b5ee-3c712ebad1ff admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:22.437183 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 923/1905] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:02:22 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:02:22.438765 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565a9364-654c-497b-9c02-87c02f0ec72a None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:22.439389 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565a9364-654c-497b-9c02-87c02f0ec72a None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:22.439808 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565a9364-654c-497b-9c02-87c02f0ec72a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:22.462773 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-565a9364-654c-497b-9c02-87c02f0ec72a None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:02:22.464101 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-565a9364-654c-497b-9c02-87c02f0ec72a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:02:22.466292 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 983/1906] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Oct 14 13:02:22 2022] POST /identity/v3/projects => generated 385 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:02:22.467296 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b429de-b41b-4894-b5ee-3c712ebad1ff admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:22.511554 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:02:22.541913 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 924/1907] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:02:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:02:22.546746 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565a9364-654c-497b-9c02-87c02f0ec72a None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:22.557065 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565a9364-654c-497b-9c02-87c02f0ec72a None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:22.563832 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452fb80b-ed35-4cd0-90ad-ff7ca0e340b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:22.564696 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b429de-b41b-4894-b5ee-3c712ebad1ff admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:22.564824 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452fb80b-ed35-4cd0-90ad-ff7ca0e340b4 admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:22.565122 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452fb80b-ed35-4cd0-90ad-ff7ca0e340b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:22.565473 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452fb80b-ed35-4cd0-90ad-ff7ca0e340b4 admin admin] PATH_INFO: `/v3/users` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:22.566503 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452fb80b-ed35-4cd0-90ad-ff7ca0e340b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:22.570227 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d7c398-d7fa-4883-a5a4-6fa78bd5ef27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:22.570375 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452fb80b-ed35-4cd0-90ad-ff7ca0e340b4 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:22.571100 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d7c398-d7fa-4883-a5a4-6fa78bd5ef27 admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:22.571626 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d7c398-d7fa-4883-a5a4-6fa78bd5ef27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:22.571969 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d7c398-d7fa-4883-a5a4-6fa78bd5ef27 admin admin] PATH_INFO: `/v3/projects/b3c0cb983b444a74976e5bcec327bf1b/users/917cea44573d4fc6ae2db974d5dadde7/roles/5e8849303a75425b9eaa2681cc031af1` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:22.588563 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d7c398-d7fa-4883-a5a4-6fa78bd5ef27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3c0cb983b444a74976e5bcec327bf1b, user_id=917cea44573d4fc6ae2db974d5dadde7, role_id=5e8849303a75425b9eaa2681cc031af1)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:22.591961 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d7c398-d7fa-4883-a5a4-6fa78bd5ef27 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:22.598365 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 925/1908] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Oct 14 13:02:22 2022] POST /identity/v3/users => generated 299 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:02:22.599509 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452fb80b-ed35-4cd0-90ad-ff7ca0e340b4 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:22.609752 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 984/1909] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Oct 14 13:02:22 2022] PUT /identity/v3/projects/b3c0cb983b444a74976e5bcec327bf1b/users/917cea44573d4fc6ae2db974d5dadde7/roles/5e8849303a75425b9eaa2681cc031af1 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:02:22.611200 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452fb80b-ed35-4cd0-90ad-ff7ca0e340b4 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:22.611312 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d7c398-d7fa-4883-a5a4-6fa78bd5ef27 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:22.686914 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6b4de0-2d23-4d82-a0f0-4a05ed0ad0aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:22.687705 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6b4de0-2d23-4d82-a0f0-4a05ed0ad0aa admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:22.687993 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6b4de0-2d23-4d82-a0f0-4a05ed0ad0aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:22.688741 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6b4de0-2d23-4d82-a0f0-4a05ed0ad0aa admin admin] PATH_INFO: `/v3/domains` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:22.688931 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6b4de0-2d23-4d82-a0f0-4a05ed0ad0aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 13:02:22.690038 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6b4de0-2d23-4d82-a0f0-4a05ed0ad0aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:22.692194 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6b4de0-2d23-4d82-a0f0-4a05ed0ad0aa admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:22.695834 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d7c398-d7fa-4883-a5a4-6fa78bd5ef27 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:22.701898 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f1f64a-246b-4342-a85d-460acbc1cdc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:22.703290 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f1f64a-246b-4342-a85d-460acbc1cdc3 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:22.703644 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f1f64a-246b-4342-a85d-460acbc1cdc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:22.704420 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f1f64a-246b-4342-a85d-460acbc1cdc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:22.704915 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f1f64a-246b-4342-a85d-460acbc1cdc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:22.706740 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f1f64a-246b-4342-a85d-460acbc1cdc3 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:22.708580 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 926/1910] 10.222.0.17 () {58 vars in 1153 bytes} [Fri Oct 14 13:02:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 13:02:22.710067 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a78dbf-395f-4e6d-8eac-88a56faa7b0d None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:22.710397 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a78dbf-395f-4e6d-8eac-88a56faa7b0d None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:22.710726 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a78dbf-395f-4e6d-8eac-88a56faa7b0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:22.733458 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 985/1911] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:02:22 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:02:22.733458 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f1f64a-246b-4342-a85d-460acbc1cdc3 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:22.750997 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f1f64a-246b-4342-a85d-460acbc1cdc3 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:22.753293 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-17a78dbf-395f-4e6d-8eac-88a56faa7b0d None None] MFA Rules not processed for user `917cea44573d4fc6ae2db974d5dadde7`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:02:22.754832 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-17a78dbf-395f-4e6d-8eac-88a56faa7b0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:02:22.756907 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af45843-72ff-44a8-9776-f250b976e444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:22.757776 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af45843-72ff-44a8-9776-f250b976e444 admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:22.758073 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af45843-72ff-44a8-9776-f250b976e444 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:22.758376 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af45843-72ff-44a8-9776-f250b976e444 admin admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:22.759018 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af45843-72ff-44a8-9776-f250b976e444 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:22.761743 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af45843-72ff-44a8-9776-f250b976e444 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:22.800566 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 986/1912] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Oct 14 13:02:22 2022] POST /identity/v3/projects => generated 383 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:02:22.801532 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af45843-72ff-44a8-9776-f250b976e444 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:22.828383 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:02:22.832612 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 927/1913] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:02:22 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:02:22.833427 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a78dbf-395f-4e6d-8eac-88a56faa7b0d None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:22.844701 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a78dbf-395f-4e6d-8eac-88a56faa7b0d None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:22.892581 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af45843-72ff-44a8-9776-f250b976e444 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:22.897657 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957e92fc-2133-47da-ba3d-70cd9fd8ffd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:22.898448 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957e92fc-2133-47da-ba3d-70cd9fd8ffd0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:22.898867 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957e92fc-2133-47da-ba3d-70cd9fd8ffd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:22.899147 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957e92fc-2133-47da-ba3d-70cd9fd8ffd0 admin admin] PATH_INFO: `/v3/projects/9e0ca603c6bb4bc89bfef20270eb83bc/users/4a63e5bc0c434f70b8ec424a276dd3c9/roles/7f6e29e390bc41f7a9af17659a2e95d1` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:22.903283 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a10e94f-b538-442b-b257-b81fd40feb1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:22.903906 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a10e94f-b538-442b-b257-b81fd40feb1f admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:22.904191 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a10e94f-b538-442b-b257-b81fd40feb1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:22.904468 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a10e94f-b538-442b-b257-b81fd40feb1f admin admin] PATH_INFO: `/v3/users` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:22.905164 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a10e94f-b538-442b-b257-b81fd40feb1f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:22.907162 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a10e94f-b538-442b-b257-b81fd40feb1f admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:22.914724 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957e92fc-2133-47da-ba3d-70cd9fd8ffd0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e0ca603c6bb4bc89bfef20270eb83bc, user_id=4a63e5bc0c434f70b8ec424a276dd3c9, role_id=7f6e29e390bc41f7a9af17659a2e95d1)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:22.917673 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957e92fc-2133-47da-ba3d-70cd9fd8ffd0 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:22.929326 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 928/1914] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Oct 14 13:02:22 2022] POST /identity/v3/users => generated 292 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:02:22.930394 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a10e94f-b538-442b-b257-b81fd40feb1f admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:22.931206 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 987/1915] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Oct 14 13:02:22 2022] PUT /identity/v3/projects/9e0ca603c6bb4bc89bfef20270eb83bc/users/4a63e5bc0c434f70b8ec424a276dd3c9/roles/7f6e29e390bc41f7a9af17659a2e95d1 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:02:22.933924 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957e92fc-2133-47da-ba3d-70cd9fd8ffd0 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:22.942911 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:02:22.943069 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a10e94f-b538-442b-b257-b81fd40feb1f admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:23.000225 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957e92fc-2133-47da-ba3d-70cd9fd8ffd0 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:23.004913 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0244989-da99-41af-b09b-edb84ea0777e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:23.005412 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349d8589-1e87-4c76-8c72-4ac444cc68c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:23.005538 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0244989-da99-41af-b09b-edb84ea0777e admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:23.005800 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0244989-da99-41af-b09b-edb84ea0777e admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:23.006048 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349d8589-1e87-4c76-8c72-4ac444cc68c7 admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:23.006297 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0244989-da99-41af-b09b-edb84ea0777e admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:23.006382 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349d8589-1e87-4c76-8c72-4ac444cc68c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:23.006637 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349d8589-1e87-4c76-8c72-4ac444cc68c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:23.006738 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0244989-da99-41af-b09b-edb84ea0777e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:23.007267 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349d8589-1e87-4c76-8c72-4ac444cc68c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:23.008349 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0244989-da99-41af-b09b-edb84ea0777e admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:23.009193 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349d8589-1e87-4c76-8c72-4ac444cc68c7 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:23.023849 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 988/1916] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:02:22 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:02:23.023849 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0244989-da99-41af-b09b-edb84ea0777e admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:23.034788 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0244989-da99-41af-b09b-edb84ea0777e admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:23.041337 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 929/1917] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Oct 14 13:02:22 2022] POST /identity/v3/projects => generated 369 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:02:23.041337 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349d8589-1e87-4c76-8c72-4ac444cc68c7 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:23.043682 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b264bda-0001-4109-aadd-1193504d547a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:23.043986 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b264bda-0001-4109-aadd-1193504d547a admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:23.044213 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b264bda-0001-4109-aadd-1193504d547a admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:23.044424 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b264bda-0001-4109-aadd-1193504d547a admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:23.045080 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b264bda-0001-4109-aadd-1193504d547a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:23.046850 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b264bda-0001-4109-aadd-1193504d547a admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:23.060731 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 989/1918] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:02:23 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:02:23.060731 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b264bda-0001-4109-aadd-1193504d547a admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:23.072920 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b264bda-0001-4109-aadd-1193504d547a admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:23.111976 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349d8589-1e87-4c76-8c72-4ac444cc68c7 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:23.117494 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87937ea3-a853-4c0e-9045-4d0c74e28971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:23.118140 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87937ea3-a853-4c0e-9045-4d0c74e28971 admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:23.118427 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87937ea3-a853-4c0e-9045-4d0c74e28971 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:23.118703 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87937ea3-a853-4c0e-9045-4d0c74e28971 admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:23.119352 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87937ea3-a853-4c0e-9045-4d0c74e28971 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:23.122050 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87937ea3-a853-4c0e-9045-4d0c74e28971 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:23.133118 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 930/1919] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:02:23 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:02:23.142889 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87937ea3-a853-4c0e-9045-4d0c74e28971 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:23.163103 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba43245e-290b-4e35-b10e-e1efc47194fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:23.163764 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba43245e-290b-4e35-b10e-e1efc47194fc admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:23.164044 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba43245e-290b-4e35-b10e-e1efc47194fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:23.164317 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba43245e-290b-4e35-b10e-e1efc47194fc admin admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:23.164957 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba43245e-290b-4e35-b10e-e1efc47194fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:23.165308 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87937ea3-a853-4c0e-9045-4d0c74e28971 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:23.167658 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba43245e-290b-4e35-b10e-e1efc47194fc admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:23.173935 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e32f651-8d43-42e3-8787-85b7c1d61ad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:23.175449 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e32f651-8d43-42e3-8787-85b7c1d61ad7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:23.175790 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e32f651-8d43-42e3-8787-85b7c1d61ad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:23.176075 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e32f651-8d43-42e3-8787-85b7c1d61ad7 admin admin] PATH_INFO: `/v3/projects/9e0ca603c6bb4bc89bfef20270eb83bc/users/4a63e5bc0c434f70b8ec424a276dd3c9/roles/7f6e29e390bc41f7a9af17659a2e95d1` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:23.178720 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e32f651-8d43-42e3-8787-85b7c1d61ad7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e0ca603c6bb4bc89bfef20270eb83bc, user_id=4a63e5bc0c434f70b8ec424a276dd3c9, role_id=7f6e29e390bc41f7a9af17659a2e95d1)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:23.181934 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e32f651-8d43-42e3-8787-85b7c1d61ad7 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:23.185537 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:02:23.205754 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 931/1921] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Oct 14 13:02:23 2022] PUT /identity/v3/projects/9e0ca603c6bb4bc89bfef20270eb83bc/users/4a63e5bc0c434f70b8ec424a276dd3c9/roles/7f6e29e390bc41f7a9af17659a2e95d1 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:02:23.214988 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 990/1921] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Oct 14 13:02:23 2022] POST /identity/v3/users => generated 291 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:02:23.216066 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba43245e-290b-4e35-b10e-e1efc47194fc admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:23.217325 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e32f651-8d43-42e3-8787-85b7c1d61ad7 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:23.247852 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba43245e-290b-4e35-b10e-e1efc47194fc admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:23.320650 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e32f651-8d43-42e3-8787-85b7c1d61ad7 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:23.329483 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae69728-21fa-4352-814c-105179fdc72a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:23.330331 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae69728-21fa-4352-814c-105179fdc72a admin admin] REQUEST_METHOD: `PUT` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:23.330740 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae69728-21fa-4352-814c-105179fdc72a admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:23.331256 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae69728-21fa-4352-814c-105179fdc72a admin admin] PATH_INFO: `/v3/projects/0999aa9715a5402ba89c458e5bc20222/users/812b8524ea0f4f6da69fb76536f5c8fc/roles/5e8849303a75425b9eaa2681cc031af1` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:23.335760 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518a9c68-5311-46d3-b735-070501bf05fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:23.336652 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518a9c68-5311-46d3-b735-070501bf05fb admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:23.337757 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518a9c68-5311-46d3-b735-070501bf05fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:23.338173 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518a9c68-5311-46d3-b735-070501bf05fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:23.339478 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518a9c68-5311-46d3-b735-070501bf05fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:23.341491 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518a9c68-5311-46d3-b735-070501bf05fb admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:23.350704 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae69728-21fa-4352-814c-105179fdc72a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0999aa9715a5402ba89c458e5bc20222, user_id=812b8524ea0f4f6da69fb76536f5c8fc, role_id=5e8849303a75425b9eaa2681cc031af1)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:23.354061 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 991/1922] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:02:23 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:02:23.355938 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae69728-21fa-4352-814c-105179fdc72a admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:23.359158 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845d6a80-563d-46a5-b313-94925a16d967 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:23.359465 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845d6a80-563d-46a5-b313-94925a16d967 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:23.359731 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845d6a80-563d-46a5-b313-94925a16d967 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:23.376257 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 932/1923] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Oct 14 13:02:23 2022] PUT /identity/v3/projects/0999aa9715a5402ba89c458e5bc20222/users/812b8524ea0f4f6da69fb76536f5c8fc/roles/5e8849303a75425b9eaa2681cc031af1 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:02:23.376953 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae69728-21fa-4352-814c-105179fdc72a admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:23.403022 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-845d6a80-563d-46a5-b313-94925a16d967 None None] MFA Rules not processed for user `4a63e5bc0c434f70b8ec424a276dd3c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:02:23.404433 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-845d6a80-563d-46a5-b313-94925a16d967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:02:23.409789 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:02:23.450139 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae69728-21fa-4352-814c-105179fdc72a admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:23.454950 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8dfca4-4f99-40c4-9810-8c88f243cb90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:23.455617 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8dfca4-4f99-40c4-9810-8c88f243cb90 admin admin] REQUEST_METHOD: `PUT` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:23.455901 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8dfca4-4f99-40c4-9810-8c88f243cb90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:23.456180 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8dfca4-4f99-40c4-9810-8c88f243cb90 admin admin] PATH_INFO: `/v3/projects/34659a1c5f924117adcae53be9f05022/users/327e8f1f903c4798a4cc2d74ec2a3ce3/roles/7f6e29e390bc41f7a9af17659a2e95d1` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:23.472413 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8dfca4-4f99-40c4-9810-8c88f243cb90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=34659a1c5f924117adcae53be9f05022, user_id=327e8f1f903c4798a4cc2d74ec2a3ce3, role_id=7f6e29e390bc41f7a9af17659a2e95d1)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:23.475392 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8dfca4-4f99-40c4-9810-8c88f243cb90 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:23.480551 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 992/1924] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:02:23 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:02:23.482759 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda50e91-b806-473b-93ce-56b849d38ae6 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:23.483283 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda50e91-b806-473b-93ce-56b849d38ae6 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:23.483789 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda50e91-b806-473b-93ce-56b849d38ae6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:23.493862 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 933/1925] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Oct 14 13:02:23 2022] PUT /identity/v3/projects/34659a1c5f924117adcae53be9f05022/users/327e8f1f903c4798a4cc2d74ec2a3ce3/roles/7f6e29e390bc41f7a9af17659a2e95d1 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:02:23.495196 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8dfca4-4f99-40c4-9810-8c88f243cb90 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:23.497535 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-8c8dfca4-4f99-40c4-9810-8c88f243cb90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:02:23.522836 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-cda50e91-b806-473b-93ce-56b849d38ae6 None None] MFA Rules not processed for user `812b8524ea0f4f6da69fb76536f5c8fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:02:23.524070 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-cda50e91-b806-473b-93ce-56b849d38ae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:02:23.563038 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8dfca4-4f99-40c4-9810-8c88f243cb90 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:23.567090 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1db3443-2a7c-4920-8b7a-ea193d7ca61c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c3c564b8c548e4beef1cbfba2ad343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:23.567712 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1db3443-2a7c-4920-8b7a-ea193d7ca61c service cinder] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:23.567999 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1db3443-2a7c-4920-8b7a-ea193d7ca61c service cinder] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:23.568281 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1db3443-2a7c-4920-8b7a-ea193d7ca61c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:23.570234 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-b1db3443-2a7c-4920-8b7a-ea193d7ca61c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:02:23.586776 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:02:23.619331 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 993/1926] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:02:23 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:02:23.621606 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda50e91-b806-473b-93ce-56b849d38ae6 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:23.681144 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1db3443-2a7c-4920-8b7a-ea193d7ca61c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:23.684633 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1db3443-2a7c-4920-8b7a-ea193d7ca61c service cinder] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:23.702631 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 934/1927] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:02:23 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:02:23.703519 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1db3443-2a7c-4920-8b7a-ea193d7ca61c service cinder] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:23.705278 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-b1db3443-2a7c-4920-8b7a-ea193d7ca61c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:02:23.718890 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1db3443-2a7c-4920-8b7a-ea193d7ca61c service cinder] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:23.723439 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55aea9e-5dd4-46bd-8dea-3ce1b79adefa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c3c564b8c548e4beef1cbfba2ad343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:23.723974 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55aea9e-5dd4-46bd-8dea-3ce1b79adefa service cinder] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:23.724249 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55aea9e-5dd4-46bd-8dea-3ce1b79adefa service cinder] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:23.724586 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55aea9e-5dd4-46bd-8dea-3ce1b79adefa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:23.736086 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55aea9e-5dd4-46bd-8dea-3ce1b79adefa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:23.737463 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda50e91-b806-473b-93ce-56b849d38ae6 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:23.737585 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55aea9e-5dd4-46bd-8dea-3ce1b79adefa service cinder] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:23.750228 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 935/1928] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:02:23 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:02:23.751046 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6310fd4-2cac-4166-bbeb-c37557c96a73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:23.751771 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6310fd4-2cac-4166-bbeb-c37557c96a73 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:23.752058 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6310fd4-2cac-4166-bbeb-c37557c96a73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:23.753551 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6310fd4-2cac-4166-bbeb-c37557c96a73 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:23.754418 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6310fd4-2cac-4166-bbeb-c37557c96a73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:23.756062 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6310fd4-2cac-4166-bbeb-c37557c96a73 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:23.771196 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 994/1929] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:02:23 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:02:23.771912 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55aea9e-5dd4-46bd-8dea-3ce1b79adefa service cinder] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:23.786568 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55aea9e-5dd4-46bd-8dea-3ce1b79adefa service cinder] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:23.799453 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd75a673-9ec4-48a7-819d-75bf03a8e97a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:23.800220 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd75a673-9ec4-48a7-819d-75bf03a8e97a admin admin] REQUEST_METHOD: `PUT` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:23.800556 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd75a673-9ec4-48a7-819d-75bf03a8e97a admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:23.801015 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd75a673-9ec4-48a7-819d-75bf03a8e97a admin admin] PATH_INFO: `/v3/projects/34659a1c5f924117adcae53be9f05022/users/327e8f1f903c4798a4cc2d74ec2a3ce3/roles/7f6e29e390bc41f7a9af17659a2e95d1` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:23.811479 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd75a673-9ec4-48a7-819d-75bf03a8e97a admin admin] RBAC: Authorizing `identity:create_grant(project_id=34659a1c5f924117adcae53be9f05022, user_id=327e8f1f903c4798a4cc2d74ec2a3ce3, role_id=7f6e29e390bc41f7a9af17659a2e95d1)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:23.816582 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd75a673-9ec4-48a7-819d-75bf03a8e97a admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:23.838180 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 936/1930] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Oct 14 13:02:23 2022] PUT /identity/v3/projects/34659a1c5f924117adcae53be9f05022/users/327e8f1f903c4798a4cc2d74ec2a3ce3/roles/7f6e29e390bc41f7a9af17659a2e95d1 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:02:23.849068 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3f75dc-3fef-4795-9a44-4606ca8f0a8a None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:23.849346 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3f75dc-3fef-4795-9a44-4606ca8f0a8a None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:23.849622 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3f75dc-3fef-4795-9a44-4606ca8f0a8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:23.885998 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-5b3f75dc-3fef-4795-9a44-4606ca8f0a8a None None] MFA Rules not processed for user `327e8f1f903c4798a4cc2d74ec2a3ce3`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:02:23.887984 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-5b3f75dc-3fef-4795-9a44-4606ca8f0a8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:02:23.913482 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:02:24.018814 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 995/1931] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:02:23 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:02:24.074666 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd75a673-9ec4-48a7-819d-75bf03a8e97a admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:24.169344 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd75a673-9ec4-48a7-819d-75bf03a8e97a admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:24.175909 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9a6bae-1f7d-41f1-baff-333fdd4807c4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c3c564b8c548e4beef1cbfba2ad343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:24.176597 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9a6bae-1f7d-41f1-baff-333fdd4807c4 service cinder] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:24.176883 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9a6bae-1f7d-41f1-baff-333fdd4807c4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:24.177158 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9a6bae-1f7d-41f1-baff-333fdd4807c4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:24.198080 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9a6bae-1f7d-41f1-baff-333fdd4807c4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:24.208533 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9a6bae-1f7d-41f1-baff-333fdd4807c4 service cinder] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:24.221418 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 937/1932] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:02:24 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:02:24.341435 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3f75dc-3fef-4795-9a44-4606ca8f0a8a None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:24.352328 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3f75dc-3fef-4795-9a44-4606ca8f0a8a None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:24.357715 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8282975-ee3f-4b34-9416-889755cb8861 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c3c564b8c548e4beef1cbfba2ad343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:24.358457 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8282975-ee3f-4b34-9416-889755cb8861 service cinder] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:24.358815 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8282975-ee3f-4b34-9416-889755cb8861 service cinder] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:24.359206 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8282975-ee3f-4b34-9416-889755cb8861 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:24.421047 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8282975-ee3f-4b34-9416-889755cb8861 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:24.422726 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8282975-ee3f-4b34-9416-889755cb8861 service cinder] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:24.433212 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 996/1933] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:02:24 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:02:26.525018 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9a6bae-1f7d-41f1-baff-333fdd4807c4 service cinder] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:26.534319 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9a6bae-1f7d-41f1-baff-333fdd4807c4 service cinder] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:26.538140 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d31c9c8-6091-4688-aac2-3b2c542b4f3a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c3c564b8c548e4beef1cbfba2ad343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:26.538818 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d31c9c8-6091-4688-aac2-3b2c542b4f3a service cinder] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:26.539227 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d31c9c8-6091-4688-aac2-3b2c542b4f3a service cinder] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:26.539659 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d31c9c8-6091-4688-aac2-3b2c542b4f3a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:26.605393 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d31c9c8-6091-4688-aac2-3b2c542b4f3a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:26.606985 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d31c9c8-6091-4688-aac2-3b2c542b4f3a service cinder] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:26.617874 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 938/1934] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:02:26 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:02:27.203879 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8282975-ee3f-4b34-9416-889755cb8861 service cinder] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:27.212934 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8282975-ee3f-4b34-9416-889755cb8861 service cinder] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:27.218055 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f0f8fe-4218-4b3f-8476-9513af42a4d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c3c564b8c548e4beef1cbfba2ad343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:27.218702 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f0f8fe-4218-4b3f-8476-9513af42a4d7 service cinder] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:27.218989 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f0f8fe-4218-4b3f-8476-9513af42a4d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:27.219263 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f0f8fe-4218-4b3f-8476-9513af42a4d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:27.325435 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f0f8fe-4218-4b3f-8476-9513af42a4d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:27.327003 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f0f8fe-4218-4b3f-8476-9513af42a4d7 service cinder] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:27.340250 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 997/1935] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:02:27 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 14 13:02:27.629992 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d31c9c8-6091-4688-aac2-3b2c542b4f3a service cinder] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:27.669185 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:02:27.708382 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d31c9c8-6091-4688-aac2-3b2c542b4f3a service cinder] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:27.713595 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc1f424-b553-412f-a3a5-0de9946a2a5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:27.714211 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc1f424-b553-412f-a3a5-0de9946a2a5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:27.714504 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc1f424-b553-412f-a3a5-0de9946a2a5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:27.714777 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc1f424-b553-412f-a3a5-0de9946a2a5b admin admin] PATH_INFO: `/v3/users/812b8524ea0f4f6da69fb76536f5c8fc` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:27.715977 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc1f424-b553-412f-a3a5-0de9946a2a5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=812b8524ea0f4f6da69fb76536f5c8fc)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:27.717947 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc1f424-b553-412f-a3a5-0de9946a2a5b admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:27.767410 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-acc1f424-b553-412f-a3a5-0de9946a2a5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '812b8524ea0f4f6da69fb76536f5c8fc'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:27.774923 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-acc1f424-b553-412f-a3a5-0de9946a2a5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '812b8524ea0f4f6da69fb76536f5c8fc'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:27.775606 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-acc1f424-b553-412f-a3a5-0de9946a2a5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '812b8524ea0f4f6da69fb76536f5c8fc'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:27.783169 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-acc1f424-b553-412f-a3a5-0de9946a2a5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '812b8524ea0f4f6da69fb76536f5c8fc'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:27.796078 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-acc1f424-b553-412f-a3a5-0de9946a2a5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '812b8524ea0f4f6da69fb76536f5c8fc'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:27.802984 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 939/1936] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Oct 14 13:02:27 2022] DELETE /identity/v3/users/812b8524ea0f4f6da69fb76536f5c8fc => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:02:27.808320 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161e3a57-4ea0-4a8b-a78d-69cc2c94c711 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:27.808604 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161e3a57-4ea0-4a8b-a78d-69cc2c94c711 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:27.808878 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161e3a57-4ea0-4a8b-a78d-69cc2c94c711 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:27.828786 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-161e3a57-4ea0-4a8b-a78d-69cc2c94c711 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:02:27.829993 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-161e3a57-4ea0-4a8b-a78d-69cc2c94c711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:02:27.873787 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:02:27.892508 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 998/1937] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:02:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:02:27.902942 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc1f424-b553-412f-a3a5-0de9946a2a5b admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:27.904426 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-acc1f424-b553-412f-a3a5-0de9946a2a5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:02:27.961048 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc1f424-b553-412f-a3a5-0de9946a2a5b admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:27.965435 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f773f26b-180c-46b2-a82f-db455944c42d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d483292f3a4794848fcacfba5b107e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:27.966050 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f773f26b-180c-46b2-a82f-db455944c42d service neutron] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:27.966356 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f773f26b-180c-46b2-a82f-db455944c42d service neutron] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:27.966626 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f773f26b-180c-46b2-a82f-db455944c42d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:27.979995 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f773f26b-180c-46b2-a82f-db455944c42d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:27.981520 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f773f26b-180c-46b2-a82f-db455944c42d service neutron] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:27.991704 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 940/1938] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:02:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:02:28.279403 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161e3a57-4ea0-4a8b-a78d-69cc2c94c711 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:28.280825 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-161e3a57-4ea0-4a8b-a78d-69cc2c94c711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:02:28.295275 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161e3a57-4ea0-4a8b-a78d-69cc2c94c711 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:28.300089 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7ea112-f139-4f0d-802f-08c8fafdf617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:28.300727 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7ea112-f139-4f0d-802f-08c8fafdf617 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:28.301069 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7ea112-f139-4f0d-802f-08c8fafdf617 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:28.301269 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7ea112-f139-4f0d-802f-08c8fafdf617 admin admin] PATH_INFO: `/v3/projects/0999aa9715a5402ba89c458e5bc20222` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:28.302423 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7ea112-f139-4f0d-802f-08c8fafdf617 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0999aa9715a5402ba89c458e5bc20222)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:28.304914 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7ea112-f139-4f0d-802f-08c8fafdf617 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:28.355021 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-0d7ea112-f139-4f0d-802f-08c8fafdf617 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0999aa9715a5402ba89c458e5bc20222', 'request_id': 'req-0d7ea112-f139-4f0d-802f-08c8fafdf617'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:28.360832 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-0d7ea112-f139-4f0d-802f-08c8fafdf617 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0999aa9715a5402ba89c458e5bc20222', 'request_id': 'req-0d7ea112-f139-4f0d-802f-08c8fafdf617'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:28.367521 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-0d7ea112-f139-4f0d-802f-08c8fafdf617 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0999aa9715a5402ba89c458e5bc20222', 'request_id': 'req-0d7ea112-f139-4f0d-802f-08c8fafdf617'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:28.380982 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-0d7ea112-f139-4f0d-802f-08c8fafdf617 admin admin] The token cache is being invalidate because project 0999aa9715a5402ba89c458e5bc20222 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:02:28.381269 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-0d7ea112-f139-4f0d-802f-08c8fafdf617 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:28.381883 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-0d7ea112-f139-4f0d-802f-08c8fafdf617 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:28.383428 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 999/1939] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Oct 14 13:02:28 2022] DELETE /identity/v3/projects/0999aa9715a5402ba89c458e5bc20222 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:02:32.553514 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f773f26b-180c-46b2-a82f-db455944c42d service neutron] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:32.555001 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-f773f26b-180c-46b2-a82f-db455944c42d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:02:32.569997 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f773f26b-180c-46b2-a82f-db455944c42d service neutron] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:32.623764 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:02:32.635731 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b937a76-5112-4517-890e-3043c6a50773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:32.636774 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b937a76-5112-4517-890e-3043c6a50773 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:32.637245 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b937a76-5112-4517-890e-3043c6a50773 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:32.637830 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b937a76-5112-4517-890e-3043c6a50773 admin admin] PATH_INFO: `/v3/users/a6e571ee68e443e5b3e31adc3477e80d` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:32.639596 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b937a76-5112-4517-890e-3043c6a50773 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6e571ee68e443e5b3e31adc3477e80d)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:32.641735 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b937a76-5112-4517-890e-3043c6a50773 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:32.692674 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-7b937a76-5112-4517-890e-3043c6a50773 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6e571ee68e443e5b3e31adc3477e80d'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:32.699703 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-7b937a76-5112-4517-890e-3043c6a50773 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6e571ee68e443e5b3e31adc3477e80d'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:32.700482 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-7b937a76-5112-4517-890e-3043c6a50773 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6e571ee68e443e5b3e31adc3477e80d'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:32.708097 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-7b937a76-5112-4517-890e-3043c6a50773 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6e571ee68e443e5b3e31adc3477e80d'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:32.720677 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-7b937a76-5112-4517-890e-3043c6a50773 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6e571ee68e443e5b3e31adc3477e80d'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:32.730020 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 941/1940] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Oct 14 13:02:32 2022] DELETE /identity/v3/users/a6e571ee68e443e5b3e31adc3477e80d => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:02:32.734661 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d3e032-91ee-427c-a161-57cc9b5aca82 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:32.735300 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d3e032-91ee-427c-a161-57cc9b5aca82 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:32.735300 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d3e032-91ee-427c-a161-57cc9b5aca82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:32.754773 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-d6d3e032-91ee-427c-a161-57cc9b5aca82 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:02:32.755998 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-d6d3e032-91ee-427c-a161-57cc9b5aca82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:02:32.817856 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1000/1941] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:02:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:02:32.828879 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b937a76-5112-4517-890e-3043c6a50773 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:32.830692 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-7b937a76-5112-4517-890e-3043c6a50773 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:02:32.890881 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b937a76-5112-4517-890e-3043c6a50773 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:32.895532 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c9010c-1e2e-4062-9379-0f5258996a2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d483292f3a4794848fcacfba5b107e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:32.896128 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c9010c-1e2e-4062-9379-0f5258996a2a service neutron] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:32.896423 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c9010c-1e2e-4062-9379-0f5258996a2a service neutron] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:32.896719 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c9010c-1e2e-4062-9379-0f5258996a2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:32.910464 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c9010c-1e2e-4062-9379-0f5258996a2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:32.911928 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c9010c-1e2e-4062-9379-0f5258996a2a service neutron] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:32.922925 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 942/1942] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:02:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:02:33.288810 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d3e032-91ee-427c-a161-57cc9b5aca82 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:33.301500 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-d6d3e032-91ee-427c-a161-57cc9b5aca82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:02:33.340705 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d3e032-91ee-427c-a161-57cc9b5aca82 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:33.348893 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33e194c-d623-47c1-9c5e-a20a6339691e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:33.349756 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33e194c-d623-47c1-9c5e-a20a6339691e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:33.350338 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33e194c-d623-47c1-9c5e-a20a6339691e admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:33.350758 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33e194c-d623-47c1-9c5e-a20a6339691e admin admin] PATH_INFO: `/v3/projects/5a605b9ac6214846bd94462f3fba325b` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:33.352918 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33e194c-d623-47c1-9c5e-a20a6339691e admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a605b9ac6214846bd94462f3fba325b)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:33.356228 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33e194c-d623-47c1-9c5e-a20a6339691e admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:33.434051 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-a33e194c-d623-47c1-9c5e-a20a6339691e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a605b9ac6214846bd94462f3fba325b', 'request_id': 'req-a33e194c-d623-47c1-9c5e-a20a6339691e'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:33.441761 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-a33e194c-d623-47c1-9c5e-a20a6339691e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a605b9ac6214846bd94462f3fba325b', 'request_id': 'req-a33e194c-d623-47c1-9c5e-a20a6339691e'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:33.453789 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-a33e194c-d623-47c1-9c5e-a20a6339691e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a605b9ac6214846bd94462f3fba325b', 'request_id': 'req-a33e194c-d623-47c1-9c5e-a20a6339691e'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:33.454959 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:02:33.469553 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-a33e194c-d623-47c1-9c5e-a20a6339691e admin admin] The token cache is being invalidate because project 5a605b9ac6214846bd94462f3fba325b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:02:33.470219 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-a33e194c-d623-47c1-9c5e-a20a6339691e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:33.471051 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-a33e194c-d623-47c1-9c5e-a20a6339691e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:33.476824 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1001/1943] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Oct 14 13:02:33 2022] DELETE /identity/v3/projects/5a605b9ac6214846bd94462f3fba325b => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:02:33.477741 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c9010c-1e2e-4062-9379-0f5258996a2a service neutron] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:33.488984 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c9010c-1e2e-4062-9379-0f5258996a2a service neutron] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:33.569593 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bb6e34-64e5-4062-a0b0-e1905e8ffee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:33.570284 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bb6e34-64e5-4062-a0b0-e1905e8ffee9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:33.570573 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bb6e34-64e5-4062-a0b0-e1905e8ffee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:33.570906 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bb6e34-64e5-4062-a0b0-e1905e8ffee9 admin admin] PATH_INFO: `/v3/users/4584a45396b1456db6c9d61bde0222fa` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:33.572035 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bb6e34-64e5-4062-a0b0-e1905e8ffee9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4584a45396b1456db6c9d61bde0222fa)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:33.574188 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bb6e34-64e5-4062-a0b0-e1905e8ffee9 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:33.604658 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:02:33.655184 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-f2bb6e34-64e5-4062-a0b0-e1905e8ffee9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4584a45396b1456db6c9d61bde0222fa'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:33.673560 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-f2bb6e34-64e5-4062-a0b0-e1905e8ffee9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4584a45396b1456db6c9d61bde0222fa'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:33.674926 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-f2bb6e34-64e5-4062-a0b0-e1905e8ffee9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4584a45396b1456db6c9d61bde0222fa'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:33.687476 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-f2bb6e34-64e5-4062-a0b0-e1905e8ffee9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4584a45396b1456db6c9d61bde0222fa'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:33.707468 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-f2bb6e34-64e5-4062-a0b0-e1905e8ffee9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4584a45396b1456db6c9d61bde0222fa'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:33.715425 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 943/1944] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Oct 14 13:02:33 2022] DELETE /identity/v3/users/4584a45396b1456db6c9d61bde0222fa => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:02:34.024224 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33e194c-d623-47c1-9c5e-a20a6339691e admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:34.025812 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-a33e194c-d623-47c1-9c5e-a20a6339691e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:02:34.040877 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33e194c-d623-47c1-9c5e-a20a6339691e admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:34.111409 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094513ea-99af-4c77-8100-ab44203520b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:34.112062 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094513ea-99af-4c77-8100-ab44203520b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:34.112336 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094513ea-99af-4c77-8100-ab44203520b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:34.112607 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094513ea-99af-4c77-8100-ab44203520b0 admin admin] PATH_INFO: `/v3/projects/afad328596c742bbb4e1f23b5f5e5068` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:34.113726 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094513ea-99af-4c77-8100-ab44203520b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=afad328596c742bbb4e1f23b5f5e5068)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:34.115687 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094513ea-99af-4c77-8100-ab44203520b0 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:34.166185 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-094513ea-99af-4c77-8100-ab44203520b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'afad328596c742bbb4e1f23b5f5e5068', 'request_id': 'req-094513ea-99af-4c77-8100-ab44203520b0'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:34.172607 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-094513ea-99af-4c77-8100-ab44203520b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'afad328596c742bbb4e1f23b5f5e5068', 'request_id': 'req-094513ea-99af-4c77-8100-ab44203520b0'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:34.179104 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-094513ea-99af-4c77-8100-ab44203520b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'afad328596c742bbb4e1f23b5f5e5068', 'request_id': 'req-094513ea-99af-4c77-8100-ab44203520b0'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:34.200981 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-094513ea-99af-4c77-8100-ab44203520b0 admin admin] The token cache is being invalidate because project afad328596c742bbb4e1f23b5f5e5068 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:02:34.201278 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-094513ea-99af-4c77-8100-ab44203520b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:34.201914 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-094513ea-99af-4c77-8100-ab44203520b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:34.203450 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1002/1945] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Oct 14 13:02:34 2022] DELETE /identity/v3/projects/afad328596c742bbb4e1f23b5f5e5068 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:02:34.207451 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bb6e34-64e5-4062-a0b0-e1905e8ffee9 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:34.208932 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-f2bb6e34-64e5-4062-a0b0-e1905e8ffee9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:02:34.221813 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bb6e34-64e5-4062-a0b0-e1905e8ffee9 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:34.283181 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2275a2c-e718-4278-b1e9-2e12348ac009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:34.283842 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2275a2c-e718-4278-b1e9-2e12348ac009 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:34.284095 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2275a2c-e718-4278-b1e9-2e12348ac009 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:34.284367 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2275a2c-e718-4278-b1e9-2e12348ac009 admin admin] PATH_INFO: `/v3/users/4a63e5bc0c434f70b8ec424a276dd3c9` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:34.285500 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2275a2c-e718-4278-b1e9-2e12348ac009 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a63e5bc0c434f70b8ec424a276dd3c9)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:34.287451 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2275a2c-e718-4278-b1e9-2e12348ac009 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:34.336101 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-a2275a2c-e718-4278-b1e9-2e12348ac009 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a63e5bc0c434f70b8ec424a276dd3c9'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:34.343467 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-a2275a2c-e718-4278-b1e9-2e12348ac009 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a63e5bc0c434f70b8ec424a276dd3c9'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:34.344179 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-a2275a2c-e718-4278-b1e9-2e12348ac009 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a63e5bc0c434f70b8ec424a276dd3c9'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:34.353258 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-a2275a2c-e718-4278-b1e9-2e12348ac009 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a63e5bc0c434f70b8ec424a276dd3c9'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:34.365765 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-a2275a2c-e718-4278-b1e9-2e12348ac009 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a63e5bc0c434f70b8ec424a276dd3c9'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:34.372493 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 944/1946] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Oct 14 13:02:34 2022] DELETE /identity/v3/users/4a63e5bc0c434f70b8ec424a276dd3c9 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:02:34.481534 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094513ea-99af-4c77-8100-ab44203520b0 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:34.482987 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-094513ea-99af-4c77-8100-ab44203520b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:02:34.496756 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094513ea-99af-4c77-8100-ab44203520b0 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:34.566503 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bba9a22-0001-40a4-9678-e4ac37c1466a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:34.567151 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bba9a22-0001-40a4-9678-e4ac37c1466a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:34.567430 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bba9a22-0001-40a4-9678-e4ac37c1466a admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:34.567703 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bba9a22-0001-40a4-9678-e4ac37c1466a admin admin] PATH_INFO: `/v3/users/385c82cfb14f40c0b307ca5da21a74ff` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:34.569225 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bba9a22-0001-40a4-9678-e4ac37c1466a admin admin] RBAC: Authorizing `identity:delete_user(user_id=385c82cfb14f40c0b307ca5da21a74ff)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:34.571256 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bba9a22-0001-40a4-9678-e4ac37c1466a admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:34.612660 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:02:34.641484 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-6bba9a22-0001-40a4-9678-e4ac37c1466a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '385c82cfb14f40c0b307ca5da21a74ff'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:34.651409 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-6bba9a22-0001-40a4-9678-e4ac37c1466a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '385c82cfb14f40c0b307ca5da21a74ff'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:34.652150 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-6bba9a22-0001-40a4-9678-e4ac37c1466a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '385c82cfb14f40c0b307ca5da21a74ff'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:34.660870 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-6bba9a22-0001-40a4-9678-e4ac37c1466a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '385c82cfb14f40c0b307ca5da21a74ff'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:34.673006 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2275a2c-e718-4278-b1e9-2e12348ac009 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:34.678532 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-a2275a2c-e718-4278-b1e9-2e12348ac009 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:02:34.698761 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2275a2c-e718-4278-b1e9-2e12348ac009 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:34.701334 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-6bba9a22-0001-40a4-9678-e4ac37c1466a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '385c82cfb14f40c0b307ca5da21a74ff'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:34.704467 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6238fb43-9b6e-448c-9aaf-fa104aeaa07a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:34.705369 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6238fb43-9b6e-448c-9aaf-fa104aeaa07a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:34.705722 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6238fb43-9b6e-448c-9aaf-fa104aeaa07a admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:34.706049 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6238fb43-9b6e-448c-9aaf-fa104aeaa07a admin admin] PATH_INFO: `/v3/projects/9e0ca603c6bb4bc89bfef20270eb83bc` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:34.707459 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6238fb43-9b6e-448c-9aaf-fa104aeaa07a admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e0ca603c6bb4bc89bfef20270eb83bc)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:34.708844 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1003/1947] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Oct 14 13:02:34 2022] DELETE /identity/v3/users/385c82cfb14f40c0b307ca5da21a74ff => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:02:34.712168 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6238fb43-9b6e-448c-9aaf-fa104aeaa07a admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:34.714492 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b6e468-7a98-4fcd-bd6e-939ba9acb46f None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:34.714787 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b6e468-7a98-4fcd-bd6e-939ba9acb46f None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:34.715682 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b6e468-7a98-4fcd-bd6e-939ba9acb46f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:34.726577 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:02:34.753038 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-69b6e468-7a98-4fcd-bd6e-939ba9acb46f None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:02:34.754549 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-69b6e468-7a98-4fcd-bd6e-939ba9acb46f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:02:34.824611 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-6238fb43-9b6e-448c-9aaf-fa104aeaa07a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e0ca603c6bb4bc89bfef20270eb83bc', 'request_id': 'req-6238fb43-9b6e-448c-9aaf-fa104aeaa07a'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:34.837033 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-6238fb43-9b6e-448c-9aaf-fa104aeaa07a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e0ca603c6bb4bc89bfef20270eb83bc', 'request_id': 'req-6238fb43-9b6e-448c-9aaf-fa104aeaa07a'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:34.846756 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-6238fb43-9b6e-448c-9aaf-fa104aeaa07a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e0ca603c6bb4bc89bfef20270eb83bc', 'request_id': 'req-6238fb43-9b6e-448c-9aaf-fa104aeaa07a'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:34.855175 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1004/1948] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:02:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 13:02:34.865824 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-6238fb43-9b6e-448c-9aaf-fa104aeaa07a admin admin] The token cache is being invalidate because project 9e0ca603c6bb4bc89bfef20270eb83bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:02:34.866028 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-6238fb43-9b6e-448c-9aaf-fa104aeaa07a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:34.866693 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-6238fb43-9b6e-448c-9aaf-fa104aeaa07a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:34.868305 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 945/1949] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Oct 14 13:02:34 2022] DELETE /identity/v3/projects/9e0ca603c6bb4bc89bfef20270eb83bc => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:02:34.934960 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b6e468-7a98-4fcd-bd6e-939ba9acb46f None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:34.940242 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-69b6e468-7a98-4fcd-bd6e-939ba9acb46f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:02:35.110139 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b6e468-7a98-4fcd-bd6e-939ba9acb46f None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:35.162748 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b260b479-7402-4b6f-9271-e7d1248cfec7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d483292f3a4794848fcacfba5b107e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:35.163357 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b260b479-7402-4b6f-9271-e7d1248cfec7 service neutron] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:35.163633 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b260b479-7402-4b6f-9271-e7d1248cfec7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:35.163902 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b260b479-7402-4b6f-9271-e7d1248cfec7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:35.165623 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-b260b479-7402-4b6f-9271-e7d1248cfec7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:02:35.179012 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:02:35.232623 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b260b479-7402-4b6f-9271-e7d1248cfec7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:35.234061 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b260b479-7402-4b6f-9271-e7d1248cfec7 service neutron] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:35.243815 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1005/1950] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:02:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:02:35.542081 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6238fb43-9b6e-448c-9aaf-fa104aeaa07a admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:35.543644 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-6238fb43-9b6e-448c-9aaf-fa104aeaa07a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:02:35.558299 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6238fb43-9b6e-448c-9aaf-fa104aeaa07a admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:35.563194 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332cab2e-b097-4270-90bb-12fb72d3d788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:35.563845 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332cab2e-b097-4270-90bb-12fb72d3d788 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:35.564109 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332cab2e-b097-4270-90bb-12fb72d3d788 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:35.564470 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332cab2e-b097-4270-90bb-12fb72d3d788 admin admin] PATH_INFO: `/v3/projects/760159925b284562ac48c0a6bb6de822` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:35.565830 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332cab2e-b097-4270-90bb-12fb72d3d788 admin admin] RBAC: Authorizing `identity:delete_project(project_id=760159925b284562ac48c0a6bb6de822)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:35.567827 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332cab2e-b097-4270-90bb-12fb72d3d788 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:35.620179 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-332cab2e-b097-4270-90bb-12fb72d3d788 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '760159925b284562ac48c0a6bb6de822', 'request_id': 'req-332cab2e-b097-4270-90bb-12fb72d3d788'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:35.626546 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-332cab2e-b097-4270-90bb-12fb72d3d788 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '760159925b284562ac48c0a6bb6de822', 'request_id': 'req-332cab2e-b097-4270-90bb-12fb72d3d788'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:35.633219 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-332cab2e-b097-4270-90bb-12fb72d3d788 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '760159925b284562ac48c0a6bb6de822', 'request_id': 'req-332cab2e-b097-4270-90bb-12fb72d3d788'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:35.646286 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-332cab2e-b097-4270-90bb-12fb72d3d788 admin admin] The token cache is being invalidate because project 760159925b284562ac48c0a6bb6de822 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:02:35.646600 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-332cab2e-b097-4270-90bb-12fb72d3d788 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:35.647209 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-332cab2e-b097-4270-90bb-12fb72d3d788 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:35.648712 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 946/1951] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Oct 14 13:02:35 2022] DELETE /identity/v3/projects/760159925b284562ac48c0a6bb6de822 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:02:35.653783 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6315caf-985b-45ff-bb8a-4e2ed05e43d2 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:35.654071 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6315caf-985b-45ff-bb8a-4e2ed05e43d2 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:35.654401 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6315caf-985b-45ff-bb8a-4e2ed05e43d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:35.678346 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-d6315caf-985b-45ff-bb8a-4e2ed05e43d2 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:02:35.679662 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-d6315caf-985b-45ff-bb8a-4e2ed05e43d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:02:35.749811 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1006/1952] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:02:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 13:02:35.757834 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2789a25-e15a-4d14-a8d4-87e76d012fb3 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:35.758446 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2789a25-e15a-4d14-a8d4-87e76d012fb3 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:35.758446 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2789a25-e15a-4d14-a8d4-87e76d012fb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:35.785129 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-b2789a25-e15a-4d14-a8d4-87e76d012fb3 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:02:35.786373 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-b2789a25-e15a-4d14-a8d4-87e76d012fb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:02:35.794281 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 947/1953] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:02:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:02:35.798656 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6315caf-985b-45ff-bb8a-4e2ed05e43d2 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:35.809636 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6315caf-985b-45ff-bb8a-4e2ed05e43d2 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:35.814411 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bad9bd-d482-443a-aefa-37c19dba4bb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:35.815115 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bad9bd-d482-443a-aefa-37c19dba4bb0 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:35.815414 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bad9bd-d482-443a-aefa-37c19dba4bb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:35.815683 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bad9bd-d482-443a-aefa-37c19dba4bb0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:35.816326 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bad9bd-d482-443a-aefa-37c19dba4bb0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 13:02:35.816626 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bad9bd-d482-443a-aefa-37c19dba4bb0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:35.818306 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bad9bd-d482-443a-aefa-37c19dba4bb0 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:35.834188 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1007/1954] 10.222.0.17 () {58 vars in 1153 bytes} [Fri Oct 14 13:02:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 13:02:35.839937 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2789a25-e15a-4d14-a8d4-87e76d012fb3 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:35.849799 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2789a25-e15a-4d14-a8d4-87e76d012fb3 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:35.857917 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609ea309-849f-4663-bc26-c739a5a06b68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:35.858979 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609ea309-849f-4663-bc26-c739a5a06b68 admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:35.859458 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609ea309-849f-4663-bc26-c739a5a06b68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:35.859971 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609ea309-849f-4663-bc26-c739a5a06b68 admin admin] PATH_INFO: `/v3/projects` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:35.860876 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609ea309-849f-4663-bc26-c739a5a06b68 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:35.863651 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609ea309-849f-4663-bc26-c739a5a06b68 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:35.892342 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 948/1955] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Oct 14 13:02:35 2022] POST /identity/v3/projects => generated 371 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:02:35.896508 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bad9bd-d482-443a-aefa-37c19dba4bb0 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:35.907179 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bad9bd-d482-443a-aefa-37c19dba4bb0 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:35.964458 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0544a7-5c8d-4d44-99ef-953bfe5f8d3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:35.965071 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0544a7-5c8d-4d44-99ef-953bfe5f8d3c admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:35.965354 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0544a7-5c8d-4d44-99ef-953bfe5f8d3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:35.965628 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0544a7-5c8d-4d44-99ef-953bfe5f8d3c admin admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:35.966307 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0544a7-5c8d-4d44-99ef-953bfe5f8d3c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:35.968252 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0544a7-5c8d-4d44-99ef-953bfe5f8d3c admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:35.993827 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1008/1956] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Oct 14 13:02:35 2022] POST /identity/v3/users => generated 286 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:02:35.995614 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609ea309-849f-4663-bc26-c739a5a06b68 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:36.006373 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609ea309-849f-4663-bc26-c739a5a06b68 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:36.011103 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfad56e3-b486-4df5-811a-96eb1af07775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:36.011702 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfad56e3-b486-4df5-811a-96eb1af07775 admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:36.011987 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfad56e3-b486-4df5-811a-96eb1af07775 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:36.012260 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfad56e3-b486-4df5-811a-96eb1af07775 admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:36.012903 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfad56e3-b486-4df5-811a-96eb1af07775 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:36.014547 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfad56e3-b486-4df5-811a-96eb1af07775 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:36.029310 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 949/1957] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:02:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:02:36.030617 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0544a7-5c8d-4d44-99ef-953bfe5f8d3c admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:36.041009 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0544a7-5c8d-4d44-99ef-953bfe5f8d3c admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:36.046642 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b017b44-f786-493a-83c3-49cced39d455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:36.047277 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b017b44-f786-493a-83c3-49cced39d455 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:36.047558 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b017b44-f786-493a-83c3-49cced39d455 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:36.047976 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b017b44-f786-493a-83c3-49cced39d455 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:36.048623 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b017b44-f786-493a-83c3-49cced39d455 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:36.050251 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b017b44-f786-493a-83c3-49cced39d455 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:36.062047 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1009/1958] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:02:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:02:36.066430 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfad56e3-b486-4df5-811a-96eb1af07775 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:36.077125 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfad56e3-b486-4df5-811a-96eb1af07775 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:36.082018 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae03d43-59a7-470f-8c6b-7fac934c1590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:36.082752 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae03d43-59a7-470f-8c6b-7fac934c1590 admin admin] REQUEST_METHOD: `PUT` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:36.083030 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae03d43-59a7-470f-8c6b-7fac934c1590 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:36.083307 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae03d43-59a7-470f-8c6b-7fac934c1590 admin admin] PATH_INFO: `/v3/projects/a83b4736c4a84ab3be6ef80355880bd0/users/b4304408a7e8439c87e3d573e4e931fa/roles/5e8849303a75425b9eaa2681cc031af1` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:36.117848 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae03d43-59a7-470f-8c6b-7fac934c1590 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a83b4736c4a84ab3be6ef80355880bd0, user_id=b4304408a7e8439c87e3d573e4e931fa, role_id=5e8849303a75425b9eaa2681cc031af1)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:36.121806 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae03d43-59a7-470f-8c6b-7fac934c1590 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:36.139943 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 950/1959] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Oct 14 13:02:36 2022] PUT /identity/v3/projects/a83b4736c4a84ab3be6ef80355880bd0/users/b4304408a7e8439c87e3d573e4e931fa/roles/5e8849303a75425b9eaa2681cc031af1 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:02:36.151570 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ea3a15-7cb7-450b-be80-6cab0871c905 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:36.151570 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ea3a15-7cb7-450b-be80-6cab0871c905 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:36.151570 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ea3a15-7cb7-450b-be80-6cab0871c905 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:36.185787 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-34ea3a15-7cb7-450b-be80-6cab0871c905 None None] MFA Rules not processed for user `b4304408a7e8439c87e3d573e4e931fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:02:36.187060 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-34ea3a15-7cb7-450b-be80-6cab0871c905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:02:36.191429 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:02:36.273609 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1010/1960] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:02:36 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:02:36.288507 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae03d43-59a7-470f-8c6b-7fac934c1590 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:36.291738 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-8ae03d43-59a7-470f-8c6b-7fac934c1590 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:02:36.319132 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=82,keystone:DELETE=14,keystone:INSERT=4 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:02:36.397552 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae03d43-59a7-470f-8c6b-7fac934c1590 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:36.405101 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a3b616-109d-4514-9760-e798bd708031 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c3c564b8c548e4beef1cbfba2ad343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:36.405768 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a3b616-109d-4514-9760-e798bd708031 service cinder] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:36.406238 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a3b616-109d-4514-9760-e798bd708031 service cinder] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:36.406652 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a3b616-109d-4514-9760-e798bd708031 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:36.426336 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a3b616-109d-4514-9760-e798bd708031 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:36.427998 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a3b616-109d-4514-9760-e798bd708031 service cinder] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:36.438886 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 951/1961] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:02:36 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:02:36.466203 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ea3a15-7cb7-450b-be80-6cab0871c905 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:36.601164 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ea3a15-7cb7-450b-be80-6cab0871c905 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:36.611518 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e4bbcb-87bc-4ea1-98f5-fa63055e9999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:36.613060 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e4bbcb-87bc-4ea1-98f5-fa63055e9999 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:36.613471 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e4bbcb-87bc-4ea1-98f5-fa63055e9999 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:36.614468 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e4bbcb-87bc-4ea1-98f5-fa63055e9999 admin admin] PATH_INFO: `/v3/users/b4304408a7e8439c87e3d573e4e931fa` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:36.617391 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e4bbcb-87bc-4ea1-98f5-fa63055e9999 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4304408a7e8439c87e3d573e4e931fa)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:36.621870 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e4bbcb-87bc-4ea1-98f5-fa63055e9999 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:36.687349 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-a9e4bbcb-87bc-4ea1-98f5-fa63055e9999 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4304408a7e8439c87e3d573e4e931fa'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:36.698039 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-a9e4bbcb-87bc-4ea1-98f5-fa63055e9999 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4304408a7e8439c87e3d573e4e931fa'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:36.699545 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-a9e4bbcb-87bc-4ea1-98f5-fa63055e9999 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4304408a7e8439c87e3d573e4e931fa'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:36.715198 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-a9e4bbcb-87bc-4ea1-98f5-fa63055e9999 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4304408a7e8439c87e3d573e4e931fa'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:36.732519 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-a9e4bbcb-87bc-4ea1-98f5-fa63055e9999 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4304408a7e8439c87e3d573e4e931fa'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:36.740529 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1011/1962] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Oct 14 13:02:36 2022] DELETE /identity/v3/users/b4304408a7e8439c87e3d573e4e931fa => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 13:02:36.745438 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36afda42-5532-4431-84b8-227e69da338f None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:36.745764 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36afda42-5532-4431-84b8-227e69da338f None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:36.746056 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36afda42-5532-4431-84b8-227e69da338f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:36.770870 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-36afda42-5532-4431-84b8-227e69da338f None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:02:36.772494 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-36afda42-5532-4431-84b8-227e69da338f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:02:36.851940 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 952/1963] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:02:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:02:36.869972 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e4bbcb-87bc-4ea1-98f5-fa63055e9999 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:36.872592 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-a9e4bbcb-87bc-4ea1-98f5-fa63055e9999 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:02:36.924978 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:02:36.981934 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e4bbcb-87bc-4ea1-98f5-fa63055e9999 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:36.985981 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c430f8a3-0b3c-4c13-b4b0-7b9757d8214f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d483292f3a4794848fcacfba5b107e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:36.986676 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c430f8a3-0b3c-4c13-b4b0-7b9757d8214f service neutron] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:36.986950 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c430f8a3-0b3c-4c13-b4b0-7b9757d8214f service neutron] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:36.987220 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c430f8a3-0b3c-4c13-b4b0-7b9757d8214f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:36.997113 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c430f8a3-0b3c-4c13-b4b0-7b9757d8214f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:36.998609 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c430f8a3-0b3c-4c13-b4b0-7b9757d8214f service neutron] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:37.009009 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1012/1964] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:02:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:02:37.299930 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36afda42-5532-4431-84b8-227e69da338f None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:37.301447 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-36afda42-5532-4431-84b8-227e69da338f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:02:37.317929 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36afda42-5532-4431-84b8-227e69da338f None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:37.324233 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3959b2-e0ca-4e5a-9ef0-56eff0af8354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:37.325312 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3959b2-e0ca-4e5a-9ef0-56eff0af8354 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:37.325588 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3959b2-e0ca-4e5a-9ef0-56eff0af8354 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:37.325860 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3959b2-e0ca-4e5a-9ef0-56eff0af8354 admin admin] PATH_INFO: `/v3/projects/a83b4736c4a84ab3be6ef80355880bd0` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:37.327104 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3959b2-e0ca-4e5a-9ef0-56eff0af8354 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a83b4736c4a84ab3be6ef80355880bd0)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:37.329072 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3959b2-e0ca-4e5a-9ef0-56eff0af8354 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:37.381024 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-2b3959b2-e0ca-4e5a-9ef0-56eff0af8354 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a83b4736c4a84ab3be6ef80355880bd0', 'request_id': 'req-2b3959b2-e0ca-4e5a-9ef0-56eff0af8354'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:37.387218 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-2b3959b2-e0ca-4e5a-9ef0-56eff0af8354 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a83b4736c4a84ab3be6ef80355880bd0', 'request_id': 'req-2b3959b2-e0ca-4e5a-9ef0-56eff0af8354'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:37.394883 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-2b3959b2-e0ca-4e5a-9ef0-56eff0af8354 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a83b4736c4a84ab3be6ef80355880bd0', 'request_id': 'req-2b3959b2-e0ca-4e5a-9ef0-56eff0af8354'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:37.410485 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-2b3959b2-e0ca-4e5a-9ef0-56eff0af8354 admin admin] The token cache is being invalidate because project a83b4736c4a84ab3be6ef80355880bd0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:02:37.410666 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-2b3959b2-e0ca-4e5a-9ef0-56eff0af8354 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:37.411336 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-2b3959b2-e0ca-4e5a-9ef0-56eff0af8354 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:37.413156 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 953/1965] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Oct 14 13:02:37 2022] DELETE /identity/v3/projects/a83b4736c4a84ab3be6ef80355880bd0 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:02:40.501082 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eef20a-d80e-44b5-914f-77e732680239 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:40.501636 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eef20a-d80e-44b5-914f-77e732680239 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:40.501636 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eef20a-d80e-44b5-914f-77e732680239 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:40.522342 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-a7eef20a-d80e-44b5-914f-77e732680239 None None] MFA Rules not processed for user `b83a5a78f3e7486293907cb3012c0ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:02:40.523560 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-a7eef20a-d80e-44b5-914f-77e732680239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:02:40.591704 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1013/1966] 10.222.0.17 () {58 vars in 1009 bytes} [Fri Oct 14 13:02:40 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:02:40.640617 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3959b2-e0ca-4e5a-9ef0-56eff0af8354 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:40.642070 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-2b3959b2-e0ca-4e5a-9ef0-56eff0af8354 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:02:40.693081 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:02:40.721621 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3959b2-e0ca-4e5a-9ef0-56eff0af8354 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:40.727155 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678cdd7f-d172-427a-9b10-cbad9940e7fa service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c9fc57b1ec4d00b9f392877f277284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:40.727831 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678cdd7f-d172-427a-9b10-cbad9940e7fa service swift] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:40.728102 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678cdd7f-d172-427a-9b10-cbad9940e7fa service swift] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:40.728312 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678cdd7f-d172-427a-9b10-cbad9940e7fa service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:40.738238 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678cdd7f-d172-427a-9b10-cbad9940e7fa service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:40.739894 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678cdd7f-d172-427a-9b10-cbad9940e7fa service swift] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:40.749438 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 954/1967] 10.222.0.17 () {60 vars in 1384 bytes} [Fri Oct 14 13:02:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 14 13:02:41.321181 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b6a060-76c3-4f71-9da2-1b69c6878d0a None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:41.321472 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b6a060-76c3-4f71-9da2-1b69c6878d0a None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:41.321754 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b6a060-76c3-4f71-9da2-1b69c6878d0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:41.341300 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-80b6a060-76c3-4f71-9da2-1b69c6878d0a None None] MFA Rules not processed for user `b83a5a78f3e7486293907cb3012c0ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:02:41.342600 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-80b6a060-76c3-4f71-9da2-1b69c6878d0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:02:41.355991 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1014/1968] 10.222.0.17 () {58 vars in 967 bytes} [Fri Oct 14 13:02:41 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 13:02:41.373813 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678cdd7f-d172-427a-9b10-cbad9940e7fa service swift] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:41.384861 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678cdd7f-d172-427a-9b10-cbad9940e7fa service swift] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:41.389999 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7260067f-e6d9-4232-be84-4eabdcd12420 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c9fc57b1ec4d00b9f392877f277284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:41.390643 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7260067f-e6d9-4232-be84-4eabdcd12420 service swift] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:41.390986 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7260067f-e6d9-4232-be84-4eabdcd12420 service swift] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:41.391261 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7260067f-e6d9-4232-be84-4eabdcd12420 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:41.405090 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7260067f-e6d9-4232-be84-4eabdcd12420 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:41.406767 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7260067f-e6d9-4232-be84-4eabdcd12420 service swift] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:41.415434 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 955/1969] 10.222.0.17 () {60 vars in 1384 bytes} [Fri Oct 14 13:02:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 14 13:02:41.701809 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8857227a-7d3d-4f03-b20b-bbe19f8a900a None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:41.702327 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8857227a-7d3d-4f03-b20b-bbe19f8a900a None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:41.702596 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8857227a-7d3d-4f03-b20b-bbe19f8a900a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:41.732140 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-8857227a-7d3d-4f03-b20b-bbe19f8a900a None None] MFA Rules not processed for user `b83a5a78f3e7486293907cb3012c0ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:02:41.733360 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-8857227a-7d3d-4f03-b20b-bbe19f8a900a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:02:41.740904 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1015/1970] 10.222.0.17 () {58 vars in 1009 bytes} [Fri Oct 14 13:02:41 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:02:41.752996 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7260067f-e6d9-4232-be84-4eabdcd12420 service swift] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:41.763939 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7260067f-e6d9-4232-be84-4eabdcd12420 service swift] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:41.769089 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc892c1-e35a-4d20-a668-7f53a641cb75 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c9fc57b1ec4d00b9f392877f277284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:41.769686 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc892c1-e35a-4d20-a668-7f53a641cb75 service swift] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:41.769972 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc892c1-e35a-4d20-a668-7f53a641cb75 service swift] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:41.770278 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc892c1-e35a-4d20-a668-7f53a641cb75 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:41.779716 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc892c1-e35a-4d20-a668-7f53a641cb75 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:41.781462 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc892c1-e35a-4d20-a668-7f53a641cb75 service swift] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:41.798507 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 956/1971] 10.222.0.17 () {60 vars in 1384 bytes} [Fri Oct 14 13:02:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 14 13:02:42.173132 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a837a0-ff5c-424f-90d2-c8d86a32fe3f None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:42.173414 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a837a0-ff5c-424f-90d2-c8d86a32fe3f None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:42.173684 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a837a0-ff5c-424f-90d2-c8d86a32fe3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:42.194777 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-58a837a0-ff5c-424f-90d2-c8d86a32fe3f None None] MFA Rules not processed for user `b83a5a78f3e7486293907cb3012c0ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:02:42.196002 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-58a837a0-ff5c-424f-90d2-c8d86a32fe3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:02:42.203684 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1016/1972] 10.222.0.17 () {58 vars in 967 bytes} [Fri Oct 14 13:02:42 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:02:42.217088 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc892c1-e35a-4d20-a668-7f53a641cb75 service swift] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:42.228147 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc892c1-e35a-4d20-a668-7f53a641cb75 service swift] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:42.233461 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d795563-d073-437e-ba95-f256a1cf2dce service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c9fc57b1ec4d00b9f392877f277284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:42.234070 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d795563-d073-437e-ba95-f256a1cf2dce service swift] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:42.234423 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d795563-d073-437e-ba95-f256a1cf2dce service swift] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:42.234661 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d795563-d073-437e-ba95-f256a1cf2dce service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:42.245880 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d795563-d073-437e-ba95-f256a1cf2dce service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:42.247518 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d795563-d073-437e-ba95-f256a1cf2dce service swift] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:42.256261 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 957/1973] 10.222.0.17 () {60 vars in 1384 bytes} [Fri Oct 14 13:02:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 14 13:02:44.461612 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a837a0-ff5c-424f-90d2-c8d86a32fe3f None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:44.463255 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-58a837a0-ff5c-424f-90d2-c8d86a32fe3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:02:44.539701 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a837a0-ff5c-424f-90d2-c8d86a32fe3f None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:44.545104 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec50e28-b240-4a04-b94a-d833cf7a561c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:44.545746 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec50e28-b240-4a04-b94a-d833cf7a561c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:44.546026 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec50e28-b240-4a04-b94a-d833cf7a561c admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:44.546329 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec50e28-b240-4a04-b94a-d833cf7a561c admin admin] PATH_INFO: `/v3/users/a736106a67ad4a6a86e13c4eb6277854` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:44.547500 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec50e28-b240-4a04-b94a-d833cf7a561c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a736106a67ad4a6a86e13c4eb6277854)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:44.549430 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec50e28-b240-4a04-b94a-d833cf7a561c admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:44.599479 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-1ec50e28-b240-4a04-b94a-d833cf7a561c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a736106a67ad4a6a86e13c4eb6277854'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:44.605464 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:02:44.607791 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-1ec50e28-b240-4a04-b94a-d833cf7a561c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a736106a67ad4a6a86e13c4eb6277854'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:44.608904 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-1ec50e28-b240-4a04-b94a-d833cf7a561c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a736106a67ad4a6a86e13c4eb6277854'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:44.618393 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-1ec50e28-b240-4a04-b94a-d833cf7a561c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a736106a67ad4a6a86e13c4eb6277854'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:44.632400 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-1ec50e28-b240-4a04-b94a-d833cf7a561c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a736106a67ad4a6a86e13c4eb6277854'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:44.638748 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1017/1974] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Oct 14 13:02:44 2022] DELETE /identity/v3/users/a736106a67ad4a6a86e13c4eb6277854 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:02:44.643286 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b385551-80f5-465b-bf3f-c61d1f5280bb None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:44.643787 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b385551-80f5-465b-bf3f-c61d1f5280bb None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:44.643893 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b385551-80f5-465b-bf3f-c61d1f5280bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:44.663752 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-0b385551-80f5-465b-bf3f-c61d1f5280bb None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:02:44.664988 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-0b385551-80f5-465b-bf3f-c61d1f5280bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:02:44.740193 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 958/1975] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:02:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:02:44.749874 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec50e28-b240-4a04-b94a-d833cf7a561c admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:44.751334 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-1ec50e28-b240-4a04-b94a-d833cf7a561c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:02:44.813119 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec50e28-b240-4a04-b94a-d833cf7a561c admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:44.816844 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94752efa-d552-4ea0-8470-f1c130f81931 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d483292f3a4794848fcacfba5b107e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:44.817457 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94752efa-d552-4ea0-8470-f1c130f81931 service neutron] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:44.817736 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94752efa-d552-4ea0-8470-f1c130f81931 service neutron] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:44.818011 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94752efa-d552-4ea0-8470-f1c130f81931 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:44.827760 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94752efa-d552-4ea0-8470-f1c130f81931 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:44.829211 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94752efa-d552-4ea0-8470-f1c130f81931 service neutron] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:44.839887 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1018/1976] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:02:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:02:45.028422 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b385551-80f5-465b-bf3f-c61d1f5280bb None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:45.029904 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-0b385551-80f5-465b-bf3f-c61d1f5280bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:02:45.050287 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b385551-80f5-465b-bf3f-c61d1f5280bb None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:45.056032 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bc1c40-0ed5-4848-9c69-2baeb9a456b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:45.056731 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bc1c40-0ed5-4848-9c69-2baeb9a456b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:45.057071 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bc1c40-0ed5-4848-9c69-2baeb9a456b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:45.057386 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bc1c40-0ed5-4848-9c69-2baeb9a456b8 admin admin] PATH_INFO: `/v3/projects/4de1f98eda764690ac16acad95880fc7` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:45.058845 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bc1c40-0ed5-4848-9c69-2baeb9a456b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4de1f98eda764690ac16acad95880fc7)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:45.060907 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bc1c40-0ed5-4848-9c69-2baeb9a456b8 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:45.118819 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-05bc1c40-0ed5-4848-9c69-2baeb9a456b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4de1f98eda764690ac16acad95880fc7', 'request_id': 'req-05bc1c40-0ed5-4848-9c69-2baeb9a456b8'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:45.124910 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-05bc1c40-0ed5-4848-9c69-2baeb9a456b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4de1f98eda764690ac16acad95880fc7', 'request_id': 'req-05bc1c40-0ed5-4848-9c69-2baeb9a456b8'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:45.135551 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-05bc1c40-0ed5-4848-9c69-2baeb9a456b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4de1f98eda764690ac16acad95880fc7', 'request_id': 'req-05bc1c40-0ed5-4848-9c69-2baeb9a456b8'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:45.150218 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-05bc1c40-0ed5-4848-9c69-2baeb9a456b8 admin admin] The token cache is being invalidate because project 4de1f98eda764690ac16acad95880fc7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:02:45.151069 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-05bc1c40-0ed5-4848-9c69-2baeb9a456b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:45.151991 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-05bc1c40-0ed5-4848-9c69-2baeb9a456b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:45.153833 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 959/1977] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Oct 14 13:02:45 2022] DELETE /identity/v3/projects/4de1f98eda764690ac16acad95880fc7 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:02:45.158783 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b574e5da-9ff4-44c1-991f-c9a459e0fb68 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:45.159007 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b574e5da-9ff4-44c1-991f-c9a459e0fb68 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:45.159310 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b574e5da-9ff4-44c1-991f-c9a459e0fb68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:45.179857 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-b574e5da-9ff4-44c1-991f-c9a459e0fb68 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:02:45.181086 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-b574e5da-9ff4-44c1-991f-c9a459e0fb68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:02:45.244405 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1019/1978] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:02:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:02:45.252024 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f36363-202b-4334-8cd8-14c76bc466a6 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:45.252305 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f36363-202b-4334-8cd8-14c76bc466a6 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:45.252579 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f36363-202b-4334-8cd8-14c76bc466a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:45.277390 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-44f36363-202b-4334-8cd8-14c76bc466a6 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:02:45.278591 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-44f36363-202b-4334-8cd8-14c76bc466a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:02:45.286432 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 960/1979] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:02:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:02:45.290716 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b574e5da-9ff4-44c1-991f-c9a459e0fb68 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:45.301226 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b574e5da-9ff4-44c1-991f-c9a459e0fb68 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:45.306671 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3fa97b-f259-472d-9311-328974f242ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:45.307605 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3fa97b-f259-472d-9311-328974f242ab admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:45.307890 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3fa97b-f259-472d-9311-328974f242ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:45.308163 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3fa97b-f259-472d-9311-328974f242ab admin admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:45.308817 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3fa97b-f259-472d-9311-328974f242ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 13:02:45.309284 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3fa97b-f259-472d-9311-328974f242ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:45.310893 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3fa97b-f259-472d-9311-328974f242ab admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:45.324245 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1020/1980] 10.222.0.17 () {58 vars in 1153 bytes} [Fri Oct 14 13:02:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 13:02:45.335789 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f36363-202b-4334-8cd8-14c76bc466a6 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:45.347154 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f36363-202b-4334-8cd8-14c76bc466a6 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:45.352245 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0893e2-4682-4fc7-a326-4a32d9016a1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:45.352847 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0893e2-4682-4fc7-a326-4a32d9016a1d admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:45.353126 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0893e2-4682-4fc7-a326-4a32d9016a1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:45.353395 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0893e2-4682-4fc7-a326-4a32d9016a1d admin admin] PATH_INFO: `/v3/projects` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:45.354324 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0893e2-4682-4fc7-a326-4a32d9016a1d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:45.356321 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0893e2-4682-4fc7-a326-4a32d9016a1d admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:45.361308 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:02:45.392355 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 961/1981] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Oct 14 13:02:45 2022] POST /identity/v3/projects => generated 391 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:02:45.399315 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3fa97b-f259-472d-9311-328974f242ab admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:45.417251 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3fa97b-f259-472d-9311-328974f242ab admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:45.515661 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db43a8d-59b5-47fe-b486-c418ce4654b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:45.516672 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db43a8d-59b5-47fe-b486-c418ce4654b6 admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:45.517280 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db43a8d-59b5-47fe-b486-c418ce4654b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:45.517749 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db43a8d-59b5-47fe-b486-c418ce4654b6 admin admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:45.519241 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db43a8d-59b5-47fe-b486-c418ce4654b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:45.523937 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db43a8d-59b5-47fe-b486-c418ce4654b6 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:45.540047 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:02:45.561709 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1021/1982] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Oct 14 13:02:45 2022] POST /identity/v3/users => generated 296 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 13:02:45.568778 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0893e2-4682-4fc7-a326-4a32d9016a1d admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:45.581687 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0893e2-4682-4fc7-a326-4a32d9016a1d admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:45.587188 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a68c454-74a9-42a8-aef0-aec29699f2cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:45.588357 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a68c454-74a9-42a8-aef0-aec29699f2cd admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:45.588782 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a68c454-74a9-42a8-aef0-aec29699f2cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:45.589313 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a68c454-74a9-42a8-aef0-aec29699f2cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:45.590164 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a68c454-74a9-42a8-aef0-aec29699f2cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:45.591810 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a68c454-74a9-42a8-aef0-aec29699f2cd admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:45.610837 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 962/1983] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:02:45 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 14 13:02:45.614928 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db43a8d-59b5-47fe-b486-c418ce4654b6 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:45.631976 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db43a8d-59b5-47fe-b486-c418ce4654b6 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:45.638168 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eb2da8-bd39-4c50-ba17-87391953ede1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:45.638786 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eb2da8-bd39-4c50-ba17-87391953ede1 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:45.639064 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eb2da8-bd39-4c50-ba17-87391953ede1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:45.639334 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eb2da8-bd39-4c50-ba17-87391953ede1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:45.639983 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1eb2da8-bd39-4c50-ba17-87391953ede1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:45.641706 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1eb2da8-bd39-4c50-ba17-87391953ede1 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:45.654427 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1022/1984] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:02:45 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:02:45.658803 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a68c454-74a9-42a8-aef0-aec29699f2cd admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:45.669884 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a68c454-74a9-42a8-aef0-aec29699f2cd admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:45.675361 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e26602-ab5a-4589-be19-c7b27aa2c5f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:45.676118 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e26602-ab5a-4589-be19-c7b27aa2c5f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:45.676465 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e26602-ab5a-4589-be19-c7b27aa2c5f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:45.676812 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e26602-ab5a-4589-be19-c7b27aa2c5f7 admin admin] PATH_INFO: `/v3/projects/6fac10095716417bb0b6e9f173f13fc8/users/06aff8494fb34d509bb038998943dc16/roles/5e8849303a75425b9eaa2681cc031af1` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:45.695535 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e26602-ab5a-4589-be19-c7b27aa2c5f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fac10095716417bb0b6e9f173f13fc8, user_id=06aff8494fb34d509bb038998943dc16, role_id=5e8849303a75425b9eaa2681cc031af1)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:45.698380 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e26602-ab5a-4589-be19-c7b27aa2c5f7 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:45.721584 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 963/1985] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Oct 14 13:02:45 2022] PUT /identity/v3/projects/6fac10095716417bb0b6e9f173f13fc8/users/06aff8494fb34d509bb038998943dc16/roles/5e8849303a75425b9eaa2681cc031af1 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:02:45.733978 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b194986-8a6e-4741-8329-233c522012c1 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:45.734301 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b194986-8a6e-4741-8329-233c522012c1 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:45.734576 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b194986-8a6e-4741-8329-233c522012c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:45.765069 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-0b194986-8a6e-4741-8329-233c522012c1 None None] MFA Rules not processed for user `06aff8494fb34d509bb038998943dc16`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:02:45.766494 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-0b194986-8a6e-4741-8329-233c522012c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:02:45.844060 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1023/1986] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:02:45 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:02:45.856436 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e26602-ab5a-4589-be19-c7b27aa2c5f7 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:45.858226 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-62e26602-ab5a-4589-be19-c7b27aa2c5f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:02:45.919593 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e26602-ab5a-4589-be19-c7b27aa2c5f7 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:45.923294 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df83b6f5-2718-4b26-9db0-a5b53eaf0a60 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c3c564b8c548e4beef1cbfba2ad343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:45.923905 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df83b6f5-2718-4b26-9db0-a5b53eaf0a60 service cinder] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:45.924184 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df83b6f5-2718-4b26-9db0-a5b53eaf0a60 service cinder] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:45.924456 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df83b6f5-2718-4b26-9db0-a5b53eaf0a60 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:45.934081 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df83b6f5-2718-4b26-9db0-a5b53eaf0a60 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:45.935564 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df83b6f5-2718-4b26-9db0-a5b53eaf0a60 service cinder] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:45.945166 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 964/1987] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:02:45 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:02:55.840966 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:INSERT=2,keystone:SELECT=39 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:02:55.944056 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=47,keystone:INSERT=2 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:02:56.061069 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfeb212-87d2-4ea4-8868-e055cf26ef89 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:56.061364 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfeb212-87d2-4ea4-8868-e055cf26ef89 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:56.061673 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfeb212-87d2-4ea4-8868-e055cf26ef89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:56.082293 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-6cfeb212-87d2-4ea4-8868-e055cf26ef89 None None] MFA Rules not processed for user `54a6ec88e95b469c89d78cb3d4b3bc7f`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:02:56.083521 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-6cfeb212-87d2-4ea4-8868-e055cf26ef89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:02:56.141912 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1024/1988] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:02:56 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:02:56.274268 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df83b6f5-2718-4b26-9db0-a5b53eaf0a60 service cinder] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:56.350857 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df83b6f5-2718-4b26-9db0-a5b53eaf0a60 service cinder] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:56.358232 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079e0521-2f28-409b-99bf-91a97c6ea761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:56.359645 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079e0521-2f28-409b-99bf-91a97c6ea761 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:56.360152 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079e0521-2f28-409b-99bf-91a97c6ea761 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:56.360641 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079e0521-2f28-409b-99bf-91a97c6ea761 admin admin] PATH_INFO: `/v3/users/06aff8494fb34d509bb038998943dc16` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:56.363032 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079e0521-2f28-409b-99bf-91a97c6ea761 admin admin] RBAC: Authorizing `identity:delete_user(user_id=06aff8494fb34d509bb038998943dc16)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:56.366303 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079e0521-2f28-409b-99bf-91a97c6ea761 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:56.437998 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-079e0521-2f28-409b-99bf-91a97c6ea761 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06aff8494fb34d509bb038998943dc16'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:56.445724 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-079e0521-2f28-409b-99bf-91a97c6ea761 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06aff8494fb34d509bb038998943dc16'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:56.446459 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-079e0521-2f28-409b-99bf-91a97c6ea761 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06aff8494fb34d509bb038998943dc16'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:56.463020 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-079e0521-2f28-409b-99bf-91a97c6ea761 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06aff8494fb34d509bb038998943dc16'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:56.486381 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-079e0521-2f28-409b-99bf-91a97c6ea761 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06aff8494fb34d509bb038998943dc16'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:56.498703 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 965/1989] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Oct 14 13:02:56 2022] DELETE /identity/v3/users/06aff8494fb34d509bb038998943dc16 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 13:02:56.503707 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36ff73e-0faa-4df3-9c09-2a63fad81723 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:56.504184 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36ff73e-0faa-4df3-9c09-2a63fad81723 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:56.504560 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36ff73e-0faa-4df3-9c09-2a63fad81723 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:56.533674 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-c36ff73e-0faa-4df3-9c09-2a63fad81723 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:02:56.535637 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-c36ff73e-0faa-4df3-9c09-2a63fad81723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:02:56.619297 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1025/1990] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:02:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:02:56.631103 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079e0521-2f28-409b-99bf-91a97c6ea761 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:56.633727 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-079e0521-2f28-409b-99bf-91a97c6ea761 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:02:56.717047 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079e0521-2f28-409b-99bf-91a97c6ea761 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:56.721203 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb672c4-bce7-40fb-9ea3-3807cf2d25a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d483292f3a4794848fcacfba5b107e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:56.722045 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb672c4-bce7-40fb-9ea3-3807cf2d25a7 service neutron] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:56.722373 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb672c4-bce7-40fb-9ea3-3807cf2d25a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:56.722786 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb672c4-bce7-40fb-9ea3-3807cf2d25a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:56.736071 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb672c4-bce7-40fb-9ea3-3807cf2d25a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:56.737525 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb672c4-bce7-40fb-9ea3-3807cf2d25a7 service neutron] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:56.748426 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 966/1991] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:02:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:02:56.754067 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36ff73e-0faa-4df3-9c09-2a63fad81723 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:56.755982 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-c36ff73e-0faa-4df3-9c09-2a63fad81723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:02:56.769477 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36ff73e-0faa-4df3-9c09-2a63fad81723 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:56.774434 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55beeebc-fb52-408c-8b47-6be5b1ee4c39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:56.775979 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55beeebc-fb52-408c-8b47-6be5b1ee4c39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:56.776398 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55beeebc-fb52-408c-8b47-6be5b1ee4c39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:56.776671 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55beeebc-fb52-408c-8b47-6be5b1ee4c39 admin admin] PATH_INFO: `/v3/users/917cea44573d4fc6ae2db974d5dadde7` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:56.777891 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55beeebc-fb52-408c-8b47-6be5b1ee4c39 admin admin] RBAC: Authorizing `identity:delete_user(user_id=917cea44573d4fc6ae2db974d5dadde7)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:56.779902 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55beeebc-fb52-408c-8b47-6be5b1ee4c39 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:56.840782 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-55beeebc-fb52-408c-8b47-6be5b1ee4c39 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '917cea44573d4fc6ae2db974d5dadde7'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:56.858909 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-55beeebc-fb52-408c-8b47-6be5b1ee4c39 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '917cea44573d4fc6ae2db974d5dadde7'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:56.860313 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-55beeebc-fb52-408c-8b47-6be5b1ee4c39 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '917cea44573d4fc6ae2db974d5dadde7'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:56.870825 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-55beeebc-fb52-408c-8b47-6be5b1ee4c39 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '917cea44573d4fc6ae2db974d5dadde7'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:56.886401 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-55beeebc-fb52-408c-8b47-6be5b1ee4c39 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '917cea44573d4fc6ae2db974d5dadde7'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:56.895898 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1026/1992] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Oct 14 13:02:56 2022] DELETE /identity/v3/users/917cea44573d4fc6ae2db974d5dadde7 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:02:56.901367 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9c7aef-c154-44fd-866e-31dc9392845e None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:56.901722 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9c7aef-c154-44fd-866e-31dc9392845e None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:56.902070 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9c7aef-c154-44fd-866e-31dc9392845e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:56.926710 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-1a9c7aef-c154-44fd-866e-31dc9392845e None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:02:56.927937 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-1a9c7aef-c154-44fd-866e-31dc9392845e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:02:56.951838 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:02:57.027953 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 967/1993] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:02:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:02:57.041506 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55beeebc-fb52-408c-8b47-6be5b1ee4c39 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:57.043227 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-55beeebc-fb52-408c-8b47-6be5b1ee4c39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:02:57.083182 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:02:57.152647 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55beeebc-fb52-408c-8b47-6be5b1ee4c39 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:57.158863 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9c7aef-c154-44fd-866e-31dc9392845e None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:57.160777 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-1a9c7aef-c154-44fd-866e-31dc9392845e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:02:57.161459 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e903bc7-262e-43ee-bd0b-ec993171e2e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d483292f3a4794848fcacfba5b107e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:57.162107 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e903bc7-262e-43ee-bd0b-ec993171e2e1 service neutron] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:57.162411 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e903bc7-262e-43ee-bd0b-ec993171e2e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:57.162726 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e903bc7-262e-43ee-bd0b-ec993171e2e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:57.179677 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e903bc7-262e-43ee-bd0b-ec993171e2e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:57.181619 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e903bc7-262e-43ee-bd0b-ec993171e2e1 service neutron] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:57.187154 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9c7aef-c154-44fd-866e-31dc9392845e None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:57.193117 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7873d14-9380-4486-9305-a473daa12e9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:57.193682 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1027/1994] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:02:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:02:57.194049 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7873d14-9380-4486-9305-a473daa12e9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:57.194523 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7873d14-9380-4486-9305-a473daa12e9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:57.194870 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7873d14-9380-4486-9305-a473daa12e9b admin admin] PATH_INFO: `/v3/projects/6fac10095716417bb0b6e9f173f13fc8` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:57.196328 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7873d14-9380-4486-9305-a473daa12e9b admin admin] RBAC: Authorizing `identity:delete_project(project_id=6fac10095716417bb0b6e9f173f13fc8)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:57.199725 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7873d14-9380-4486-9305-a473daa12e9b admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:57.267146 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-f7873d14-9380-4486-9305-a473daa12e9b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6fac10095716417bb0b6e9f173f13fc8', 'request_id': 'req-f7873d14-9380-4486-9305-a473daa12e9b'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:57.276420 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-f7873d14-9380-4486-9305-a473daa12e9b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6fac10095716417bb0b6e9f173f13fc8', 'request_id': 'req-f7873d14-9380-4486-9305-a473daa12e9b'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:57.283992 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-f7873d14-9380-4486-9305-a473daa12e9b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6fac10095716417bb0b6e9f173f13fc8', 'request_id': 'req-f7873d14-9380-4486-9305-a473daa12e9b'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:57.302990 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-f7873d14-9380-4486-9305-a473daa12e9b admin admin] The token cache is being invalidate because project 6fac10095716417bb0b6e9f173f13fc8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:02:57.303639 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-f7873d14-9380-4486-9305-a473daa12e9b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:57.305162 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-f7873d14-9380-4486-9305-a473daa12e9b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:57.308036 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 968/1995] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Oct 14 13:02:57 2022] DELETE /identity/v3/projects/6fac10095716417bb0b6e9f173f13fc8 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 13:02:57.573700 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e903bc7-262e-43ee-bd0b-ec993171e2e1 service neutron] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:57.576251 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-0e903bc7-262e-43ee-bd0b-ec993171e2e1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:02:57.599082 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e903bc7-262e-43ee-bd0b-ec993171e2e1 service neutron] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:57.674579 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed69dee-8973-4e37-933e-cdca86592d16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:57.675223 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed69dee-8973-4e37-933e-cdca86592d16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:57.675502 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed69dee-8973-4e37-933e-cdca86592d16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:57.675776 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed69dee-8973-4e37-933e-cdca86592d16 admin admin] PATH_INFO: `/v3/projects/b3c0cb983b444a74976e5bcec327bf1b` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:57.677065 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed69dee-8973-4e37-933e-cdca86592d16 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3c0cb983b444a74976e5bcec327bf1b)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:57.679057 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed69dee-8973-4e37-933e-cdca86592d16 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:57.747782 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-0ed69dee-8973-4e37-933e-cdca86592d16 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3c0cb983b444a74976e5bcec327bf1b', 'request_id': 'req-0ed69dee-8973-4e37-933e-cdca86592d16'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:57.753367 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-0ed69dee-8973-4e37-933e-cdca86592d16 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3c0cb983b444a74976e5bcec327bf1b', 'request_id': 'req-0ed69dee-8973-4e37-933e-cdca86592d16'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:57.760356 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-0ed69dee-8973-4e37-933e-cdca86592d16 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3c0cb983b444a74976e5bcec327bf1b', 'request_id': 'req-0ed69dee-8973-4e37-933e-cdca86592d16'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:57.773844 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-0ed69dee-8973-4e37-933e-cdca86592d16 admin admin] The token cache is being invalidate because project b3c0cb983b444a74976e5bcec327bf1b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:02:57.774162 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-0ed69dee-8973-4e37-933e-cdca86592d16 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:57.779969 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-0ed69dee-8973-4e37-933e-cdca86592d16 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:57.779969 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1028/1996] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Oct 14 13:02:57 2022] DELETE /identity/v3/projects/b3c0cb983b444a74976e5bcec327bf1b => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:02:57.782388 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7873d14-9380-4486-9305-a473daa12e9b admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:57.784244 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-f7873d14-9380-4486-9305-a473daa12e9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:02:57.799059 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7873d14-9380-4486-9305-a473daa12e9b admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:57.870170 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d75204-cf0c-41f2-9836-3043d04fcc27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:57.870820 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d75204-cf0c-41f2-9836-3043d04fcc27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:57.871098 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d75204-cf0c-41f2-9836-3043d04fcc27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:57.871371 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d75204-cf0c-41f2-9836-3043d04fcc27 admin admin] PATH_INFO: `/v3/users/327e8f1f903c4798a4cc2d74ec2a3ce3` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:57.872517 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d75204-cf0c-41f2-9836-3043d04fcc27 admin admin] RBAC: Authorizing `identity:delete_user(user_id=327e8f1f903c4798a4cc2d74ec2a3ce3)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:57.874643 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d75204-cf0c-41f2-9836-3043d04fcc27 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:57.927717 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-c3d75204-cf0c-41f2-9836-3043d04fcc27 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '327e8f1f903c4798a4cc2d74ec2a3ce3'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:57.929731 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:02:57.943048 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-c3d75204-cf0c-41f2-9836-3043d04fcc27 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '327e8f1f903c4798a4cc2d74ec2a3ce3'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:57.944299 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-c3d75204-cf0c-41f2-9836-3043d04fcc27 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '327e8f1f903c4798a4cc2d74ec2a3ce3'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:57.955269 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-c3d75204-cf0c-41f2-9836-3043d04fcc27 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '327e8f1f903c4798a4cc2d74ec2a3ce3'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:57.968419 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-c3d75204-cf0c-41f2-9836-3043d04fcc27 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '327e8f1f903c4798a4cc2d74ec2a3ce3'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:57.975123 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 969/1997] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Oct 14 13:02:57 2022] DELETE /identity/v3/users/327e8f1f903c4798a4cc2d74ec2a3ce3 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:02:58.286627 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed69dee-8973-4e37-933e-cdca86592d16 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:58.288220 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-0ed69dee-8973-4e37-933e-cdca86592d16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:02:58.303286 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed69dee-8973-4e37-933e-cdca86592d16 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:58.361798 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:02:58.374866 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76507d7d-b7b6-46e4-84f1-f3a7c94fe4db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:58.375589 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76507d7d-b7b6-46e4-84f1-f3a7c94fe4db admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:58.375921 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76507d7d-b7b6-46e4-84f1-f3a7c94fe4db admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:58.376197 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76507d7d-b7b6-46e4-84f1-f3a7c94fe4db admin admin] PATH_INFO: `/v3/projects/34659a1c5f924117adcae53be9f05022` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:58.377941 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76507d7d-b7b6-46e4-84f1-f3a7c94fe4db admin admin] RBAC: Authorizing `identity:delete_project(project_id=34659a1c5f924117adcae53be9f05022)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:58.379705 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76507d7d-b7b6-46e4-84f1-f3a7c94fe4db admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:58.447885 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-76507d7d-b7b6-46e4-84f1-f3a7c94fe4db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34659a1c5f924117adcae53be9f05022', 'request_id': 'req-76507d7d-b7b6-46e4-84f1-f3a7c94fe4db'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:58.456768 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-76507d7d-b7b6-46e4-84f1-f3a7c94fe4db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34659a1c5f924117adcae53be9f05022', 'request_id': 'req-76507d7d-b7b6-46e4-84f1-f3a7c94fe4db'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:58.464812 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-76507d7d-b7b6-46e4-84f1-f3a7c94fe4db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34659a1c5f924117adcae53be9f05022', 'request_id': 'req-76507d7d-b7b6-46e4-84f1-f3a7c94fe4db'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:58.480784 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-76507d7d-b7b6-46e4-84f1-f3a7c94fe4db admin admin] The token cache is being invalidate because project 34659a1c5f924117adcae53be9f05022 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:02:58.481195 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-76507d7d-b7b6-46e4-84f1-f3a7c94fe4db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:58.482112 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-76507d7d-b7b6-46e4-84f1-f3a7c94fe4db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:02:58.483701 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1029/1998] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Oct 14 13:02:58 2022] DELETE /identity/v3/projects/34659a1c5f924117adcae53be9f05022 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 13:02:58.489437 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af48ef97-9a6f-4e4e-bea4-cf5aacc989d4 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:58.489811 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af48ef97-9a6f-4e4e-bea4-cf5aacc989d4 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:58.490264 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af48ef97-9a6f-4e4e-bea4-cf5aacc989d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:58.515873 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-af48ef97-9a6f-4e4e-bea4-cf5aacc989d4 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:02:58.517478 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-af48ef97-9a6f-4e4e-bea4-cf5aacc989d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:02:58.595387 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 970/1999] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:02:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:02:58.603673 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd90bb0-5b51-4dc6-a0ff-1b524d4566e8 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:58.603954 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd90bb0-5b51-4dc6-a0ff-1b524d4566e8 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:58.604235 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd90bb0-5b51-4dc6-a0ff-1b524d4566e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:58.625057 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-acd90bb0-5b51-4dc6-a0ff-1b524d4566e8 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:02:58.626349 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-acd90bb0-5b51-4dc6-a0ff-1b524d4566e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:02:58.635995 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1030/2000] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:02:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:02:58.640994 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af48ef97-9a6f-4e4e-bea4-cf5aacc989d4 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:58.656125 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af48ef97-9a6f-4e4e-bea4-cf5aacc989d4 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:58.660932 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264a8256-eea5-40b9-8954-5916b11e2909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:58.661567 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264a8256-eea5-40b9-8954-5916b11e2909 admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:58.661847 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264a8256-eea5-40b9-8954-5916b11e2909 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:58.662130 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264a8256-eea5-40b9-8954-5916b11e2909 admin admin] PATH_INFO: `/v3/domains` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:58.662806 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264a8256-eea5-40b9-8954-5916b11e2909 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 13:02:58.663114 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264a8256-eea5-40b9-8954-5916b11e2909 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:58.664730 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264a8256-eea5-40b9-8954-5916b11e2909 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:58.677379 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 971/2001] 10.222.0.17 () {58 vars in 1153 bytes} [Fri Oct 14 13:02:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 13:02:58.681967 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd90bb0-5b51-4dc6-a0ff-1b524d4566e8 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:58.692778 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd90bb0-5b51-4dc6-a0ff-1b524d4566e8 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:58.699256 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc8638f-0866-461f-a500-974327fed669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:58.699883 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc8638f-0866-461f-a500-974327fed669 admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:58.700159 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc8638f-0866-461f-a500-974327fed669 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:58.700426 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc8638f-0866-461f-a500-974327fed669 admin admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:58.701057 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc8638f-0866-461f-a500-974327fed669 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:58.703026 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc8638f-0866-461f-a500-974327fed669 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:58.737274 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1031/2002] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Oct 14 13:02:58 2022] POST /identity/v3/projects => generated 381 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:02:58.742255 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264a8256-eea5-40b9-8954-5916b11e2909 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:58.755187 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264a8256-eea5-40b9-8954-5916b11e2909 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:58.819704 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f719bd99-0ea5-48e5-a13c-b0a96e44377a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:58.820237 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f719bd99-0ea5-48e5-a13c-b0a96e44377a admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:58.820527 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f719bd99-0ea5-48e5-a13c-b0a96e44377a admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:58.820799 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f719bd99-0ea5-48e5-a13c-b0a96e44377a admin admin] PATH_INFO: `/v3/users` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:58.822055 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f719bd99-0ea5-48e5-a13c-b0a96e44377a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:58.824621 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f719bd99-0ea5-48e5-a13c-b0a96e44377a admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:58.850144 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 972/2003] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Oct 14 13:02:58 2022] POST /identity/v3/users => generated 291 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:02:58.854755 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc8638f-0866-461f-a500-974327fed669 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:58.866310 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc8638f-0866-461f-a500-974327fed669 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:58.873078 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cd3750-4e65-4c92-a5e8-45ae645b3601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:58.873710 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cd3750-4e65-4c92-a5e8-45ae645b3601 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:58.873991 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cd3750-4e65-4c92-a5e8-45ae645b3601 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:58.874294 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cd3750-4e65-4c92-a5e8-45ae645b3601 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:58.874974 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cd3750-4e65-4c92-a5e8-45ae645b3601 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:58.876606 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cd3750-4e65-4c92-a5e8-45ae645b3601 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:58.891185 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1032/2004] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:02:58 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 14 13:02:58.892536 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f719bd99-0ea5-48e5-a13c-b0a96e44377a admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:58.903540 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f719bd99-0ea5-48e5-a13c-b0a96e44377a admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:58.908582 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e508d8a4-8147-49c6-8d2e-f2778d5eaddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:58.909203 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e508d8a4-8147-49c6-8d2e-f2778d5eaddc admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:58.909481 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e508d8a4-8147-49c6-8d2e-f2778d5eaddc admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:58.909923 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e508d8a4-8147-49c6-8d2e-f2778d5eaddc admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:58.910597 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e508d8a4-8147-49c6-8d2e-f2778d5eaddc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:58.912207 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e508d8a4-8147-49c6-8d2e-f2778d5eaddc admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:58.926393 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 973/2005] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:02:58 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:02:58.931497 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cd3750-4e65-4c92-a5e8-45ae645b3601 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:58.942845 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cd3750-4e65-4c92-a5e8-45ae645b3601 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:58.949688 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1190830-2518-4439-8515-f64dea0a3c13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:58.950422 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1190830-2518-4439-8515-f64dea0a3c13 admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:58.950836 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1190830-2518-4439-8515-f64dea0a3c13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:58.951114 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1190830-2518-4439-8515-f64dea0a3c13 admin admin] PATH_INFO: `/v3/projects/f4cbcd93ac7741f281df743d0315cb90/users/96ebccff5a1b412f818fd7a465dfd05b/roles/5e8849303a75425b9eaa2681cc031af1` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:58.973737 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1190830-2518-4439-8515-f64dea0a3c13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4cbcd93ac7741f281df743d0315cb90, user_id=96ebccff5a1b412f818fd7a465dfd05b, role_id=5e8849303a75425b9eaa2681cc031af1)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:58.976499 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1190830-2518-4439-8515-f64dea0a3c13 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:58.996382 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1033/2006] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Oct 14 13:02:58 2022] PUT /identity/v3/projects/f4cbcd93ac7741f281df743d0315cb90/users/96ebccff5a1b412f818fd7a465dfd05b/roles/5e8849303a75425b9eaa2681cc031af1 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:02:59.012117 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a47429-57e0-4bb6-90b5-26d0e7d0a27b None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:59.012117 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a47429-57e0-4bb6-90b5-26d0e7d0a27b None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:59.012117 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a47429-57e0-4bb6-90b5-26d0e7d0a27b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:59.050371 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-39a47429-57e0-4bb6-90b5-26d0e7d0a27b None None] MFA Rules not processed for user `96ebccff5a1b412f818fd7a465dfd05b`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:02:59.051633 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-39a47429-57e0-4bb6-90b5-26d0e7d0a27b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:02:59.074285 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:02:59.157500 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 974/2007] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:02:59 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:02:59.161841 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1190830-2518-4439-8515-f64dea0a3c13 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:59.263891 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1190830-2518-4439-8515-f64dea0a3c13 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:59.269000 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8baa29-4139-4fef-b316-5215293c1138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:59.269625 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8baa29-4139-4fef-b316-5215293c1138 admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:59.270048 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8baa29-4139-4fef-b316-5215293c1138 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:59.270355 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8baa29-4139-4fef-b316-5215293c1138 admin admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:59.271010 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8baa29-4139-4fef-b316-5215293c1138 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:59.272943 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8baa29-4139-4fef-b316-5215293c1138 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:59.316872 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1034/2008] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Oct 14 13:02:59 2022] POST /identity/v3/projects => generated 383 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 13:02:59.317494 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a47429-57e0-4bb6-90b5-26d0e7d0a27b None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:59.329174 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a47429-57e0-4bb6-90b5-26d0e7d0a27b None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:59.402873 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2134397e-e130-4bed-8fb3-1599ff233f15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:59.403836 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2134397e-e130-4bed-8fb3-1599ff233f15 admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:59.404339 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2134397e-e130-4bed-8fb3-1599ff233f15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:59.404801 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2134397e-e130-4bed-8fb3-1599ff233f15 admin admin] PATH_INFO: `/v3/users` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:59.405686 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2134397e-e130-4bed-8fb3-1599ff233f15 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:59.407927 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2134397e-e130-4bed-8fb3-1599ff233f15 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:59.441429 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 975/2009] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Oct 14 13:02:59 2022] POST /identity/v3/users => generated 298 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:02:59.446481 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8baa29-4139-4fef-b316-5215293c1138 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:59.456977 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:02:59.466236 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8baa29-4139-4fef-b316-5215293c1138 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:59.475041 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2848fa-e536-4648-8679-9839f307bc9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:59.475854 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2848fa-e536-4648-8679-9839f307bc9f admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:59.476287 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2848fa-e536-4648-8679-9839f307bc9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:59.476673 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2848fa-e536-4648-8679-9839f307bc9f admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:59.477464 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2848fa-e536-4648-8679-9839f307bc9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:59.481087 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2848fa-e536-4648-8679-9839f307bc9f admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:59.497029 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1035/2010] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:02:59 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 14 13:02:59.501385 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2134397e-e130-4bed-8fb3-1599ff233f15 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:59.512837 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2134397e-e130-4bed-8fb3-1599ff233f15 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:59.519711 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7f594f-9ce0-4dac-ad71-c0b1980023b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:59.520397 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7f594f-9ce0-4dac-ad71-c0b1980023b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:59.520681 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7f594f-9ce0-4dac-ad71-c0b1980023b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:59.520957 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7f594f-9ce0-4dac-ad71-c0b1980023b7 admin admin] PATH_INFO: `/v3/projects/be8a4efe4f87486a889c26b10544eb84/users/b49e31432ee645688fc7ddaaf8ac183e/roles/7f6e29e390bc41f7a9af17659a2e95d1` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:59.540500 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7f594f-9ce0-4dac-ad71-c0b1980023b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be8a4efe4f87486a889c26b10544eb84, user_id=b49e31432ee645688fc7ddaaf8ac183e, role_id=7f6e29e390bc41f7a9af17659a2e95d1)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:59.543773 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7f594f-9ce0-4dac-ad71-c0b1980023b7 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:59.561120 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 976/2011] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Oct 14 13:02:59 2022] PUT /identity/v3/projects/be8a4efe4f87486a889c26b10544eb84/users/b49e31432ee645688fc7ddaaf8ac183e/roles/7f6e29e390bc41f7a9af17659a2e95d1 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:02:59.565339 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2848fa-e536-4648-8679-9839f307bc9f admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:59.579329 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2848fa-e536-4648-8679-9839f307bc9f admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:59.653886 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133b590f-e585-4507-aa10-afdbd050856f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:59.654557 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133b590f-e585-4507-aa10-afdbd050856f admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:59.654878 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133b590f-e585-4507-aa10-afdbd050856f admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:59.655113 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133b590f-e585-4507-aa10-afdbd050856f admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:59.655771 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133b590f-e585-4507-aa10-afdbd050856f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:59.657397 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133b590f-e585-4507-aa10-afdbd050856f admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:59.668718 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1036/2012] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:02:59 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:02:59.673065 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7f594f-9ce0-4dac-ad71-c0b1980023b7 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:59.685096 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7f594f-9ce0-4dac-ad71-c0b1980023b7 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:59.691093 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfacb4bf-a0f4-4f9c-b26d-a4a66aa0430b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:59.691848 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfacb4bf-a0f4-4f9c-b26d-a4a66aa0430b admin admin] REQUEST_METHOD: `PUT` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:59.692172 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfacb4bf-a0f4-4f9c-b26d-a4a66aa0430b admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:59.692539 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfacb4bf-a0f4-4f9c-b26d-a4a66aa0430b admin admin] PATH_INFO: `/v3/projects/be8a4efe4f87486a889c26b10544eb84/users/b49e31432ee645688fc7ddaaf8ac183e/roles/7f6e29e390bc41f7a9af17659a2e95d1` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:59.695254 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfacb4bf-a0f4-4f9c-b26d-a4a66aa0430b admin admin] RBAC: Authorizing `identity:create_grant(project_id=be8a4efe4f87486a889c26b10544eb84, user_id=b49e31432ee645688fc7ddaaf8ac183e, role_id=7f6e29e390bc41f7a9af17659a2e95d1)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:59.698036 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfacb4bf-a0f4-4f9c-b26d-a4a66aa0430b admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:59.710057 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 977/2013] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Oct 14 13:02:59 2022] PUT /identity/v3/projects/be8a4efe4f87486a889c26b10544eb84/users/b49e31432ee645688fc7ddaaf8ac183e/roles/7f6e29e390bc41f7a9af17659a2e95d1 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:02:59.721059 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e808c334-fd93-4004-b320-084260b6bf57 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:59.721348 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e808c334-fd93-4004-b320-084260b6bf57 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:59.721622 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e808c334-fd93-4004-b320-084260b6bf57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:59.753031 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-e808c334-fd93-4004-b320-084260b6bf57 None None] MFA Rules not processed for user `b49e31432ee645688fc7ddaaf8ac183e`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:02:59.754339 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-e808c334-fd93-4004-b320-084260b6bf57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:02:59.837442 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1037/2014] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:02:59 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:02:59.849008 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfacb4bf-a0f4-4f9c-b26d-a4a66aa0430b admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:02:59.850739 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-cfacb4bf-a0f4-4f9c-b26d-a4a66aa0430b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:02:59.915298 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfacb4bf-a0f4-4f9c-b26d-a4a66aa0430b admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:02:59.919163 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a44e8a-9791-4d35-b7bb-2da70f10a32f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c3c564b8c548e4beef1cbfba2ad343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:02:59.919787 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a44e8a-9791-4d35-b7bb-2da70f10a32f service cinder] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:02:59.920069 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a44e8a-9791-4d35-b7bb-2da70f10a32f service cinder] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:02:59.920347 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a44e8a-9791-4d35-b7bb-2da70f10a32f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:02:59.930039 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a44e8a-9791-4d35-b7bb-2da70f10a32f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:02:59.932287 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a44e8a-9791-4d35-b7bb-2da70f10a32f service cinder] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:02:59.942615 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 978/2015] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:02:59 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:03:00.080413 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e808c334-fd93-4004-b320-084260b6bf57 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:03:00.102323 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e808c334-fd93-4004-b320-084260b6bf57 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:03:00.112723 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd576ea-0e46-4a4c-86e1-dae51a51c4cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c3c564b8c548e4beef1cbfba2ad343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:03:00.113443 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd576ea-0e46-4a4c-86e1-dae51a51c4cc service cinder] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:03:00.113732 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd576ea-0e46-4a4c-86e1-dae51a51c4cc service cinder] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:03:00.114034 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd576ea-0e46-4a4c-86e1-dae51a51c4cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:03:00.188108 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd576ea-0e46-4a4c-86e1-dae51a51c4cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:03:00.189579 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd576ea-0e46-4a4c-86e1-dae51a51c4cc service cinder] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:03:00.199804 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1038/2016] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:03:00 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:03:02.881434 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a44e8a-9791-4d35-b7bb-2da70f10a32f service cinder] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:03:02.899047 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:03:02.961541 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a44e8a-9791-4d35-b7bb-2da70f10a32f service cinder] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:03:02.967007 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740e0198-1f21-470f-89b2-8f499b09d99c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:03:02.967645 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740e0198-1f21-470f-89b2-8f499b09d99c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:03:02.967928 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740e0198-1f21-470f-89b2-8f499b09d99c admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:03:02.968232 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740e0198-1f21-470f-89b2-8f499b09d99c admin admin] PATH_INFO: `/v3/users/96ebccff5a1b412f818fd7a465dfd05b` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:03:02.975002 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740e0198-1f21-470f-89b2-8f499b09d99c admin admin] RBAC: Authorizing `identity:delete_user(user_id=96ebccff5a1b412f818fd7a465dfd05b)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:03:02.976962 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740e0198-1f21-470f-89b2-8f499b09d99c admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:03:03.030098 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-740e0198-1f21-470f-89b2-8f499b09d99c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96ebccff5a1b412f818fd7a465dfd05b'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:03:03.038511 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-740e0198-1f21-470f-89b2-8f499b09d99c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96ebccff5a1b412f818fd7a465dfd05b'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:03:03.039228 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-740e0198-1f21-470f-89b2-8f499b09d99c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96ebccff5a1b412f818fd7a465dfd05b'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:03:03.048726 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-740e0198-1f21-470f-89b2-8f499b09d99c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96ebccff5a1b412f818fd7a465dfd05b'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:03:03.062220 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-740e0198-1f21-470f-89b2-8f499b09d99c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96ebccff5a1b412f818fd7a465dfd05b'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:03:03.069010 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 979/2017] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Oct 14 13:03:02 2022] DELETE /identity/v3/users/96ebccff5a1b412f818fd7a465dfd05b => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:03:03.074355 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fde6852-9fbd-4a90-90b9-a64617b5b52b None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:03:03.074911 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fde6852-9fbd-4a90-90b9-a64617b5b52b None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:03:03.074911 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fde6852-9fbd-4a90-90b9-a64617b5b52b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:03:03.098705 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-0fde6852-9fbd-4a90-90b9-a64617b5b52b None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:03:03.099960 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-0fde6852-9fbd-4a90-90b9-a64617b5b52b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:03:03.106148 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:03:03.170169 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1039/2018] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:03:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:03:03.180463 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740e0198-1f21-470f-89b2-8f499b09d99c admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:03:03.181913 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-740e0198-1f21-470f-89b2-8f499b09d99c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:03:03.246308 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740e0198-1f21-470f-89b2-8f499b09d99c admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:03:03.250012 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dac2b8-022e-4523-bb6f-9a99dcd299a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d483292f3a4794848fcacfba5b107e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:03:03.250649 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dac2b8-022e-4523-bb6f-9a99dcd299a0 service neutron] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:03:03.250930 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dac2b8-022e-4523-bb6f-9a99dcd299a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:03:03.251201 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dac2b8-022e-4523-bb6f-9a99dcd299a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:03:03.261790 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dac2b8-022e-4523-bb6f-9a99dcd299a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:03:03.263310 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dac2b8-022e-4523-bb6f-9a99dcd299a0 service neutron] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:03:03.278543 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 980/2019] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:03:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:03:03.804337 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fde6852-9fbd-4a90-90b9-a64617b5b52b None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:03:03.807243 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-0fde6852-9fbd-4a90-90b9-a64617b5b52b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:03:03.826524 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fde6852-9fbd-4a90-90b9-a64617b5b52b None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:03:03.832605 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143980a3-78c3-49e1-9ed9-f98afe8c8917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:03:03.833305 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143980a3-78c3-49e1-9ed9-f98afe8c8917 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:03:03.833592 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143980a3-78c3-49e1-9ed9-f98afe8c8917 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:03:03.833948 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143980a3-78c3-49e1-9ed9-f98afe8c8917 admin admin] PATH_INFO: `/v3/projects/f4cbcd93ac7741f281df743d0315cb90` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:03:03.835397 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143980a3-78c3-49e1-9ed9-f98afe8c8917 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4cbcd93ac7741f281df743d0315cb90)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:03:03.837758 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143980a3-78c3-49e1-9ed9-f98afe8c8917 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:03:03.888419 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-143980a3-78c3-49e1-9ed9-f98afe8c8917 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4cbcd93ac7741f281df743d0315cb90', 'request_id': 'req-143980a3-78c3-49e1-9ed9-f98afe8c8917'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:03:03.894060 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-143980a3-78c3-49e1-9ed9-f98afe8c8917 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4cbcd93ac7741f281df743d0315cb90', 'request_id': 'req-143980a3-78c3-49e1-9ed9-f98afe8c8917'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:03:03.900974 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-143980a3-78c3-49e1-9ed9-f98afe8c8917 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4cbcd93ac7741f281df743d0315cb90', 'request_id': 'req-143980a3-78c3-49e1-9ed9-f98afe8c8917'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:03:03.920492 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-143980a3-78c3-49e1-9ed9-f98afe8c8917 admin admin] The token cache is being invalidate because project f4cbcd93ac7741f281df743d0315cb90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:03:03.920786 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-143980a3-78c3-49e1-9ed9-f98afe8c8917 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:03:03.921448 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-143980a3-78c3-49e1-9ed9-f98afe8c8917 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:03:03.922990 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1040/2020] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Oct 14 13:03:03 2022] DELETE /identity/v3/projects/f4cbcd93ac7741f281df743d0315cb90 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 13:03:03.927364 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dac2b8-022e-4523-bb6f-9a99dcd299a0 service neutron] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:03:03.938559 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dac2b8-022e-4523-bb6f-9a99dcd299a0 service neutron] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:03:03.974149 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:03:03.999693 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0373f0f6-49d9-4300-bead-cd3a6d8b80f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:03:04.000327 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0373f0f6-49d9-4300-bead-cd3a6d8b80f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:03:04.000610 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0373f0f6-49d9-4300-bead-cd3a6d8b80f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:03:04.000887 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0373f0f6-49d9-4300-bead-cd3a6d8b80f7 admin admin] PATH_INFO: `/v3/users/b49e31432ee645688fc7ddaaf8ac183e` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:03:04.002023 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0373f0f6-49d9-4300-bead-cd3a6d8b80f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b49e31432ee645688fc7ddaaf8ac183e)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:03:04.003994 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0373f0f6-49d9-4300-bead-cd3a6d8b80f7 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:03:04.060122 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-0373f0f6-49d9-4300-bead-cd3a6d8b80f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b49e31432ee645688fc7ddaaf8ac183e'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:03:04.067416 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-0373f0f6-49d9-4300-bead-cd3a6d8b80f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b49e31432ee645688fc7ddaaf8ac183e'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:03:04.068156 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-0373f0f6-49d9-4300-bead-cd3a6d8b80f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b49e31432ee645688fc7ddaaf8ac183e'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:03:04.075756 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-0373f0f6-49d9-4300-bead-cd3a6d8b80f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b49e31432ee645688fc7ddaaf8ac183e'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:03:04.095075 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-0373f0f6-49d9-4300-bead-cd3a6d8b80f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b49e31432ee645688fc7ddaaf8ac183e'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:03:04.102089 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 981/2021] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Oct 14 13:03:03 2022] DELETE /identity/v3/users/b49e31432ee645688fc7ddaaf8ac183e => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:03:04.395778 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143980a3-78c3-49e1-9ed9-f98afe8c8917 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:03:04.397753 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-143980a3-78c3-49e1-9ed9-f98afe8c8917 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:03:04.413352 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143980a3-78c3-49e1-9ed9-f98afe8c8917 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:03:04.475442 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a15e47-5761-4c58-bec9-bcddcf08a39a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:03:04.476087 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a15e47-5761-4c58-bec9-bcddcf08a39a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:03:04.476368 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a15e47-5761-4c58-bec9-bcddcf08a39a admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:03:04.476645 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a15e47-5761-4c58-bec9-bcddcf08a39a admin admin] PATH_INFO: `/v3/projects/be8a4efe4f87486a889c26b10544eb84` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:03:04.478667 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a15e47-5761-4c58-bec9-bcddcf08a39a admin admin] RBAC: Authorizing `identity:delete_project(project_id=be8a4efe4f87486a889c26b10544eb84)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:03:04.480789 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a15e47-5761-4c58-bec9-bcddcf08a39a admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:03:04.528861 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:03:04.544184 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-a1a15e47-5761-4c58-bec9-bcddcf08a39a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be8a4efe4f87486a889c26b10544eb84', 'request_id': 'req-a1a15e47-5761-4c58-bec9-bcddcf08a39a'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:03:04.553457 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-a1a15e47-5761-4c58-bec9-bcddcf08a39a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be8a4efe4f87486a889c26b10544eb84', 'request_id': 'req-a1a15e47-5761-4c58-bec9-bcddcf08a39a'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:03:04.563760 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-a1a15e47-5761-4c58-bec9-bcddcf08a39a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be8a4efe4f87486a889c26b10544eb84', 'request_id': 'req-a1a15e47-5761-4c58-bec9-bcddcf08a39a'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:03:04.581076 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-a1a15e47-5761-4c58-bec9-bcddcf08a39a admin admin] The token cache is being invalidate because project be8a4efe4f87486a889c26b10544eb84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:03:04.581375 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-a1a15e47-5761-4c58-bec9-bcddcf08a39a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:03:04.582210 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-a1a15e47-5761-4c58-bec9-bcddcf08a39a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:03:04.584168 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1041/2022] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Oct 14 13:03:04 2022] DELETE /identity/v3/projects/be8a4efe4f87486a889c26b10544eb84 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:03:04.589711 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a264431f-4283-4236-8362-639e119c22a4 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:03:04.590004 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a264431f-4283-4236-8362-639e119c22a4 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:03:04.590482 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a264431f-4283-4236-8362-639e119c22a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:03:04.616541 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-a264431f-4283-4236-8362-639e119c22a4 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:03:04.618179 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-a264431f-4283-4236-8362-639e119c22a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:03:04.682006 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 982/2023] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:03:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 13:03:04.692664 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3a7efe-d6df-4303-90b0-5aeee34c92ed None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:03:04.693101 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3a7efe-d6df-4303-90b0-5aeee34c92ed None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:03:04.693476 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3a7efe-d6df-4303-90b0-5aeee34c92ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:03:04.717111 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-4f3a7efe-d6df-4303-90b0-5aeee34c92ed None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:03:04.718307 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-4f3a7efe-d6df-4303-90b0-5aeee34c92ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:03:04.726634 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1042/2024] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:03:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:03:04.731064 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a264431f-4283-4236-8362-639e119c22a4 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:03:04.741126 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a264431f-4283-4236-8362-639e119c22a4 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:03:04.745833 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a855e6e0-11be-4196-b8db-1877f604275e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:03:04.746475 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a855e6e0-11be-4196-b8db-1877f604275e admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:03:04.746758 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a855e6e0-11be-4196-b8db-1877f604275e admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:03:04.747032 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a855e6e0-11be-4196-b8db-1877f604275e admin admin] PATH_INFO: `/v3/domains` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:03:04.747687 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a855e6e0-11be-4196-b8db-1877f604275e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 13:03:04.747993 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a855e6e0-11be-4196-b8db-1877f604275e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:03:04.749630 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a855e6e0-11be-4196-b8db-1877f604275e admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:03:04.763289 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 983/2025] 10.222.0.17 () {58 vars in 1153 bytes} [Fri Oct 14 13:03:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 13:03:04.767869 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3a7efe-d6df-4303-90b0-5aeee34c92ed None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:03:04.778757 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3a7efe-d6df-4303-90b0-5aeee34c92ed None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:03:04.783611 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5110970-9202-4049-b9d0-bb2e28b8a4e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:03:04.784242 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5110970-9202-4049-b9d0-bb2e28b8a4e2 admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:03:04.784519 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5110970-9202-4049-b9d0-bb2e28b8a4e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:03:04.784790 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5110970-9202-4049-b9d0-bb2e28b8a4e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:03:04.785427 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5110970-9202-4049-b9d0-bb2e28b8a4e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:03:04.787388 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5110970-9202-4049-b9d0-bb2e28b8a4e2 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:03:04.818065 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1043/2026] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Oct 14 13:03:04 2022] POST /identity/v3/projects => generated 407 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:03:04.823423 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a855e6e0-11be-4196-b8db-1877f604275e admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:03:04.833780 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a855e6e0-11be-4196-b8db-1877f604275e admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:03:04.878906 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:03:04.896755 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fede4c-0ff1-4327-b14a-ea6eb4b7580a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:03:04.897400 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fede4c-0ff1-4327-b14a-ea6eb4b7580a admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:03:04.897682 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fede4c-0ff1-4327-b14a-ea6eb4b7580a admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:03:04.897986 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fede4c-0ff1-4327-b14a-ea6eb4b7580a admin admin] PATH_INFO: `/v3/users` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:03:04.898676 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fede4c-0ff1-4327-b14a-ea6eb4b7580a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:03:04.900738 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fede4c-0ff1-4327-b14a-ea6eb4b7580a admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:03:04.926815 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 984/2027] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Oct 14 13:03:04 2022] POST /identity/v3/users => generated 304 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 13:03:04.931911 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5110970-9202-4049-b9d0-bb2e28b8a4e2 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:03:04.944097 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5110970-9202-4049-b9d0-bb2e28b8a4e2 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:03:04.950352 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42c4754-5683-433d-a427-028cb4062270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:03:04.950352 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42c4754-5683-433d-a427-028cb4062270 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:03:04.950352 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42c4754-5683-433d-a427-028cb4062270 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:03:04.950352 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42c4754-5683-433d-a427-028cb4062270 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:03:04.952820 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42c4754-5683-433d-a427-028cb4062270 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:03:04.953894 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42c4754-5683-433d-a427-028cb4062270 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:03:04.965335 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1044/2028] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:03:04 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 14 13:03:04.969464 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fede4c-0ff1-4327-b14a-ea6eb4b7580a admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:03:04.980937 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fede4c-0ff1-4327-b14a-ea6eb4b7580a admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:03:04.985660 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f768af5-2dd1-4fb9-b465-75e43e5ed517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:03:04.986383 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f768af5-2dd1-4fb9-b465-75e43e5ed517 admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:03:04.986662 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f768af5-2dd1-4fb9-b465-75e43e5ed517 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:03:04.986934 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f768af5-2dd1-4fb9-b465-75e43e5ed517 admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:03:04.987582 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f768af5-2dd1-4fb9-b465-75e43e5ed517 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:03:04.989205 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f768af5-2dd1-4fb9-b465-75e43e5ed517 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:03:05.001203 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 985/2029] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:03:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:03:05.005398 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42c4754-5683-433d-a427-028cb4062270 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:03:05.016528 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42c4754-5683-433d-a427-028cb4062270 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:03:05.021435 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c673f050-f664-4e87-a37a-4ad01a887bf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:03:05.022109 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c673f050-f664-4e87-a37a-4ad01a887bf4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:03:05.022410 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c673f050-f664-4e87-a37a-4ad01a887bf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:03:05.022707 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c673f050-f664-4e87-a37a-4ad01a887bf4 admin admin] PATH_INFO: `/v3/projects/8f19bd6c3fb8417b84d27ca3161f4440/users/b758c217fb974b4c825de022d48df258/roles/5e8849303a75425b9eaa2681cc031af1` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:03:05.039017 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c673f050-f664-4e87-a37a-4ad01a887bf4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f19bd6c3fb8417b84d27ca3161f4440, user_id=b758c217fb974b4c825de022d48df258, role_id=5e8849303a75425b9eaa2681cc031af1)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:03:05.041706 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c673f050-f664-4e87-a37a-4ad01a887bf4 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:03:05.055868 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1045/2030] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Oct 14 13:03:05 2022] PUT /identity/v3/projects/8f19bd6c3fb8417b84d27ca3161f4440/users/b758c217fb974b4c825de022d48df258/roles/5e8849303a75425b9eaa2681cc031af1 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 13:03:05.068114 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ae7024-cf95-4438-9106-f2a328b232d9 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:03:05.068429 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ae7024-cf95-4438-9106-f2a328b232d9 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:03:05.068736 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ae7024-cf95-4438-9106-f2a328b232d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:03:05.099349 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-98ae7024-cf95-4438-9106-f2a328b232d9 None None] MFA Rules not processed for user `b758c217fb974b4c825de022d48df258`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:03:05.100647 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-98ae7024-cf95-4438-9106-f2a328b232d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:03:05.171701 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 986/2031] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:03:05 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:03:05.176463 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c673f050-f664-4e87-a37a-4ad01a887bf4 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:03:05.241188 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c673f050-f664-4e87-a37a-4ad01a887bf4 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:03:05.246951 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2665d50-f7d0-4b96-8656-83d93c6fcf0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:03:05.247566 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2665d50-f7d0-4b96-8656-83d93c6fcf0c admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:03:05.247844 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2665d50-f7d0-4b96-8656-83d93c6fcf0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:03:05.248116 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2665d50-f7d0-4b96-8656-83d93c6fcf0c admin admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:03:05.248760 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2665d50-f7d0-4b96-8656-83d93c6fcf0c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:03:05.250725 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2665d50-f7d0-4b96-8656-83d93c6fcf0c admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:03:05.281147 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1046/2032] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Oct 14 13:03:05 2022] POST /identity/v3/projects => generated 409 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 13:03:05.285197 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ae7024-cf95-4438-9106-f2a328b232d9 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:03:05.297268 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ae7024-cf95-4438-9106-f2a328b232d9 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:03:05.356732 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f08d9b5-bb24-49e3-9b50-b462afec1e41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:03:05.357376 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f08d9b5-bb24-49e3-9b50-b462afec1e41 admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:03:05.357676 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f08d9b5-bb24-49e3-9b50-b462afec1e41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:03:05.357931 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f08d9b5-bb24-49e3-9b50-b462afec1e41 admin admin] PATH_INFO: `/v3/users` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:03:05.358607 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f08d9b5-bb24-49e3-9b50-b462afec1e41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:03:05.360521 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f08d9b5-bb24-49e3-9b50-b462afec1e41 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:03:05.383043 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 987/2033] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Oct 14 13:03:05 2022] POST /identity/v3/users => generated 311 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:03:05.387486 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2665d50-f7d0-4b96-8656-83d93c6fcf0c admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:03:05.397963 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2665d50-f7d0-4b96-8656-83d93c6fcf0c admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:03:05.402964 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcf808f-0ce7-4cc3-90a1-38f6af962fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:03:05.403580 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcf808f-0ce7-4cc3-90a1-38f6af962fa2 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:03:05.403868 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcf808f-0ce7-4cc3-90a1-38f6af962fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:03:05.404143 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcf808f-0ce7-4cc3-90a1-38f6af962fa2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:03:05.404822 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcf808f-0ce7-4cc3-90a1-38f6af962fa2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:03:05.406516 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcf808f-0ce7-4cc3-90a1-38f6af962fa2 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:03:05.418498 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1047/2034] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:03:05 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 14 13:03:05.423385 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f08d9b5-bb24-49e3-9b50-b462afec1e41 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:03:05.438933 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f08d9b5-bb24-49e3-9b50-b462afec1e41 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:03:05.444264 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff50222d-3b61-4579-9e00-65bcdf71b5ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:03:05.444937 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff50222d-3b61-4579-9e00-65bcdf71b5ff admin admin] REQUEST_METHOD: `PUT` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:03:05.445219 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff50222d-3b61-4579-9e00-65bcdf71b5ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:03:05.445516 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff50222d-3b61-4579-9e00-65bcdf71b5ff admin admin] PATH_INFO: `/v3/projects/b3d7cf8b1d7241caa613b1bce57dff48/users/d49d5f0729104d14bbfbc06eead3e2e2/roles/7f6e29e390bc41f7a9af17659a2e95d1` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:03:05.464285 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff50222d-3b61-4579-9e00-65bcdf71b5ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3d7cf8b1d7241caa613b1bce57dff48, user_id=d49d5f0729104d14bbfbc06eead3e2e2, role_id=7f6e29e390bc41f7a9af17659a2e95d1)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:03:05.467012 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff50222d-3b61-4579-9e00-65bcdf71b5ff admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:03:05.484172 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 988/2035] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Oct 14 13:03:05 2022] PUT /identity/v3/projects/b3d7cf8b1d7241caa613b1bce57dff48/users/d49d5f0729104d14bbfbc06eead3e2e2/roles/7f6e29e390bc41f7a9af17659a2e95d1 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 13:03:05.489117 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcf808f-0ce7-4cc3-90a1-38f6af962fa2 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:03:05.509319 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcf808f-0ce7-4cc3-90a1-38f6af962fa2 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:03:05.547813 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:03:05.580087 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4b5a45-6d52-443b-952f-7cecc222e6ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:03:05.580710 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4b5a45-6d52-443b-952f-7cecc222e6ad admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:03:05.580989 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4b5a45-6d52-443b-952f-7cecc222e6ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:03:05.581263 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4b5a45-6d52-443b-952f-7cecc222e6ad admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:03:05.581916 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4b5a45-6d52-443b-952f-7cecc222e6ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:03:05.583580 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4b5a45-6d52-443b-952f-7cecc222e6ad admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:03:05.594900 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1048/2036] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:03:05 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 14 13:03:05.599141 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff50222d-3b61-4579-9e00-65bcdf71b5ff admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:03:05.615317 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff50222d-3b61-4579-9e00-65bcdf71b5ff admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:03:05.620458 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588675a3-8784-4e40-85d6-daba74b2feb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:03:05.621130 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588675a3-8784-4e40-85d6-daba74b2feb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:03:05.621407 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588675a3-8784-4e40-85d6-daba74b2feb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:03:05.621679 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588675a3-8784-4e40-85d6-daba74b2feb8 admin admin] PATH_INFO: `/v3/projects/b3d7cf8b1d7241caa613b1bce57dff48/users/d49d5f0729104d14bbfbc06eead3e2e2/roles/7f6e29e390bc41f7a9af17659a2e95d1` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:03:05.624295 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588675a3-8784-4e40-85d6-daba74b2feb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3d7cf8b1d7241caa613b1bce57dff48, user_id=d49d5f0729104d14bbfbc06eead3e2e2, role_id=7f6e29e390bc41f7a9af17659a2e95d1)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:03:05.627053 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588675a3-8784-4e40-85d6-daba74b2feb8 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:03:05.640273 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 989/2037] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Oct 14 13:03:05 2022] PUT /identity/v3/projects/b3d7cf8b1d7241caa613b1bce57dff48/users/d49d5f0729104d14bbfbc06eead3e2e2/roles/7f6e29e390bc41f7a9af17659a2e95d1 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:03:05.651972 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4b763f-a044-4401-9515-373f6ccdfc04 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:03:05.652321 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4b763f-a044-4401-9515-373f6ccdfc04 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:03:05.652709 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4b763f-a044-4401-9515-373f6ccdfc04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:03:05.685390 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-ea4b763f-a044-4401-9515-373f6ccdfc04 None None] MFA Rules not processed for user `d49d5f0729104d14bbfbc06eead3e2e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:03:05.687095 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-ea4b763f-a044-4401-9515-373f6ccdfc04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:03:05.766813 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1049/2038] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:03:05 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:03:05.778294 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588675a3-8784-4e40-85d6-daba74b2feb8 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:03:05.780398 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-588675a3-8784-4e40-85d6-daba74b2feb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:03:05.787174 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:03:05.842925 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588675a3-8784-4e40-85d6-daba74b2feb8 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:03:05.846542 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d943dcb7-eaf0-4a3e-9a37-10c811356eb1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c3c564b8c548e4beef1cbfba2ad343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:03:05.847151 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d943dcb7-eaf0-4a3e-9a37-10c811356eb1 service cinder] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:03:05.847430 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d943dcb7-eaf0-4a3e-9a37-10c811356eb1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:03:05.847702 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d943dcb7-eaf0-4a3e-9a37-10c811356eb1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:03:05.858146 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d943dcb7-eaf0-4a3e-9a37-10c811356eb1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:03:05.859661 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d943dcb7-eaf0-4a3e-9a37-10c811356eb1 service cinder] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:03:05.870362 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 990/2039] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:03:05 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:03:06.030202 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4b763f-a044-4401-9515-373f6ccdfc04 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:03:06.040585 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4b763f-a044-4401-9515-373f6ccdfc04 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:03:06.044234 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8316b6e0-db36-4489-83fa-eaa2ac9d7670 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c3c564b8c548e4beef1cbfba2ad343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:03:06.044848 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8316b6e0-db36-4489-83fa-eaa2ac9d7670 service cinder] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:03:06.046138 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8316b6e0-db36-4489-83fa-eaa2ac9d7670 service cinder] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:03:06.046138 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8316b6e0-db36-4489-83fa-eaa2ac9d7670 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:03:06.111373 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8316b6e0-db36-4489-83fa-eaa2ac9d7670 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:03:06.112834 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8316b6e0-db36-4489-83fa-eaa2ac9d7670 service cinder] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:03:06.123214 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1050/2040] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:03:06 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:03:11.578416 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d943dcb7-eaf0-4a3e-9a37-10c811356eb1 service cinder] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:03:11.661316 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d943dcb7-eaf0-4a3e-9a37-10c811356eb1 service cinder] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:03:11.666090 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab8a164-dec3-40d5-a6d2-17c8a21e29c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:03:11.666766 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab8a164-dec3-40d5-a6d2-17c8a21e29c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:03:11.667043 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab8a164-dec3-40d5-a6d2-17c8a21e29c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:03:11.667319 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab8a164-dec3-40d5-a6d2-17c8a21e29c6 admin admin] PATH_INFO: `/v3/users/b758c217fb974b4c825de022d48df258` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:03:11.668482 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab8a164-dec3-40d5-a6d2-17c8a21e29c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b758c217fb974b4c825de022d48df258)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:03:11.670476 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab8a164-dec3-40d5-a6d2-17c8a21e29c6 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:03:11.727551 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-6ab8a164-dec3-40d5-a6d2-17c8a21e29c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b758c217fb974b4c825de022d48df258'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:03:11.734795 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-6ab8a164-dec3-40d5-a6d2-17c8a21e29c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b758c217fb974b4c825de022d48df258'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:03:11.735526 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-6ab8a164-dec3-40d5-a6d2-17c8a21e29c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b758c217fb974b4c825de022d48df258'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:03:11.744668 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-6ab8a164-dec3-40d5-a6d2-17c8a21e29c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b758c217fb974b4c825de022d48df258'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:03:11.768080 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-6ab8a164-dec3-40d5-a6d2-17c8a21e29c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b758c217fb974b4c825de022d48df258'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:03:11.775062 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 991/2041] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Oct 14 13:03:11 2022] DELETE /identity/v3/users/b758c217fb974b4c825de022d48df258 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:03:11.779781 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a031d15-1d4f-4839-80f0-9364228c0e1a None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:03:11.780284 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a031d15-1d4f-4839-80f0-9364228c0e1a None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:03:11.780408 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a031d15-1d4f-4839-80f0-9364228c0e1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:03:11.801099 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-7a031d15-1d4f-4839-80f0-9364228c0e1a None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:03:11.802421 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-7a031d15-1d4f-4839-80f0-9364228c0e1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:03:11.868875 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:03:11.881731 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1051/2042] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:03:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:03:11.892659 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab8a164-dec3-40d5-a6d2-17c8a21e29c6 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:03:11.894228 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-6ab8a164-dec3-40d5-a6d2-17c8a21e29c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:03:11.937575 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:03:11.969799 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab8a164-dec3-40d5-a6d2-17c8a21e29c6 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:03:11.974561 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd9697e-0e50-4adc-921d-d6501366ab92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d483292f3a4794848fcacfba5b107e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:03:11.975179 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd9697e-0e50-4adc-921d-d6501366ab92 service neutron] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:03:11.975464 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd9697e-0e50-4adc-921d-d6501366ab92 service neutron] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:03:11.975735 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd9697e-0e50-4adc-921d-d6501366ab92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:03:11.986983 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd9697e-0e50-4adc-921d-d6501366ab92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:03:11.988461 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd9697e-0e50-4adc-921d-d6501366ab92 service neutron] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:03:11.999775 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 992/2043] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:03:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:03:12.295422 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a031d15-1d4f-4839-80f0-9364228c0e1a None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:03:12.296873 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-7a031d15-1d4f-4839-80f0-9364228c0e1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:03:12.313948 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a031d15-1d4f-4839-80f0-9364228c0e1a None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:03:12.318855 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320fdc3a-ef26-43e0-9f5e-e70f6039e9f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:03:12.319511 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320fdc3a-ef26-43e0-9f5e-e70f6039e9f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:03:12.319796 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320fdc3a-ef26-43e0-9f5e-e70f6039e9f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:03:12.320073 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320fdc3a-ef26-43e0-9f5e-e70f6039e9f3 admin admin] PATH_INFO: `/v3/projects/8f19bd6c3fb8417b84d27ca3161f4440` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:03:12.321898 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320fdc3a-ef26-43e0-9f5e-e70f6039e9f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f19bd6c3fb8417b84d27ca3161f4440)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:03:12.323861 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320fdc3a-ef26-43e0-9f5e-e70f6039e9f3 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:03:12.384443 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-320fdc3a-ef26-43e0-9f5e-e70f6039e9f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f19bd6c3fb8417b84d27ca3161f4440', 'request_id': 'req-320fdc3a-ef26-43e0-9f5e-e70f6039e9f3'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:03:12.390548 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-320fdc3a-ef26-43e0-9f5e-e70f6039e9f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f19bd6c3fb8417b84d27ca3161f4440', 'request_id': 'req-320fdc3a-ef26-43e0-9f5e-e70f6039e9f3'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:03:12.397568 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-320fdc3a-ef26-43e0-9f5e-e70f6039e9f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f19bd6c3fb8417b84d27ca3161f4440', 'request_id': 'req-320fdc3a-ef26-43e0-9f5e-e70f6039e9f3'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:03:12.417419 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-320fdc3a-ef26-43e0-9f5e-e70f6039e9f3 admin admin] The token cache is being invalidate because project 8f19bd6c3fb8417b84d27ca3161f4440 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:03:12.417713 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-320fdc3a-ef26-43e0-9f5e-e70f6039e9f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:03:12.418397 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-320fdc3a-ef26-43e0-9f5e-e70f6039e9f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:03:12.419908 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1052/2044] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Oct 14 13:03:12 2022] DELETE /identity/v3/projects/8f19bd6c3fb8417b84d27ca3161f4440 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:03:12.423911 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd9697e-0e50-4adc-921d-d6501366ab92 service neutron] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:03:12.433830 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd9697e-0e50-4adc-921d-d6501366ab92 service neutron] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:03:12.507646 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca72b58-3b7d-466b-bdaf-9c86ed6acd29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:03:12.508242 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca72b58-3b7d-466b-bdaf-9c86ed6acd29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:03:12.508567 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca72b58-3b7d-466b-bdaf-9c86ed6acd29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:03:12.508851 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca72b58-3b7d-466b-bdaf-9c86ed6acd29 admin admin] PATH_INFO: `/v3/users/d49d5f0729104d14bbfbc06eead3e2e2` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:03:12.510057 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca72b58-3b7d-466b-bdaf-9c86ed6acd29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d49d5f0729104d14bbfbc06eead3e2e2)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:03:12.512060 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca72b58-3b7d-466b-bdaf-9c86ed6acd29 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:03:12.561878 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-bca72b58-3b7d-466b-bdaf-9c86ed6acd29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd49d5f0729104d14bbfbc06eead3e2e2'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:03:12.568903 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-bca72b58-3b7d-466b-bdaf-9c86ed6acd29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd49d5f0729104d14bbfbc06eead3e2e2'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:03:12.569592 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-bca72b58-3b7d-466b-bdaf-9c86ed6acd29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd49d5f0729104d14bbfbc06eead3e2e2'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:03:12.577498 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-bca72b58-3b7d-466b-bdaf-9c86ed6acd29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd49d5f0729104d14bbfbc06eead3e2e2'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:03:12.597318 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-bca72b58-3b7d-466b-bdaf-9c86ed6acd29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd49d5f0729104d14bbfbc06eead3e2e2'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:03:12.606192 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 993/2045] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Oct 14 13:03:12 2022] DELETE /identity/v3/users/d49d5f0729104d14bbfbc06eead3e2e2 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:03:12.902853 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320fdc3a-ef26-43e0-9f5e-e70f6039e9f3 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:03:12.904368 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-320fdc3a-ef26-43e0-9f5e-e70f6039e9f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:03:12.917886 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320fdc3a-ef26-43e0-9f5e-e70f6039e9f3 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:03:12.985257 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8960dbe-bb15-4a5a-9eca-316e8d0a29ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:03:12.985257 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8960dbe-bb15-4a5a-9eca-316e8d0a29ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:03:12.985257 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8960dbe-bb15-4a5a-9eca-316e8d0a29ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:03:12.985257 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8960dbe-bb15-4a5a-9eca-316e8d0a29ac admin admin] PATH_INFO: `/v3/projects/b3d7cf8b1d7241caa613b1bce57dff48` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:03:12.985703 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8960dbe-bb15-4a5a-9eca-316e8d0a29ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3d7cf8b1d7241caa613b1bce57dff48)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:03:12.986967 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8960dbe-bb15-4a5a-9eca-316e8d0a29ac admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:03:13.037220 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-b8960dbe-bb15-4a5a-9eca-316e8d0a29ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3d7cf8b1d7241caa613b1bce57dff48', 'request_id': 'req-b8960dbe-bb15-4a5a-9eca-316e8d0a29ac'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:03:13.043997 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-b8960dbe-bb15-4a5a-9eca-316e8d0a29ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3d7cf8b1d7241caa613b1bce57dff48', 'request_id': 'req-b8960dbe-bb15-4a5a-9eca-316e8d0a29ac'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:03:13.050815 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-b8960dbe-bb15-4a5a-9eca-316e8d0a29ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3d7cf8b1d7241caa613b1bce57dff48', 'request_id': 'req-b8960dbe-bb15-4a5a-9eca-316e8d0a29ac'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:03:13.065408 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-b8960dbe-bb15-4a5a-9eca-316e8d0a29ac admin admin] The token cache is being invalidate because project b3d7cf8b1d7241caa613b1bce57dff48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:03:13.065699 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-b8960dbe-bb15-4a5a-9eca-316e8d0a29ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:03:13.066376 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-b8960dbe-bb15-4a5a-9eca-316e8d0a29ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:03:13.067945 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1053/2046] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Oct 14 13:03:12 2022] DELETE /identity/v3/projects/b3d7cf8b1d7241caa613b1bce57dff48 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:03:13.073403 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d28d836-b2e9-4a65-bf52-c09e42c04cce None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:03:13.073698 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d28d836-b2e9-4a65-bf52-c09e42c04cce None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:03:13.073980 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d28d836-b2e9-4a65-bf52-c09e42c04cce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:03:13.095403 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-6d28d836-b2e9-4a65-bf52-c09e42c04cce None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:03:13.096680 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-6d28d836-b2e9-4a65-bf52-c09e42c04cce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:03:13.145072 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:03:13.166079 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 994/2047] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:03:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:03:13.174704 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756ff052-ad47-4870-86a0-c4ef84ef2030 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:03:13.174983 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756ff052-ad47-4870-86a0-c4ef84ef2030 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:03:13.175277 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756ff052-ad47-4870-86a0-c4ef84ef2030 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:03:13.197552 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-756ff052-ad47-4870-86a0-c4ef84ef2030 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:03:13.198828 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-756ff052-ad47-4870-86a0-c4ef84ef2030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:03:13.206980 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1054/2048] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:03:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:03:13.212080 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d28d836-b2e9-4a65-bf52-c09e42c04cce None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:03:13.222618 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d28d836-b2e9-4a65-bf52-c09e42c04cce None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:03:13.231635 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56412090-8d3f-4d0d-9fbc-62268322ed4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:03:13.232264 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56412090-8d3f-4d0d-9fbc-62268322ed4c admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:03:13.232545 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56412090-8d3f-4d0d-9fbc-62268322ed4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:03:13.232820 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56412090-8d3f-4d0d-9fbc-62268322ed4c admin admin] PATH_INFO: `/v3/domains` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:03:13.233483 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56412090-8d3f-4d0d-9fbc-62268322ed4c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 13:03:13.233784 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56412090-8d3f-4d0d-9fbc-62268322ed4c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:03:13.235425 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56412090-8d3f-4d0d-9fbc-62268322ed4c admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:03:13.252156 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 995/2049] 10.222.0.17 () {58 vars in 1153 bytes} [Fri Oct 14 13:03:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 13:03:13.257801 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756ff052-ad47-4870-86a0-c4ef84ef2030 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:03:13.261877 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:03:13.268574 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756ff052-ad47-4870-86a0-c4ef84ef2030 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:03:13.274831 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe1c7ad-e122-4d6e-89db-cbddec8aae59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:03:13.275449 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe1c7ad-e122-4d6e-89db-cbddec8aae59 admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:03:13.275727 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe1c7ad-e122-4d6e-89db-cbddec8aae59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:03:13.275996 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe1c7ad-e122-4d6e-89db-cbddec8aae59 admin admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:03:13.276619 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe1c7ad-e122-4d6e-89db-cbddec8aae59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:03:13.278622 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe1c7ad-e122-4d6e-89db-cbddec8aae59 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:03:13.307371 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1055/2050] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Oct 14 13:03:13 2022] POST /identity/v3/projects => generated 377 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:03:13.311918 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56412090-8d3f-4d0d-9fbc-62268322ed4c admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:03:13.323248 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56412090-8d3f-4d0d-9fbc-62268322ed4c admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:03:13.384122 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e1af19-9428-4c3d-870e-0552244a8dcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:03:13.384750 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e1af19-9428-4c3d-870e-0552244a8dcc admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:03:13.385029 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e1af19-9428-4c3d-870e-0552244a8dcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:03:13.385296 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e1af19-9428-4c3d-870e-0552244a8dcc admin admin] PATH_INFO: `/v3/users` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:03:13.385939 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e1af19-9428-4c3d-870e-0552244a8dcc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:03:13.387905 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e1af19-9428-4c3d-870e-0552244a8dcc admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:03:13.410959 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 996/2051] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Oct 14 13:03:13 2022] POST /identity/v3/users => generated 289 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 13:03:13.415144 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe1c7ad-e122-4d6e-89db-cbddec8aae59 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:03:13.426422 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe1c7ad-e122-4d6e-89db-cbddec8aae59 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:03:13.431795 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504abd7c-606c-4162-bf33-17fa71f10f48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:03:13.432402 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504abd7c-606c-4162-bf33-17fa71f10f48 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:03:13.432684 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504abd7c-606c-4162-bf33-17fa71f10f48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:03:13.432958 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504abd7c-606c-4162-bf33-17fa71f10f48 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:03:13.433598 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504abd7c-606c-4162-bf33-17fa71f10f48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:03:13.435242 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504abd7c-606c-4162-bf33-17fa71f10f48 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:03:13.446730 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1056/2052] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:03:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:03:13.451000 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e1af19-9428-4c3d-870e-0552244a8dcc admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:03:13.461794 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e1af19-9428-4c3d-870e-0552244a8dcc admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:03:13.466663 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbe66c3-ea02-4bf5-9c18-5d78c7046375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:03:13.467274 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbe66c3-ea02-4bf5-9c18-5d78c7046375 admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:03:13.467552 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbe66c3-ea02-4bf5-9c18-5d78c7046375 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:03:13.467822 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbe66c3-ea02-4bf5-9c18-5d78c7046375 admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:03:13.468467 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbe66c3-ea02-4bf5-9c18-5d78c7046375 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:03:13.470060 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbe66c3-ea02-4bf5-9c18-5d78c7046375 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:03:13.482529 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 997/2053] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:03:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:03:13.486861 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504abd7c-606c-4162-bf33-17fa71f10f48 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:03:13.501890 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504abd7c-606c-4162-bf33-17fa71f10f48 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:03:13.506790 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a77bed-a27a-4b0c-8fea-e7f9ee97eb07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:03:13.507452 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a77bed-a27a-4b0c-8fea-e7f9ee97eb07 admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:03:13.507737 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a77bed-a27a-4b0c-8fea-e7f9ee97eb07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:03:13.508069 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a77bed-a27a-4b0c-8fea-e7f9ee97eb07 admin admin] PATH_INFO: `/v3/projects/dee1f2c11e664e01a962ca1aeb90bdf3/users/5b27ddc14ddf46b88a730f64b7458156/roles/5e8849303a75425b9eaa2681cc031af1` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:03:13.530738 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a77bed-a27a-4b0c-8fea-e7f9ee97eb07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dee1f2c11e664e01a962ca1aeb90bdf3, user_id=5b27ddc14ddf46b88a730f64b7458156, role_id=5e8849303a75425b9eaa2681cc031af1)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:03:13.533413 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a77bed-a27a-4b0c-8fea-e7f9ee97eb07 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:03:13.548288 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1057/2054] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Oct 14 13:03:13 2022] PUT /identity/v3/projects/dee1f2c11e664e01a962ca1aeb90bdf3/users/5b27ddc14ddf46b88a730f64b7458156/roles/5e8849303a75425b9eaa2681cc031af1 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:03:13.561695 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ea1b68-a868-4d41-acd0-69ce7eca866f None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:03:13.562095 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ea1b68-a868-4d41-acd0-69ce7eca866f None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:03:13.562578 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ea1b68-a868-4d41-acd0-69ce7eca866f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:03:13.595591 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-75ea1b68-a868-4d41-acd0-69ce7eca866f None None] MFA Rules not processed for user `5b27ddc14ddf46b88a730f64b7458156`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:03:13.596855 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-75ea1b68-a868-4d41-acd0-69ce7eca866f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:03:13.671231 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 998/2055] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:03:13 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:03:13.683625 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a77bed-a27a-4b0c-8fea-e7f9ee97eb07 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:03:13.686359 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-93a77bed-a27a-4b0c-8fea-e7f9ee97eb07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:03:13.749835 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a77bed-a27a-4b0c-8fea-e7f9ee97eb07 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:03:13.753575 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528de021-18f0-472c-a521-333de20f2604 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c3c564b8c548e4beef1cbfba2ad343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:03:13.754226 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528de021-18f0-472c-a521-333de20f2604 service cinder] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:03:13.754511 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528de021-18f0-472c-a521-333de20f2604 service cinder] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:03:13.754786 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528de021-18f0-472c-a521-333de20f2604 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:03:13.764121 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528de021-18f0-472c-a521-333de20f2604 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:03:13.765603 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528de021-18f0-472c-a521-333de20f2604 service cinder] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:03:13.775311 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1058/2056] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:03:13 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:03:23.668064 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=77,keystone:INSERT=3 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:03:23.770856 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=49,keystone:INSERT=2 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:03:27.602826 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ea1b68-a868-4d41-acd0-69ce7eca866f None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:03:27.669580 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ea1b68-a868-4d41-acd0-69ce7eca866f None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:03:27.674044 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda5f6ea-ba66-4bc9-af86-17d43dfe7950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:03:27.674781 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda5f6ea-ba66-4bc9-af86-17d43dfe7950 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:03:27.675061 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda5f6ea-ba66-4bc9-af86-17d43dfe7950 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:03:27.675335 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda5f6ea-ba66-4bc9-af86-17d43dfe7950 admin admin] PATH_INFO: `/v3/users/5b27ddc14ddf46b88a730f64b7458156` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:03:27.676470 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda5f6ea-ba66-4bc9-af86-17d43dfe7950 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b27ddc14ddf46b88a730f64b7458156)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:03:27.678439 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda5f6ea-ba66-4bc9-af86-17d43dfe7950 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:03:27.748247 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-fda5f6ea-ba66-4bc9-af86-17d43dfe7950 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b27ddc14ddf46b88a730f64b7458156'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:03:27.759890 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-fda5f6ea-ba66-4bc9-af86-17d43dfe7950 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b27ddc14ddf46b88a730f64b7458156'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:03:27.760637 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-fda5f6ea-ba66-4bc9-af86-17d43dfe7950 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b27ddc14ddf46b88a730f64b7458156'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:03:27.769462 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-fda5f6ea-ba66-4bc9-af86-17d43dfe7950 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b27ddc14ddf46b88a730f64b7458156'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:03:27.782078 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-fda5f6ea-ba66-4bc9-af86-17d43dfe7950 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b27ddc14ddf46b88a730f64b7458156'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:03:27.788195 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 999/2057] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Oct 14 13:03:27 2022] DELETE /identity/v3/users/5b27ddc14ddf46b88a730f64b7458156 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:03:27.793367 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ffae3a-77fd-49c2-a0c2-638e4bbe19ec None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:03:27.793879 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ffae3a-77fd-49c2-a0c2-638e4bbe19ec None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:03:27.793879 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ffae3a-77fd-49c2-a0c2-638e4bbe19ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:03:27.813828 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-c4ffae3a-77fd-49c2-a0c2-638e4bbe19ec None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:03:27.815130 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-c4ffae3a-77fd-49c2-a0c2-638e4bbe19ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:03:27.877350 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1059/2058] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:03:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:03:27.887519 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda5f6ea-ba66-4bc9-af86-17d43dfe7950 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:03:27.889083 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-fda5f6ea-ba66-4bc9-af86-17d43dfe7950 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:03:27.952342 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda5f6ea-ba66-4bc9-af86-17d43dfe7950 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:03:27.956020 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f236e7f-f489-4633-b225-9a901488f19c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d483292f3a4794848fcacfba5b107e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:03:27.956631 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f236e7f-f489-4633-b225-9a901488f19c service neutron] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:03:27.956911 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f236e7f-f489-4633-b225-9a901488f19c service neutron] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:03:27.957355 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f236e7f-f489-4633-b225-9a901488f19c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:03:27.971917 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f236e7f-f489-4633-b225-9a901488f19c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:03:27.973628 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f236e7f-f489-4633-b225-9a901488f19c service neutron] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:03:27.985629 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1000/2059] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:03:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 14 13:03:28.265537 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ffae3a-77fd-49c2-a0c2-638e4bbe19ec None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:03:28.267220 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-c4ffae3a-77fd-49c2-a0c2-638e4bbe19ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:03:28.280401 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ffae3a-77fd-49c2-a0c2-638e4bbe19ec None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:03:28.285183 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587a39ce-a49b-48db-8a1e-dcc27dc3ee64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:03:28.285822 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587a39ce-a49b-48db-8a1e-dcc27dc3ee64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:03:28.286102 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587a39ce-a49b-48db-8a1e-dcc27dc3ee64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:03:28.286429 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587a39ce-a49b-48db-8a1e-dcc27dc3ee64 admin admin] PATH_INFO: `/v3/projects/dee1f2c11e664e01a962ca1aeb90bdf3` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:03:28.287848 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587a39ce-a49b-48db-8a1e-dcc27dc3ee64 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dee1f2c11e664e01a962ca1aeb90bdf3)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:03:28.291025 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587a39ce-a49b-48db-8a1e-dcc27dc3ee64 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:03:28.340167 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-587a39ce-a49b-48db-8a1e-dcc27dc3ee64 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dee1f2c11e664e01a962ca1aeb90bdf3', 'request_id': 'req-587a39ce-a49b-48db-8a1e-dcc27dc3ee64'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:03:28.345857 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-587a39ce-a49b-48db-8a1e-dcc27dc3ee64 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dee1f2c11e664e01a962ca1aeb90bdf3', 'request_id': 'req-587a39ce-a49b-48db-8a1e-dcc27dc3ee64'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:03:28.356447 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-587a39ce-a49b-48db-8a1e-dcc27dc3ee64 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dee1f2c11e664e01a962ca1aeb90bdf3', 'request_id': 'req-587a39ce-a49b-48db-8a1e-dcc27dc3ee64'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:03:28.372186 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-587a39ce-a49b-48db-8a1e-dcc27dc3ee64 admin admin] The token cache is being invalidate because project dee1f2c11e664e01a962ca1aeb90bdf3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:03:28.372478 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-587a39ce-a49b-48db-8a1e-dcc27dc3ee64 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:03:28.373160 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-587a39ce-a49b-48db-8a1e-dcc27dc3ee64 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:03:28.374674 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1060/2060] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Oct 14 13:03:28 2022] DELETE /identity/v3/projects/dee1f2c11e664e01a962ca1aeb90bdf3 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:03:28.381223 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7a2ce5-8b64-47a9-bfa0-b82e368f325e None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:03:28.381510 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7a2ce5-8b64-47a9-bfa0-b82e368f325e None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:03:28.381784 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7a2ce5-8b64-47a9-bfa0-b82e368f325e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:03:28.402685 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-bb7a2ce5-8b64-47a9-bfa0-b82e368f325e None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:03:28.403912 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-bb7a2ce5-8b64-47a9-bfa0-b82e368f325e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:03:28.422924 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:03:28.467916 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1001/2061] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:03:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:03:28.476746 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f7f967-54a8-48af-ae6b-543b3b5aeaa3 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:03:28.477065 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f7f967-54a8-48af-ae6b-543b3b5aeaa3 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:03:28.477384 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f7f967-54a8-48af-ae6b-543b3b5aeaa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:03:28.499522 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-c0f7f967-54a8-48af-ae6b-543b3b5aeaa3 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:03:28.500768 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-c0f7f967-54a8-48af-ae6b-543b3b5aeaa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:03:28.509901 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1061/2062] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:03:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:03:28.514275 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7a2ce5-8b64-47a9-bfa0-b82e368f325e None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:03:28.525004 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7a2ce5-8b64-47a9-bfa0-b82e368f325e None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:03:28.529756 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f80daad-2649-4ea7-8056-949c4549c751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:03:28.530403 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f80daad-2649-4ea7-8056-949c4549c751 admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:03:28.530714 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f80daad-2649-4ea7-8056-949c4549c751 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:03:28.530975 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f80daad-2649-4ea7-8056-949c4549c751 admin admin] PATH_INFO: `/v3/domains` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:03:28.531628 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f80daad-2649-4ea7-8056-949c4549c751 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 13:03:28.531939 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f80daad-2649-4ea7-8056-949c4549c751 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:03:28.533540 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f80daad-2649-4ea7-8056-949c4549c751 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:03:28.545907 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1002/2063] 10.222.0.17 () {58 vars in 1153 bytes} [Fri Oct 14 13:03:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 13:03:28.550454 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f7f967-54a8-48af-ae6b-543b3b5aeaa3 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:03:28.560043 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f7f967-54a8-48af-ae6b-543b3b5aeaa3 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:03:28.564849 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0539e6a-9831-49d3-acf0-200e5076fe20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:03:28.565458 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0539e6a-9831-49d3-acf0-200e5076fe20 admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:03:28.565808 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0539e6a-9831-49d3-acf0-200e5076fe20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:03:28.566012 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0539e6a-9831-49d3-acf0-200e5076fe20 admin admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:03:28.566676 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0539e6a-9831-49d3-acf0-200e5076fe20 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:03:28.568616 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0539e6a-9831-49d3-acf0-200e5076fe20 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:03:28.599555 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1062/2064] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Oct 14 13:03:28 2022] POST /identity/v3/projects => generated 371 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:03:28.603826 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f80daad-2649-4ea7-8056-949c4549c751 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:03:28.613942 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f80daad-2649-4ea7-8056-949c4549c751 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:03:28.673451 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f07816-892c-46e6-9728-0b7a8e559269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:03:28.674074 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f07816-892c-46e6-9728-0b7a8e559269 admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:03:28.674399 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f07816-892c-46e6-9728-0b7a8e559269 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:03:28.674698 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f07816-892c-46e6-9728-0b7a8e559269 admin admin] PATH_INFO: `/v3/users` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:03:28.675360 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f07816-892c-46e6-9728-0b7a8e559269 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:03:28.677320 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f07816-892c-46e6-9728-0b7a8e559269 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:03:28.700525 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1003/2065] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Oct 14 13:03:28 2022] POST /identity/v3/users => generated 286 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:03:28.705075 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0539e6a-9831-49d3-acf0-200e5076fe20 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:03:28.716862 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0539e6a-9831-49d3-acf0-200e5076fe20 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:03:28.722197 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670c189f-0323-41d2-a334-c97e17f949ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:03:28.723063 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670c189f-0323-41d2-a334-c97e17f949ef admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:03:28.723454 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670c189f-0323-41d2-a334-c97e17f949ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:03:28.723731 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670c189f-0323-41d2-a334-c97e17f949ef admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:03:28.724371 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670c189f-0323-41d2-a334-c97e17f949ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:03:28.726108 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670c189f-0323-41d2-a334-c97e17f949ef admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:03:28.737020 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1063/2066] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:03:28 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 14 13:03:28.741066 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f07816-892c-46e6-9728-0b7a8e559269 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:03:28.751543 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f07816-892c-46e6-9728-0b7a8e559269 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:03:28.756275 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5abbf4-2991-4383-a342-83959bf10c5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:03:28.756878 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5abbf4-2991-4383-a342-83959bf10c5b admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:03:28.757165 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5abbf4-2991-4383-a342-83959bf10c5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:03:28.757931 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5abbf4-2991-4383-a342-83959bf10c5b admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:03:28.758972 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5abbf4-2991-4383-a342-83959bf10c5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:03:28.760654 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5abbf4-2991-4383-a342-83959bf10c5b admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:03:28.771969 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1004/2067] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:03:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:03:28.776952 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670c189f-0323-41d2-a334-c97e17f949ef admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:03:28.787278 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670c189f-0323-41d2-a334-c97e17f949ef admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:03:28.792259 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb77955-9ca2-40d2-803f-9c04224a8d94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:03:28.792920 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb77955-9ca2-40d2-803f-9c04224a8d94 admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:03:28.793200 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb77955-9ca2-40d2-803f-9c04224a8d94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:03:28.793473 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb77955-9ca2-40d2-803f-9c04224a8d94 admin admin] PATH_INFO: `/v3/projects/083f54db9f9b476882da0e741ca4e9b9/users/ba64033251de498eb3cfe4c3a002f6ad/roles/5e8849303a75425b9eaa2681cc031af1` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:03:28.809217 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb77955-9ca2-40d2-803f-9c04224a8d94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=083f54db9f9b476882da0e741ca4e9b9, user_id=ba64033251de498eb3cfe4c3a002f6ad, role_id=5e8849303a75425b9eaa2681cc031af1)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:03:28.812005 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb77955-9ca2-40d2-803f-9c04224a8d94 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:03:28.827157 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1064/2068] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Oct 14 13:03:28 2022] PUT /identity/v3/projects/083f54db9f9b476882da0e741ca4e9b9/users/ba64033251de498eb3cfe4c3a002f6ad/roles/5e8849303a75425b9eaa2681cc031af1 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:03:28.832414 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69305203-7c20-41b7-9e45-ea2baf66a7b4 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:03:28.832693 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69305203-7c20-41b7-9e45-ea2baf66a7b4 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:03:28.832980 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69305203-7c20-41b7-9e45-ea2baf66a7b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:03:28.854410 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-69305203-7c20-41b7-9e45-ea2baf66a7b4 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:03:28.855716 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-69305203-7c20-41b7-9e45-ea2baf66a7b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:03:28.918364 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1005/2069] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:03:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:03:28.928251 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb77955-9ca2-40d2-803f-9c04224a8d94 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:03:28.930809 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-9bb77955-9ca2-40d2-803f-9c04224a8d94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:03:28.954072 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:03:28.994689 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb77955-9ca2-40d2-803f-9c04224a8d94 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:03:28.998605 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206210ab-9487-4b12-a94d-990ded341db0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d483292f3a4794848fcacfba5b107e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:03:28.999222 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206210ab-9487-4b12-a94d-990ded341db0 service neutron] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:03:28.999501 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206210ab-9487-4b12-a94d-990ded341db0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:03:28.999771 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206210ab-9487-4b12-a94d-990ded341db0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:03:29.010319 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206210ab-9487-4b12-a94d-990ded341db0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:03:29.011841 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206210ab-9487-4b12-a94d-990ded341db0 service neutron] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:03:29.021797 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1065/2070] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:03:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:03:33.207380 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae93b4f-a30c-4339-9d82-c2fbd558f6e4 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:03:33.207929 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae93b4f-a30c-4339-9d82-c2fbd558f6e4 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:03:33.207929 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae93b4f-a30c-4339-9d82-c2fbd558f6e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:03:33.239178 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-8ae93b4f-a30c-4339-9d82-c2fbd558f6e4 None None] MFA Rules not processed for user `ba64033251de498eb3cfe4c3a002f6ad`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:03:33.240197 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-8ae93b4f-a30c-4339-9d82-c2fbd558f6e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:03:33.265521 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:03:33.333914 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1006/2071] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:03:33 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:03:33.338171 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206210ab-9487-4b12-a94d-990ded341db0 service neutron] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:03:33.346786 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206210ab-9487-4b12-a94d-990ded341db0 service neutron] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:03:33.352414 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4d9b0e-b961-4fa6-9807-8b7f6ee2692f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:03:33.353058 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4d9b0e-b961-4fa6-9807-8b7f6ee2692f admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:03:33.353336 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4d9b0e-b961-4fa6-9807-8b7f6ee2692f admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:03:33.353611 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4d9b0e-b961-4fa6-9807-8b7f6ee2692f admin admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:03:33.354305 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4d9b0e-b961-4fa6-9807-8b7f6ee2692f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:03:33.356363 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4d9b0e-b961-4fa6-9807-8b7f6ee2692f admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:03:33.386305 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1066/2072] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Oct 14 13:03:33 2022] POST /identity/v3/projects => generated 371 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:03:33.390331 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae93b4f-a30c-4339-9d82-c2fbd558f6e4 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:03:33.401857 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae93b4f-a30c-4339-9d82-c2fbd558f6e4 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:03:33.495064 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf3c7b1-97d2-4ca8-a774-7b2d6d5381d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:03:33.495699 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf3c7b1-97d2-4ca8-a774-7b2d6d5381d1 admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:03:33.495984 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf3c7b1-97d2-4ca8-a774-7b2d6d5381d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:03:33.496261 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf3c7b1-97d2-4ca8-a774-7b2d6d5381d1 admin admin] PATH_INFO: `/v3/users` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:03:33.496915 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf3c7b1-97d2-4ca8-a774-7b2d6d5381d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:03:33.498969 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf3c7b1-97d2-4ca8-a774-7b2d6d5381d1 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:03:33.525402 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1007/2073] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Oct 14 13:03:33 2022] POST /identity/v3/users => generated 292 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:03:33.529156 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4d9b0e-b961-4fa6-9807-8b7f6ee2692f admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:03:33.540543 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4d9b0e-b961-4fa6-9807-8b7f6ee2692f admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:03:33.545478 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bab383-611d-4bd4-a846-38d2dae20ef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:03:33.546100 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bab383-611d-4bd4-a846-38d2dae20ef5 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:03:33.546412 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bab383-611d-4bd4-a846-38d2dae20ef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:03:33.546682 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bab383-611d-4bd4-a846-38d2dae20ef5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:03:33.547328 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bab383-611d-4bd4-a846-38d2dae20ef5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:03:33.548956 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bab383-611d-4bd4-a846-38d2dae20ef5 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:03:33.565923 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1067/2074] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:03:33 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 14 13:03:33.571051 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf3c7b1-97d2-4ca8-a774-7b2d6d5381d1 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:03:33.586791 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf3c7b1-97d2-4ca8-a774-7b2d6d5381d1 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:03:33.594672 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35eb9df-7d2b-416a-bfe0-3024ac91ff6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:03:33.595347 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35eb9df-7d2b-416a-bfe0-3024ac91ff6f admin admin] REQUEST_METHOD: `PUT` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:03:33.595629 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35eb9df-7d2b-416a-bfe0-3024ac91ff6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:03:33.595906 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35eb9df-7d2b-416a-bfe0-3024ac91ff6f admin admin] PATH_INFO: `/v3/projects/77df8bbec29e40d282012a38798ba0a9/users/54abcba47b3b4d65822086b2071eae68/roles/7f6e29e390bc41f7a9af17659a2e95d1` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:03:33.615603 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35eb9df-7d2b-416a-bfe0-3024ac91ff6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=77df8bbec29e40d282012a38798ba0a9, user_id=54abcba47b3b4d65822086b2071eae68, role_id=7f6e29e390bc41f7a9af17659a2e95d1)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:03:33.619070 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35eb9df-7d2b-416a-bfe0-3024ac91ff6f admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:03:33.640422 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1008/2075] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Oct 14 13:03:33 2022] PUT /identity/v3/projects/77df8bbec29e40d282012a38798ba0a9/users/54abcba47b3b4d65822086b2071eae68/roles/7f6e29e390bc41f7a9af17659a2e95d1 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:03:33.644907 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bab383-611d-4bd4-a846-38d2dae20ef5 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:03:33.656113 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bab383-611d-4bd4-a846-38d2dae20ef5 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:03:33.742463 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0efd4b-53f7-41b9-bb95-6a491d4726fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:03:33.743240 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0efd4b-53f7-41b9-bb95-6a491d4726fe admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:03:33.743584 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0efd4b-53f7-41b9-bb95-6a491d4726fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:03:33.743926 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0efd4b-53f7-41b9-bb95-6a491d4726fe admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:03:33.746050 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0efd4b-53f7-41b9-bb95-6a491d4726fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:03:33.746518 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0efd4b-53f7-41b9-bb95-6a491d4726fe admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:03:33.764308 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1068/2076] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:03:33 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 14 13:03:33.765463 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35eb9df-7d2b-416a-bfe0-3024ac91ff6f admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:03:33.782069 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35eb9df-7d2b-416a-bfe0-3024ac91ff6f admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:03:33.787724 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4edbf18-8ce8-42d9-8ad7-4e5259699599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:03:33.788443 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4edbf18-8ce8-42d9-8ad7-4e5259699599 admin admin] REQUEST_METHOD: `PUT` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:03:33.788871 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4edbf18-8ce8-42d9-8ad7-4e5259699599 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:03:33.789311 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4edbf18-8ce8-42d9-8ad7-4e5259699599 admin admin] PATH_INFO: `/v3/projects/77df8bbec29e40d282012a38798ba0a9/users/54abcba47b3b4d65822086b2071eae68/roles/7f6e29e390bc41f7a9af17659a2e95d1` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:03:33.791733 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4edbf18-8ce8-42d9-8ad7-4e5259699599 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77df8bbec29e40d282012a38798ba0a9, user_id=54abcba47b3b4d65822086b2071eae68, role_id=7f6e29e390bc41f7a9af17659a2e95d1)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:03:33.794978 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4edbf18-8ce8-42d9-8ad7-4e5259699599 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:03:33.810041 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1009/2077] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Oct 14 13:03:33 2022] PUT /identity/v3/projects/77df8bbec29e40d282012a38798ba0a9/users/54abcba47b3b4d65822086b2071eae68/roles/7f6e29e390bc41f7a9af17659a2e95d1 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:03:38.582914 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed4ff70-5668-4a27-b02a-4da7982133dd None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:03:38.583431 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed4ff70-5668-4a27-b02a-4da7982133dd None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:03:38.583537 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed4ff70-5668-4a27-b02a-4da7982133dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:03:38.615654 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-8ed4ff70-5668-4a27-b02a-4da7982133dd None None] MFA Rules not processed for user `54abcba47b3b4d65822086b2071eae68`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:03:38.617583 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-8ed4ff70-5668-4a27-b02a-4da7982133dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:03:38.699649 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1069/2078] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:03:38 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:03:38.730051 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4edbf18-8ce8-42d9-8ad7-4e5259699599 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:03:38.739264 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-c4edbf18-8ce8-42d9-8ad7-4e5259699599 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:03:38.848515 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4edbf18-8ce8-42d9-8ad7-4e5259699599 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:03:38.856295 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4cd012-f4e7-4ebb-b871-68713444b725 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '931f4e32c8764514b5efed31b0785be7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:03:38.857039 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4cd012-f4e7-4ebb-b871-68713444b725 service nova] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:03:38.857402 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4cd012-f4e7-4ebb-b871-68713444b725 service nova] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:03:38.857733 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4cd012-f4e7-4ebb-b871-68713444b725 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:03:38.866680 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:03:38.935609 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4cd012-f4e7-4ebb-b871-68713444b725 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:03:38.938626 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4cd012-f4e7-4ebb-b871-68713444b725 service nova] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:03:38.951394 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1010/2079] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:03:38 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:03:40.209180 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6c9fc5-971b-4d37-a08d-796484ea388e None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:03:40.209677 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6c9fc5-971b-4d37-a08d-796484ea388e None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:03:40.209677 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6c9fc5-971b-4d37-a08d-796484ea388e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:03:40.231092 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-ed6c9fc5-971b-4d37-a08d-796484ea388e None None] MFA Rules not processed for user `ba64033251de498eb3cfe4c3a002f6ad`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:03:40.232314 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-ed6c9fc5-971b-4d37-a08d-796484ea388e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:03:40.239469 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1070/2080] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:03:40 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:03:46.022209 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142a0ef0-d1f9-479a-8de9-9320e9628bfb None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:03:46.022698 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142a0ef0-d1f9-479a-8de9-9320e9628bfb None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:03:46.022895 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142a0ef0-d1f9-479a-8de9-9320e9628bfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:03:46.042771 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-142a0ef0-d1f9-479a-8de9-9320e9628bfb None None] MFA Rules not processed for user `a1b9ec5c477d4f01aa2ad5f634e5f73a`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:03:46.043984 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-142a0ef0-d1f9-479a-8de9-9320e9628bfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:03:46.105291 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1011/2081] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:03:46 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:03:50.224512 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=97,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:03:56.098564 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=49 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:03:59.868576 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa60614-a976-493e-8a4f-4dd63676e0fd None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:03:59.869027 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa60614-a976-493e-8a4f-4dd63676e0fd None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:03:59.869113 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa60614-a976-493e-8a4f-4dd63676e0fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:03:59.889464 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-9aa60614-a976-493e-8a4f-4dd63676e0fd None None] MFA Rules not processed for user `b83a5a78f3e7486293907cb3012c0ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:03:59.890721 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-9aa60614-a976-493e-8a4f-4dd63676e0fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:03:59.947893 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1071/2082] 10.222.0.17 () {58 vars in 1009 bytes} [Fri Oct 14 13:03:59 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:03:59.996635 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142a0ef0-d1f9-479a-8de9-9320e9628bfb None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:03:59.999623 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-142a0ef0-d1f9-479a-8de9-9320e9628bfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:04:00.078588 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142a0ef0-d1f9-479a-8de9-9320e9628bfb None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:04:00.089757 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1dd870-6772-4f2c-b893-853ca77ae640 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c9fc57b1ec4d00b9f392877f277284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:04:00.090551 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1dd870-6772-4f2c-b893-853ca77ae640 service swift] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:04:00.091515 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1dd870-6772-4f2c-b893-853ca77ae640 service swift] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:04:00.091881 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1dd870-6772-4f2c-b893-853ca77ae640 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:04:00.109182 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1dd870-6772-4f2c-b893-853ca77ae640 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:04:00.110993 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1dd870-6772-4f2c-b893-853ca77ae640 service swift] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:04:00.120137 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1012/2083] 10.222.0.17 () {60 vars in 1384 bytes} [Fri Oct 14 13:03:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 14 13:04:03.529681 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa60614-a976-493e-8a4f-4dd63676e0fd None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:04:03.531940 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-9aa60614-a976-493e-8a4f-4dd63676e0fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:04:03.608271 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa60614-a976-493e-8a4f-4dd63676e0fd None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:04:03.613458 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1415c9d-eafd-428a-8006-a549c8fb743f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a5e5c35ed8b4abc877ba8d8c490dacd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:04:03.614193 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1415c9d-eafd-428a-8006-a549c8fb743f service placement] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:04:03.614475 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1415c9d-eafd-428a-8006-a549c8fb743f service placement] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:04:03.614745 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1415c9d-eafd-428a-8006-a549c8fb743f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:04:03.616513 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-b1415c9d-eafd-428a-8006-a549c8fb743f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:04:03.628559 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1415c9d-eafd-428a-8006-a549c8fb743f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:04:03.630293 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1415c9d-eafd-428a-8006-a549c8fb743f service placement] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:04:03.643950 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1072/2084] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:04:03 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:04:10.116756 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=32 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:04:13.638324 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=57 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:04:15.929382 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d1f22c-1335-49b1-b7b5-41d3f2d9a150 None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:04:15.930021 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d1f22c-1335-49b1-b7b5-41d3f2d9a150 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:04:15.930149 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d1f22c-1335-49b1-b7b5-41d3f2d9a150 None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:04:15.932118 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1013/2085] 10.222.0.17 () {54 vars in 921 bytes} [Fri Oct 14 13:04:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 13:04:15.939271 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9b9fe8-d5f6-4c1c-a78b-d7d8535f28a5 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:04:15.939875 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9b9fe8-d5f6-4c1c-a78b-d7d8535f28a5 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:04:15.939875 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9b9fe8-d5f6-4c1c-a78b-d7d8535f28a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:04:15.961613 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-6d9b9fe8-d5f6-4c1c-a78b-d7d8535f28a5 None None] MFA Rules not processed for user `931f4e32c8764514b5efed31b0785be7`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:04:15.962947 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-6d9b9fe8-d5f6-4c1c-a78b-d7d8535f28a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:04:15.973007 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1073/2086] 10.222.0.17 () {58 vars in 1018 bytes} [Fri Oct 14 13:04:15 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 13:04:15.985913 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d1f22c-1335-49b1-b7b5-41d3f2d9a150 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:04:15.987770 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-f7d1f22c-1335-49b1-b7b5-41d3f2d9a150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:04:16.051307 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d1f22c-1335-49b1-b7b5-41d3f2d9a150 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:04:16.055195 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45a9fb6-7541-4b78-afbc-091106a7cea9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0de24488ed54df29d8da344d76651d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:04:16.055809 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45a9fb6-7541-4b78-afbc-091106a7cea9 service glance] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:04:16.056086 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45a9fb6-7541-4b78-afbc-091106a7cea9 service glance] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:04:16.056358 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45a9fb6-7541-4b78-afbc-091106a7cea9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:04:16.069016 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45a9fb6-7541-4b78-afbc-091106a7cea9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:04:16.070518 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45a9fb6-7541-4b78-afbc-091106a7cea9 service glance] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:04:16.082450 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1014/2087] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:04:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:04:16.159462 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c978d8b-e978-470e-bc92-78f1a7d27189 None None] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:04:16.159749 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c978d8b-e978-470e-bc92-78f1a7d27189 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:04:16.160028 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c978d8b-e978-470e-bc92-78f1a7d27189 None None] PATH_INFO: `/` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:04:16.161502 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1074/2088] 10.222.0.17 () {54 vars in 921 bytes} [Fri Oct 14 13:04:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 13:04:16.166386 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c734f2b-0b26-40f4-b56e-11c724114067 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:04:16.167101 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c734f2b-0b26-40f4-b56e-11c724114067 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:04:16.167903 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c734f2b-0b26-40f4-b56e-11c724114067 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:04:16.192007 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-2c734f2b-0b26-40f4-b56e-11c724114067 None None] MFA Rules not processed for user `b2d483292f3a4794848fcacfba5b107e`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:04:16.193724 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-2c734f2b-0b26-40f4-b56e-11c724114067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:04:16.247612 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1015/2089] 10.222.0.17 () {58 vars in 1018 bytes} [Fri Oct 14 13:04:16 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:04:16.263144 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c978d8b-e978-470e-bc92-78f1a7d27189 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:04:16.274477 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c978d8b-e978-470e-bc92-78f1a7d27189 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:04:16.278202 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8016cf04-8be2-4e4e-a2ff-33c414f866af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d483292f3a4794848fcacfba5b107e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:04:16.278801 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8016cf04-8be2-4e4e-a2ff-33c414f866af service neutron] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:04:16.279082 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8016cf04-8be2-4e4e-a2ff-33c414f866af service neutron] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:04:16.279358 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8016cf04-8be2-4e4e-a2ff-33c414f866af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:04:16.286955 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8016cf04-8be2-4e4e-a2ff-33c414f866af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:04:16.288385 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8016cf04-8be2-4e4e-a2ff-33c414f866af service neutron] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:04:16.296933 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1075/2090] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:04:16 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:04:16.398261 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b976e20-6ee5-4e0b-8065-cc4a1c2e4ed2 None None] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:04:16.398555 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b976e20-6ee5-4e0b-8065-cc4a1c2e4ed2 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:04:16.398830 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b976e20-6ee5-4e0b-8065-cc4a1c2e4ed2 None None] PATH_INFO: `/` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:04:16.400182 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1016/2091] 10.222.0.17 () {54 vars in 921 bytes} [Fri Oct 14 13:04:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 13:04:16.405612 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb2cf7c-c55d-485e-a9d8-3240485a4155 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:04:16.405900 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb2cf7c-c55d-485e-a9d8-3240485a4155 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:04:16.406218 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb2cf7c-c55d-485e-a9d8-3240485a4155 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:04:16.426291 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-aeb2cf7c-c55d-485e-a9d8-3240485a4155 None None] MFA Rules not processed for user `931f4e32c8764514b5efed31b0785be7`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:04:16.427502 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-aeb2cf7c-c55d-485e-a9d8-3240485a4155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:04:16.437613 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1076/2092] 10.222.0.17 () {58 vars in 1018 bytes} [Fri Oct 14 13:04:16 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:04:16.448523 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b976e20-6ee5-4e0b-8065-cc4a1c2e4ed2 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:04:16.460069 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b976e20-6ee5-4e0b-8065-cc4a1c2e4ed2 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:04:16.463624 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c97305-d5b0-4672-9b14-2d30a5694f41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d483292f3a4794848fcacfba5b107e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:04:16.464219 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c97305-d5b0-4672-9b14-2d30a5694f41 service neutron] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:04:16.464501 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c97305-d5b0-4672-9b14-2d30a5694f41 service neutron] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:04:16.464775 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c97305-d5b0-4672-9b14-2d30a5694f41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:04:16.476163 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c97305-d5b0-4672-9b14-2d30a5694f41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:04:16.477595 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c97305-d5b0-4672-9b14-2d30a5694f41 service neutron] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:04:16.491787 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1017/2093] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:04:16 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:04:17.765734 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb2cf7c-c55d-485e-a9d8-3240485a4155 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:04:17.775366 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb2cf7c-c55d-485e-a9d8-3240485a4155 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:04:17.779941 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c36d9a9-e44b-409c-825b-a58784f7cd65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d483292f3a4794848fcacfba5b107e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:04:17.780483 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c36d9a9-e44b-409c-825b-a58784f7cd65 service neutron] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:04:17.780757 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c36d9a9-e44b-409c-825b-a58784f7cd65 service neutron] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:04:17.781034 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c36d9a9-e44b-409c-825b-a58784f7cd65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:04:17.790583 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c36d9a9-e44b-409c-825b-a58784f7cd65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:04:17.792037 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c36d9a9-e44b-409c-825b-a58784f7cd65 service neutron] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:04:17.802562 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1077/2094] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:04:17 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:04:19.042424 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6904db-438e-4ec4-8ed6-cf4fb65eed3b None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:04:19.043018 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6904db-438e-4ec4-8ed6-cf4fb65eed3b None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:04:19.043187 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6904db-438e-4ec4-8ed6-cf4fb65eed3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:04:19.063280 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-ef6904db-438e-4ec4-8ed6-cf4fb65eed3b None None] MFA Rules not processed for user `b83a5a78f3e7486293907cb3012c0ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:04:19.064560 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-ef6904db-438e-4ec4-8ed6-cf4fb65eed3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:04:19.071964 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1018/2095] 10.222.0.17 () {58 vars in 1009 bytes} [Fri Oct 14 13:04:19 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:04:19.087725 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c36d9a9-e44b-409c-825b-a58784f7cd65 service neutron] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:04:19.101220 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c36d9a9-e44b-409c-825b-a58784f7cd65 service neutron] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:04:19.105782 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e0ce34-d9c3-49ba-8adb-7ba1333374c1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c9fc57b1ec4d00b9f392877f277284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:04:19.106484 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e0ce34-d9c3-49ba-8adb-7ba1333374c1 service swift] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:04:19.106861 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e0ce34-d9c3-49ba-8adb-7ba1333374c1 service swift] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:04:19.107221 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e0ce34-d9c3-49ba-8adb-7ba1333374c1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:04:19.116266 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e0ce34-d9c3-49ba-8adb-7ba1333374c1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:04:19.117946 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e0ce34-d9c3-49ba-8adb-7ba1333374c1 service swift] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:04:19.126682 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1078/2096] 10.222.0.17 () {60 vars in 1384 bytes} [Fri Oct 14 13:04:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 14 13:04:29.057962 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=58 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:04:29.123212 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=24 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:04:41.612176 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c610e884-81e8-41d2-974b-98c42df12109 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:04:41.612689 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c610e884-81e8-41d2-974b-98c42df12109 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:04:41.612780 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c610e884-81e8-41d2-974b-98c42df12109 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:04:41.632582 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-c610e884-81e8-41d2-974b-98c42df12109 None None] MFA Rules not processed for user `b83a5a78f3e7486293907cb3012c0ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:04:41.633798 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-c610e884-81e8-41d2-974b-98c42df12109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:04:41.641646 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1019/2097] 10.222.0.17 () {58 vars in 967 bytes} [Fri Oct 14 13:04:41 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:04:41.654146 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e0ce34-d9c3-49ba-8adb-7ba1333374c1 service swift] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:04:41.664576 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e0ce34-d9c3-49ba-8adb-7ba1333374c1 service swift] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:04:41.669851 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2063c98d-47f9-4438-9897-1bf58899c9aa service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c9fc57b1ec4d00b9f392877f277284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:04:41.670492 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2063c98d-47f9-4438-9897-1bf58899c9aa service swift] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:04:41.670776 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2063c98d-47f9-4438-9897-1bf58899c9aa service swift] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:04:41.671053 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2063c98d-47f9-4438-9897-1bf58899c9aa service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:04:41.679380 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2063c98d-47f9-4438-9897-1bf58899c9aa service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:04:41.681004 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2063c98d-47f9-4438-9897-1bf58899c9aa service swift] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:04:41.689681 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1079/2098] 10.222.0.17 () {60 vars in 1384 bytes} [Fri Oct 14 13:04:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 14 13:04:51.627747 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=3 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:04:51.686452 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=6 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:05:03.862750 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70acef25-eea2-4635-a8ec-8b34fc0fd051 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:03.863313 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70acef25-eea2-4635-a8ec-8b34fc0fd051 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:03.863313 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70acef25-eea2-4635-a8ec-8b34fc0fd051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:03.882090 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-70acef25-eea2-4635-a8ec-8b34fc0fd051 None None] MFA Rules not processed for user `54a6ec88e95b469c89d78cb3d4b3bc7f`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:05:03.883318 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-70acef25-eea2-4635-a8ec-8b34fc0fd051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:05:03.941853 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1020/2099] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:05:03 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:05:13.935044 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=25 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:05:42.660060 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f49b26e-1045-4fe2-8cad-337ccf7c56fc None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:42.660581 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f49b26e-1045-4fe2-8cad-337ccf7c56fc None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:42.660678 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f49b26e-1045-4fe2-8cad-337ccf7c56fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:42.680065 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-1f49b26e-1045-4fe2-8cad-337ccf7c56fc None None] MFA Rules not processed for user `a1b9ec5c477d4f01aa2ad5f634e5f73a`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:05:42.681257 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-1f49b26e-1045-4fe2-8cad-337ccf7c56fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:05:42.688109 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1080/2100] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:05:42 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:05:52.675337 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=3 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:05:53.747310 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70acef25-eea2-4635-a8ec-8b34fc0fd051 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:05:53.748722 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-70acef25-eea2-4635-a8ec-8b34fc0fd051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:05:53.763894 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70acef25-eea2-4635-a8ec-8b34fc0fd051 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:05:53.767535 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a303b6-d4c6-449b-ac93-102efbcaa009 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d483292f3a4794848fcacfba5b107e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:05:53.768226 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a303b6-d4c6-449b-ac93-102efbcaa009 service neutron] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:53.768405 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a303b6-d4c6-449b-ac93-102efbcaa009 service neutron] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:53.768675 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a303b6-d4c6-449b-ac93-102efbcaa009 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:53.770446 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-79a303b6-d4c6-449b-ac93-102efbcaa009 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:05:53.784305 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a303b6-d4c6-449b-ac93-102efbcaa009 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:05:53.785845 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a303b6-d4c6-449b-ac93-102efbcaa009 service neutron] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:05:53.797201 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1021/2101] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:05:53 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:05:53.811989 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f49b26e-1045-4fe2-8cad-337ccf7c56fc None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:05:53.822932 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f49b26e-1045-4fe2-8cad-337ccf7c56fc None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:05:53.826504 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a392261-c0aa-4765-9843-e0bc80f6d52e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d483292f3a4794848fcacfba5b107e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:05:53.827278 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a392261-c0aa-4765-9843-e0bc80f6d52e service neutron] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:05:53.827745 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a392261-c0aa-4765-9843-e0bc80f6d52e service neutron] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:05:53.828019 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a392261-c0aa-4765-9843-e0bc80f6d52e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:05:53.829743 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-4a392261-c0aa-4765-9843-e0bc80f6d52e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:05:53.843506 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a392261-c0aa-4765-9843-e0bc80f6d52e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:05:53.844964 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a392261-c0aa-4765-9843-e0bc80f6d52e service neutron] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:05:53.856592 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1081/2102] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:05:53 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:06:00.416185 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d8343c-11de-43c8-b257-9445fef77c9f None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:00.416703 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d8343c-11de-43c8-b257-9445fef77c9f None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:00.416805 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d8343c-11de-43c8-b257-9445fef77c9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:00.435609 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-d6d8343c-11de-43c8-b257-9445fef77c9f None None] MFA Rules not processed for user `9434562e690740bda182577b25f70774`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:06:00.436836 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-d6d8343c-11de-43c8-b257-9445fef77c9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:06:00.491546 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1022/2103] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:06:00 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:06:03.852047 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=6 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:06:08.430808 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a392261-c0aa-4765-9843-e0bc80f6d52e service neutron] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:06:08.440384 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a392261-c0aa-4765-9843-e0bc80f6d52e service neutron] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:06:08.444107 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4977b910-cb2a-43a8-8d69-9bda585c59cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d483292f3a4794848fcacfba5b107e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:06:08.444689 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4977b910-cb2a-43a8-8d69-9bda585c59cc service neutron] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:08.444964 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4977b910-cb2a-43a8-8d69-9bda585c59cc service neutron] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:08.445753 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4977b910-cb2a-43a8-8d69-9bda585c59cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:08.447779 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-4977b910-cb2a-43a8-8d69-9bda585c59cc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:06:08.458785 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4977b910-cb2a-43a8-8d69-9bda585c59cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:06:08.460205 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4977b910-cb2a-43a8-8d69-9bda585c59cc service neutron] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:06:08.469544 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1082/2104] 10.222.0.17 () {60 vars in 1396 bytes} [Fri Oct 14 13:06:08 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3266 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:06:10.485016 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=31 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:06:12.059949 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d8343c-11de-43c8-b257-9445fef77c9f None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:06:12.061354 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-d6d8343c-11de-43c8-b257-9445fef77c9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:06:12.077267 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d8343c-11de-43c8-b257-9445fef77c9f None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:06:12.082609 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45a731c-0bf3-452f-af37-4b49ea230bf9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '931f4e32c8764514b5efed31b0785be7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:06:12.083215 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45a731c-0bf3-452f-af37-4b49ea230bf9 service nova] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:12.083493 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45a731c-0bf3-452f-af37-4b49ea230bf9 service nova] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:12.083765 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45a731c-0bf3-452f-af37-4b49ea230bf9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:12.087643 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-a45a731c-0bf3-452f-af37-4b49ea230bf9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:06:12.099615 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45a731c-0bf3-452f-af37-4b49ea230bf9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:06:12.100804 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45a731c-0bf3-452f-af37-4b49ea230bf9 service nova] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:06:12.110972 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1023/2105] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:06:12 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:06:18.465237 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=6 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:06:22.106014 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=6 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:06:27.533118 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4977b910-cb2a-43a8-8d69-9bda585c59cc service neutron] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:06:27.541776 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4977b910-cb2a-43a8-8d69-9bda585c59cc service neutron] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:06:27.545351 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecee315f-67d3-4c80-9dc2-97202b62d25f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d483292f3a4794848fcacfba5b107e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:06:27.545933 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecee315f-67d3-4c80-9dc2-97202b62d25f service neutron] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:27.546245 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecee315f-67d3-4c80-9dc2-97202b62d25f service neutron] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:27.546517 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecee315f-67d3-4c80-9dc2-97202b62d25f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:27.548196 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-ecee315f-67d3-4c80-9dc2-97202b62d25f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:06:27.613836 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecee315f-67d3-4c80-9dc2-97202b62d25f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:06:27.615236 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecee315f-67d3-4c80-9dc2-97202b62d25f service neutron] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:06:27.625529 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1083/2106] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:06:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:06:30.794862 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45a731c-0bf3-452f-af37-4b49ea230bf9 service nova] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:06:30.806868 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45a731c-0bf3-452f-af37-4b49ea230bf9 service nova] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:06:30.812269 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f46364-803d-4160-a4a5-383297a5a9f0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a5e5c35ed8b4abc877ba8d8c490dacd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:06:30.812905 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f46364-803d-4160-a4a5-383297a5a9f0 service placement] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:30.813188 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f46364-803d-4160-a4a5-383297a5a9f0 service placement] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:30.813460 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f46364-803d-4160-a4a5-383297a5a9f0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:30.815340 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-87f46364-803d-4160-a4a5-383297a5a9f0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:06:30.828112 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f46364-803d-4160-a4a5-383297a5a9f0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:06:30.829707 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f46364-803d-4160-a4a5-383297a5a9f0 service placement] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:06:30.841465 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1024/2107] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:06:30 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:06:30.850710 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecee315f-67d3-4c80-9dc2-97202b62d25f service neutron] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:06:30.852311 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-ecee315f-67d3-4c80-9dc2-97202b62d25f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:06:30.865868 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecee315f-67d3-4c80-9dc2-97202b62d25f service neutron] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:06:30.875131 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c46fba-7b75-4384-98bb-4257b5962c96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:06:30.875803 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c46fba-7b75-4384-98bb-4257b5962c96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:30.875981 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c46fba-7b75-4384-98bb-4257b5962c96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:30.876243 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c46fba-7b75-4384-98bb-4257b5962c96 admin admin] PATH_INFO: `/v3/users/54a6ec88e95b469c89d78cb3d4b3bc7f` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:30.877386 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c46fba-7b75-4384-98bb-4257b5962c96 admin admin] RBAC: Authorizing `identity:delete_user(user_id=54a6ec88e95b469c89d78cb3d4b3bc7f)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:06:30.879349 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c46fba-7b75-4384-98bb-4257b5962c96 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:06:30.929671 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-88c46fba-7b75-4384-98bb-4257b5962c96 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54a6ec88e95b469c89d78cb3d4b3bc7f'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:06:30.936347 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-88c46fba-7b75-4384-98bb-4257b5962c96 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54a6ec88e95b469c89d78cb3d4b3bc7f'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:06:30.937018 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-88c46fba-7b75-4384-98bb-4257b5962c96 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54a6ec88e95b469c89d78cb3d4b3bc7f'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:06:30.944787 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-88c46fba-7b75-4384-98bb-4257b5962c96 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54a6ec88e95b469c89d78cb3d4b3bc7f'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:06:30.956728 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-88c46fba-7b75-4384-98bb-4257b5962c96 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54a6ec88e95b469c89d78cb3d4b3bc7f'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:06:30.964027 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1084/2108] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Oct 14 13:06:30 2022] DELETE /identity/v3/users/54a6ec88e95b469c89d78cb3d4b3bc7f => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:06:31.141914 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f46364-803d-4160-a4a5-383297a5a9f0 service placement] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:06:31.155358 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f46364-803d-4160-a4a5-383297a5a9f0 service placement] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:06:31.222390 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ca160a-4d55-4d51-b394-ab69dc7ec6e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:06:31.223176 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ca160a-4d55-4d51-b394-ab69dc7ec6e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:31.223541 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ca160a-4d55-4d51-b394-ab69dc7ec6e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:31.223817 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ca160a-4d55-4d51-b394-ab69dc7ec6e3 admin admin] PATH_INFO: `/v3/projects/a57419b4c6f44fd9886da9105b9e13b4` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:31.224950 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ca160a-4d55-4d51-b394-ab69dc7ec6e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a57419b4c6f44fd9886da9105b9e13b4)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:06:31.227769 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ca160a-4d55-4d51-b394-ab69dc7ec6e3 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:06:31.276163 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-02ca160a-4d55-4d51-b394-ab69dc7ec6e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a57419b4c6f44fd9886da9105b9e13b4', 'request_id': 'req-02ca160a-4d55-4d51-b394-ab69dc7ec6e3'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:06:31.281541 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-02ca160a-4d55-4d51-b394-ab69dc7ec6e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a57419b4c6f44fd9886da9105b9e13b4', 'request_id': 'req-02ca160a-4d55-4d51-b394-ab69dc7ec6e3'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:06:31.288113 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-02ca160a-4d55-4d51-b394-ab69dc7ec6e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a57419b4c6f44fd9886da9105b9e13b4', 'request_id': 'req-02ca160a-4d55-4d51-b394-ab69dc7ec6e3'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:06:31.301423 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-02ca160a-4d55-4d51-b394-ab69dc7ec6e3 admin admin] The token cache is being invalidate because project a57419b4c6f44fd9886da9105b9e13b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:06:31.301714 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-02ca160a-4d55-4d51-b394-ab69dc7ec6e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:06:31.302528 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-02ca160a-4d55-4d51-b394-ab69dc7ec6e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:06:31.305333 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1025/2109] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Oct 14 13:06:31 2022] DELETE /identity/v3/projects/a57419b4c6f44fd9886da9105b9e13b4 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:06:31.312272 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a10b6a5-be1c-4dd8-a7ad-39f1f91cfb80 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:31.312547 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a10b6a5-be1c-4dd8-a7ad-39f1f91cfb80 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:31.312824 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a10b6a5-be1c-4dd8-a7ad-39f1f91cfb80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:31.333324 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-4a10b6a5-be1c-4dd8-a7ad-39f1f91cfb80 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:06:31.334920 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-4a10b6a5-be1c-4dd8-a7ad-39f1f91cfb80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:06:31.396926 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1085/2110] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:06:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:06:31.404721 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6198519e-5b11-4eb4-a5da-bccec0d7df35 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:31.405032 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6198519e-5b11-4eb4-a5da-bccec0d7df35 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:31.405308 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6198519e-5b11-4eb4-a5da-bccec0d7df35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:31.425049 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-6198519e-5b11-4eb4-a5da-bccec0d7df35 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:06:31.426291 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-6198519e-5b11-4eb4-a5da-bccec0d7df35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:06:31.434896 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1026/2111] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:06:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:06:31.439069 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a10b6a5-be1c-4dd8-a7ad-39f1f91cfb80 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:06:31.449327 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a10b6a5-be1c-4dd8-a7ad-39f1f91cfb80 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:06:31.453905 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be2817f-815a-4a9c-a6ed-dc52b0dea4c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:06:31.454539 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be2817f-815a-4a9c-a6ed-dc52b0dea4c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:31.454818 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be2817f-815a-4a9c-a6ed-dc52b0dea4c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:31.455090 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be2817f-815a-4a9c-a6ed-dc52b0dea4c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:31.455730 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be2817f-815a-4a9c-a6ed-dc52b0dea4c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 13:06:31.456033 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be2817f-815a-4a9c-a6ed-dc52b0dea4c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:06:31.457632 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be2817f-815a-4a9c-a6ed-dc52b0dea4c8 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:06:31.459100 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:06:31.471575 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1086/2112] 10.222.0.17 () {58 vars in 1153 bytes} [Fri Oct 14 13:06:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 13:06:31.476103 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6198519e-5b11-4eb4-a5da-bccec0d7df35 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:06:31.485912 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6198519e-5b11-4eb4-a5da-bccec0d7df35 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:06:31.491476 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6999df-bb07-497d-bcff-d274ea2bd6ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:06:31.492043 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6999df-bb07-497d-bcff-d274ea2bd6ae admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:31.492327 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6999df-bb07-497d-bcff-d274ea2bd6ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:31.492601 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6999df-bb07-497d-bcff-d274ea2bd6ae admin admin] PATH_INFO: `/v3/projects` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:31.493247 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6999df-bb07-497d-bcff-d274ea2bd6ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:06:31.495348 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6999df-bb07-497d-bcff-d274ea2bd6ae admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:06:31.522796 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1027/2113] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Oct 14 13:06:31 2022] POST /identity/v3/projects => generated 377 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:06:31.527022 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be2817f-815a-4a9c-a6ed-dc52b0dea4c8 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:06:31.536909 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be2817f-815a-4a9c-a6ed-dc52b0dea4c8 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:06:31.592999 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedd0d90-ec07-4285-869f-d803363d8c18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:06:31.593596 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedd0d90-ec07-4285-869f-d803363d8c18 admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:31.593871 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedd0d90-ec07-4285-869f-d803363d8c18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:31.594218 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedd0d90-ec07-4285-869f-d803363d8c18 admin admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:31.595186 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedd0d90-ec07-4285-869f-d803363d8c18 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:06:31.597140 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedd0d90-ec07-4285-869f-d803363d8c18 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:06:31.619826 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1087/2114] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Oct 14 13:06:31 2022] POST /identity/v3/users => generated 289 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:06:31.624135 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6999df-bb07-497d-bcff-d274ea2bd6ae admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:06:31.634359 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6999df-bb07-497d-bcff-d274ea2bd6ae admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:06:31.638932 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de65038d-8f20-4ec7-b3ad-5a398648c59f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:06:31.639569 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de65038d-8f20-4ec7-b3ad-5a398648c59f admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:31.639841 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de65038d-8f20-4ec7-b3ad-5a398648c59f admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:31.640173 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de65038d-8f20-4ec7-b3ad-5a398648c59f admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:31.640993 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de65038d-8f20-4ec7-b3ad-5a398648c59f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:06:31.642960 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de65038d-8f20-4ec7-b3ad-5a398648c59f admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:06:31.652885 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1028/2115] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:06:31 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:06:31.656956 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedd0d90-ec07-4285-869f-d803363d8c18 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:06:31.667393 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedd0d90-ec07-4285-869f-d803363d8c18 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:06:31.672025 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f2f8df-6801-45ae-b069-44556495196d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:06:31.672612 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f2f8df-6801-45ae-b069-44556495196d admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:31.672890 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f2f8df-6801-45ae-b069-44556495196d admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:31.673161 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f2f8df-6801-45ae-b069-44556495196d admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:31.673805 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f2f8df-6801-45ae-b069-44556495196d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:06:31.675445 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f2f8df-6801-45ae-b069-44556495196d admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:06:31.686611 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1088/2116] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:06:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 14 13:06:31.691002 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de65038d-8f20-4ec7-b3ad-5a398648c59f admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:06:31.701028 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de65038d-8f20-4ec7-b3ad-5a398648c59f admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:06:31.706046 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda1a8b0-a50b-4f23-9553-276024e3a456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:06:31.706729 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda1a8b0-a50b-4f23-9553-276024e3a456 admin admin] REQUEST_METHOD: `PUT` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:31.707005 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda1a8b0-a50b-4f23-9553-276024e3a456 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:31.707278 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda1a8b0-a50b-4f23-9553-276024e3a456 admin admin] PATH_INFO: `/v3/projects/818c2b08a84f4fad8bf281f00d65eb55/users/b7394b504d0d4338adc6c599cadda6d6/roles/5e8849303a75425b9eaa2681cc031af1` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:31.722073 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda1a8b0-a50b-4f23-9553-276024e3a456 admin admin] RBAC: Authorizing `identity:create_grant(project_id=818c2b08a84f4fad8bf281f00d65eb55, user_id=b7394b504d0d4338adc6c599cadda6d6, role_id=5e8849303a75425b9eaa2681cc031af1)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:06:31.724716 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda1a8b0-a50b-4f23-9553-276024e3a456 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:06:31.737338 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1029/2117] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Oct 14 13:06:31 2022] PUT /identity/v3/projects/818c2b08a84f4fad8bf281f00d65eb55/users/b7394b504d0d4338adc6c599cadda6d6/roles/5e8849303a75425b9eaa2681cc031af1 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:06:31.743333 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1fdc78-5a11-4d64-b131-61605a80830c None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:31.743722 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1fdc78-5a11-4d64-b131-61605a80830c None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:31.744091 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1fdc78-5a11-4d64-b131-61605a80830c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:31.762829 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-aa1fdc78-5a11-4d64-b131-61605a80830c None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:06:31.764046 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-aa1fdc78-5a11-4d64-b131-61605a80830c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:06:31.823386 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1089/2118] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:06:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 13:06:31.833781 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda1a8b0-a50b-4f23-9553-276024e3a456 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:06:31.836714 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-fda1a8b0-a50b-4f23-9553-276024e3a456 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:06:31.852750 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:06:31.900400 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda1a8b0-a50b-4f23-9553-276024e3a456 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:06:31.904313 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00912d11-dcc9-4062-85fd-089a87b4fb08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d483292f3a4794848fcacfba5b107e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:06:31.904873 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00912d11-dcc9-4062-85fd-089a87b4fb08 service neutron] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:31.905156 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00912d11-dcc9-4062-85fd-089a87b4fb08 service neutron] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:31.905435 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00912d11-dcc9-4062-85fd-089a87b4fb08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:31.915426 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00912d11-dcc9-4062-85fd-089a87b4fb08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:06:31.916889 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00912d11-dcc9-4062-85fd-089a87b4fb08 service neutron] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:06:31.927543 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1030/2119] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:06:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:06:35.863095 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8821f412-0f84-40b0-9577-7f5558311f96 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:35.863617 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8821f412-0f84-40b0-9577-7f5558311f96 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:35.863725 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8821f412-0f84-40b0-9577-7f5558311f96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:35.896281 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-8821f412-0f84-40b0-9577-7f5558311f96 None None] MFA Rules not processed for user `b7394b504d0d4338adc6c599cadda6d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:06:35.898424 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-8821f412-0f84-40b0-9577-7f5558311f96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:06:36.000668 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1090/2120] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:06:35 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:06:36.001804 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00912d11-dcc9-4062-85fd-089a87b4fb08 service neutron] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:06:36.003238 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-00912d11-dcc9-4062-85fd-089a87b4fb08 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:06:36.119077 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00912d11-dcc9-4062-85fd-089a87b4fb08 service neutron] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:06:36.124662 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de71fc1a-7ea2-48c8-9707-eb7c4c5d4ae8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '931f4e32c8764514b5efed31b0785be7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:06:36.125290 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de71fc1a-7ea2-48c8-9707-eb7c4c5d4ae8 service nova] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:36.125569 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de71fc1a-7ea2-48c8-9707-eb7c4c5d4ae8 service nova] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:36.125843 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de71fc1a-7ea2-48c8-9707-eb7c4c5d4ae8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:36.134815 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de71fc1a-7ea2-48c8-9707-eb7c4c5d4ae8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:06:36.136429 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de71fc1a-7ea2-48c8-9707-eb7c4c5d4ae8 service nova] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:06:36.145930 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1031/2121] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:06:36 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 14 13:06:37.404049 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19566f00-4954-416b-9840-cab23a80d6d7 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:37.404565 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19566f00-4954-416b-9840-cab23a80d6d7 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:37.404683 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19566f00-4954-416b-9840-cab23a80d6d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:37.411805 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:06:37.426105 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-19566f00-4954-416b-9840-cab23a80d6d7 None None] MFA Rules not processed for user `b7394b504d0d4338adc6c599cadda6d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:06:37.427373 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-19566f00-4954-416b-9840-cab23a80d6d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:06:37.434764 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1091/2122] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:06:37 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:06:37.747540 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de71fc1a-7ea2-48c8-9707-eb7c4c5d4ae8 service nova] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:06:37.749773 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-de71fc1a-7ea2-48c8-9707-eb7c4c5d4ae8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:06:37.763249 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de71fc1a-7ea2-48c8-9707-eb7c4c5d4ae8 service nova] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:06:37.766855 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3674faf1-2a41-4c4b-a212-3b627ef3f1e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d483292f3a4794848fcacfba5b107e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:06:37.767523 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3674faf1-2a41-4c4b-a212-3b627ef3f1e1 service neutron] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:37.767809 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3674faf1-2a41-4c4b-a212-3b627ef3f1e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:37.768082 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3674faf1-2a41-4c4b-a212-3b627ef3f1e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:37.769808 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-3674faf1-2a41-4c4b-a212-3b627ef3f1e1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:06:37.779549 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3674faf1-2a41-4c4b-a212-3b627ef3f1e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:06:37.780965 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3674faf1-2a41-4c4b-a212-3b627ef3f1e1 service neutron] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:06:37.789889 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1032/2123] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:06:37 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:06:38.172282 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19566f00-4954-416b-9840-cab23a80d6d7 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:06:38.173678 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-19566f00-4954-416b-9840-cab23a80d6d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:06:38.288346 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19566f00-4954-416b-9840-cab23a80d6d7 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:06:38.293649 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366b9fb7-e1a7-40fc-a660-24660dba3dbb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a5e5c35ed8b4abc877ba8d8c490dacd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:06:38.294289 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366b9fb7-e1a7-40fc-a660-24660dba3dbb service placement] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:38.294572 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366b9fb7-e1a7-40fc-a660-24660dba3dbb service placement] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:38.294841 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366b9fb7-e1a7-40fc-a660-24660dba3dbb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:38.296612 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-366b9fb7-e1a7-40fc-a660-24660dba3dbb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:06:38.309188 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366b9fb7-e1a7-40fc-a660-24660dba3dbb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:06:38.310870 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366b9fb7-e1a7-40fc-a660-24660dba3dbb service placement] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:06:38.322052 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1092/2124] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:06:38 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:06:40.141960 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3674faf1-2a41-4c4b-a212-3b627ef3f1e1 service neutron] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:06:40.155830 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3674faf1-2a41-4c4b-a212-3b627ef3f1e1 service neutron] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:06:40.160306 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99480659-47e3-4168-ac98-25a709cb5688 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d483292f3a4794848fcacfba5b107e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:06:40.161212 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99480659-47e3-4168-ac98-25a709cb5688 service neutron] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:40.161677 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99480659-47e3-4168-ac98-25a709cb5688 service neutron] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:40.162722 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99480659-47e3-4168-ac98-25a709cb5688 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:40.165005 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-99480659-47e3-4168-ac98-25a709cb5688 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:06:40.176487 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99480659-47e3-4168-ac98-25a709cb5688 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:06:40.178681 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99480659-47e3-4168-ac98-25a709cb5688 service neutron] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:06:40.187864 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1033/2125] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:06:40 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:06:40.840951 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366b9fb7-e1a7-40fc-a660-24660dba3dbb service placement] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:06:40.842548 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-366b9fb7-e1a7-40fc-a660-24660dba3dbb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:06:40.860661 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366b9fb7-e1a7-40fc-a660-24660dba3dbb service placement] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:06:40.867248 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12970870-5ce3-4059-b474-8f5bfaba047d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '931f4e32c8764514b5efed31b0785be7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:06:40.867865 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12970870-5ce3-4059-b474-8f5bfaba047d service nova] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:40.868148 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12970870-5ce3-4059-b474-8f5bfaba047d service nova] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:40.868433 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12970870-5ce3-4059-b474-8f5bfaba047d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:40.870220 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-12970870-5ce3-4059-b474-8f5bfaba047d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:06:40.884689 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12970870-5ce3-4059-b474-8f5bfaba047d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:06:40.886347 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12970870-5ce3-4059-b474-8f5bfaba047d service nova] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:06:40.898546 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1093/2126] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:06:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:06:47.881539 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99480659-47e3-4168-ac98-25a709cb5688 service neutron] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:06:47.895691 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99480659-47e3-4168-ac98-25a709cb5688 service neutron] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:06:47.901659 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb25ec6-4df8-484e-ba4c-d47d538c6559 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '931f4e32c8764514b5efed31b0785be7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:06:47.902305 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb25ec6-4df8-484e-ba4c-d47d538c6559 service nova] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:47.902586 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb25ec6-4df8-484e-ba4c-d47d538c6559 service nova] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:47.902860 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb25ec6-4df8-484e-ba4c-d47d538c6559 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:47.904567 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-fcb25ec6-4df8-484e-ba4c-d47d538c6559 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:06:47.916930 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb25ec6-4df8-484e-ba4c-d47d538c6559 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:06:47.918590 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb25ec6-4df8-484e-ba4c-d47d538c6559 service nova] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:06:47.929934 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1034/2127] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:06:47 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:06:50.892992 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=40 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:06:52.118742 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12970870-5ce3-4059-b474-8f5bfaba047d service nova] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:06:52.144788 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12970870-5ce3-4059-b474-8f5bfaba047d service nova] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:06:52.151111 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fb947e-6032-4b9d-8e59-4ea923affd36 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '931f4e32c8764514b5efed31b0785be7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:06:52.151714 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fb947e-6032-4b9d-8e59-4ea923affd36 service nova] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:06:52.151990 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fb947e-6032-4b9d-8e59-4ea923affd36 service nova] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:06:52.152259 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fb947e-6032-4b9d-8e59-4ea923affd36 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:06:52.153957 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-43fb947e-6032-4b9d-8e59-4ea923affd36 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:06:52.167228 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fb947e-6032-4b9d-8e59-4ea923affd36 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:06:52.169017 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fb947e-6032-4b9d-8e59-4ea923affd36 service nova] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:06:52.183539 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1094/2128] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:06:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:06:57.924941 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=72 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:07:02.179760 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=6 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:07:11.421408 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb25ec6-4df8-484e-ba4c-d47d538c6559 service nova] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:07:11.432499 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb25ec6-4df8-484e-ba4c-d47d538c6559 service nova] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:07:11.438217 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e401e49c-4e83-4cf4-b5ec-ff5e6261baec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '931f4e32c8764514b5efed31b0785be7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:07:11.438809 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e401e49c-4e83-4cf4-b5ec-ff5e6261baec service nova] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:07:11.439094 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e401e49c-4e83-4cf4-b5ec-ff5e6261baec service nova] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:07:11.439371 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e401e49c-4e83-4cf4-b5ec-ff5e6261baec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:07:11.441091 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-e401e49c-4e83-4cf4-b5ec-ff5e6261baec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:07:11.499116 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e401e49c-4e83-4cf4-b5ec-ff5e6261baec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:07:11.500703 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e401e49c-4e83-4cf4-b5ec-ff5e6261baec service nova] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:07:11.510369 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1035/2129] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:07:11 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:07:21.506360 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=28 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:07:26.455028 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2399e402-f3f0-4b94-9086-653e50757be7 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:07:26.455578 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2399e402-f3f0-4b94-9086-653e50757be7 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:07:26.455685 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2399e402-f3f0-4b94-9086-653e50757be7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:07:26.477514 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-2399e402-f3f0-4b94-9086-653e50757be7 None None] MFA Rules not processed for user `a1b9ec5c477d4f01aa2ad5f634e5f73a`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:07:26.478774 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-2399e402-f3f0-4b94-9086-653e50757be7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:07:26.486071 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1095/2130] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:07:26 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:07:26.792600 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e401e49c-4e83-4cf4-b5ec-ff5e6261baec service nova] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:07:26.802255 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e401e49c-4e83-4cf4-b5ec-ff5e6261baec service nova] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:07:26.805993 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef97f1f-e9d0-4dfe-a399-da7d5c8e5158 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d483292f3a4794848fcacfba5b107e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:07:26.806630 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef97f1f-e9d0-4dfe-a399-da7d5c8e5158 service neutron] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:07:26.806914 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef97f1f-e9d0-4dfe-a399-da7d5c8e5158 service neutron] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:07:26.807190 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef97f1f-e9d0-4dfe-a399-da7d5c8e5158 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:07:26.808939 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-9ef97f1f-e9d0-4dfe-a399-da7d5c8e5158 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:07:26.818888 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef97f1f-e9d0-4dfe-a399-da7d5c8e5158 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:07:26.820305 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef97f1f-e9d0-4dfe-a399-da7d5c8e5158 service neutron] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:07:26.828266 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1036/2131] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:07:26 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:07:36.472179 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=3 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:07:36.824651 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=6 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:08:03.582446 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097f671f-889a-4636-b7c5-43acba7f9955 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:08:03.583026 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097f671f-889a-4636-b7c5-43acba7f9955 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:08:03.583026 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097f671f-889a-4636-b7c5-43acba7f9955 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:08:03.603222 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-097f671f-889a-4636-b7c5-43acba7f9955 None None] MFA Rules not processed for user `b83a5a78f3e7486293907cb3012c0ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:08:03.604428 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-097f671f-889a-4636-b7c5-43acba7f9955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:08:03.659426 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1096/2132] 10.222.0.17 () {58 vars in 1009 bytes} [Fri Oct 14 13:08:03 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:08:03.706585 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef97f1f-e9d0-4dfe-a399-da7d5c8e5158 service neutron] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:08:03.708013 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-9ef97f1f-e9d0-4dfe-a399-da7d5c8e5158 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:08:03.776375 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef97f1f-e9d0-4dfe-a399-da7d5c8e5158 service neutron] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:08:03.781279 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b61a38-9e52-4d59-8304-6cbebdd57f4e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c9fc57b1ec4d00b9f392877f277284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:08:03.781878 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b61a38-9e52-4d59-8304-6cbebdd57f4e service swift] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:08:03.782179 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b61a38-9e52-4d59-8304-6cbebdd57f4e service swift] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:08:03.782453 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b61a38-9e52-4d59-8304-6cbebdd57f4e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:08:03.791074 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b61a38-9e52-4d59-8304-6cbebdd57f4e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:08:03.792652 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b61a38-9e52-4d59-8304-6cbebdd57f4e service swift] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:08:03.800574 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1037/2133] 10.222.0.17 () {60 vars in 1384 bytes} [Fri Oct 14 13:08:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 14 13:08:13.652972 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=25 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:08:13.797551 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=32 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:08:21.411227 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb018b2f-3756-44cd-9c7c-7d014f345680 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:08:21.411682 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb018b2f-3756-44cd-9c7c-7d014f345680 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:08:21.411896 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb018b2f-3756-44cd-9c7c-7d014f345680 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:08:21.431365 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-fb018b2f-3756-44cd-9c7c-7d014f345680 None None] MFA Rules not processed for user `b83a5a78f3e7486293907cb3012c0ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:08:21.432577 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-fb018b2f-3756-44cd-9c7c-7d014f345680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:08:21.439687 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1097/2134] 10.222.0.17 () {58 vars in 1009 bytes} [Fri Oct 14 13:08:21 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:08:21.452237 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b61a38-9e52-4d59-8304-6cbebdd57f4e service swift] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:08:21.462946 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b61a38-9e52-4d59-8304-6cbebdd57f4e service swift] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:08:21.468168 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8401ea-35b9-40f2-ac80-5f66b4e4648c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c9fc57b1ec4d00b9f392877f277284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:08:21.468752 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8401ea-35b9-40f2-ac80-5f66b4e4648c service swift] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:08:21.469031 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8401ea-35b9-40f2-ac80-5f66b4e4648c service swift] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:08:21.469301 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8401ea-35b9-40f2-ac80-5f66b4e4648c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:08:21.477354 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8401ea-35b9-40f2-ac80-5f66b4e4648c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:08:21.478953 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8401ea-35b9-40f2-ac80-5f66b4e4648c service swift] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:08:21.487219 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1038/2135] 10.222.0.17 () {60 vars in 1384 bytes} [Fri Oct 14 13:08:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 14 13:08:31.425979 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=3 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:08:31.483786 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=6 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:08:42.519561 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c037399-2cc8-466a-b885-397040b296dd None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:08:42.520119 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c037399-2cc8-466a-b885-397040b296dd None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:08:42.520231 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c037399-2cc8-466a-b885-397040b296dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:08:42.539730 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-9c037399-2cc8-466a-b885-397040b296dd None None] MFA Rules not processed for user `b83a5a78f3e7486293907cb3012c0ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:08:42.540953 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-9c037399-2cc8-466a-b885-397040b296dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:08:42.547943 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1098/2136] 10.222.0.17 () {58 vars in 967 bytes} [Fri Oct 14 13:08:42 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:08:42.560728 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8401ea-35b9-40f2-ac80-5f66b4e4648c service swift] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:08:42.571961 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8401ea-35b9-40f2-ac80-5f66b4e4648c service swift] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:08:42.576911 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76f19bc-79ed-4cbb-8475-e7d1293ac315 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c9fc57b1ec4d00b9f392877f277284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:08:42.577496 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76f19bc-79ed-4cbb-8475-e7d1293ac315 service swift] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:08:42.577772 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76f19bc-79ed-4cbb-8475-e7d1293ac315 service swift] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:08:42.578044 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76f19bc-79ed-4cbb-8475-e7d1293ac315 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:08:42.586654 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76f19bc-79ed-4cbb-8475-e7d1293ac315 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:08:42.588199 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76f19bc-79ed-4cbb-8475-e7d1293ac315 service swift] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:08:42.596538 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1039/2137] 10.222.0.17 () {60 vars in 1384 bytes} [Fri Oct 14 13:08:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 14 13:08:52.534840 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=3 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:08:52.593175 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=6 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:09:18.379869 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c037399-2cc8-466a-b885-397040b296dd None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:09:18.454671 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c037399-2cc8-466a-b885-397040b296dd None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:09:18.461191 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59231bd2-19e9-4457-8a3b-7af8290730e4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a5e5c35ed8b4abc877ba8d8c490dacd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:09:18.461648 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59231bd2-19e9-4457-8a3b-7af8290730e4 service placement] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:09:18.461995 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59231bd2-19e9-4457-8a3b-7af8290730e4 service placement] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:09:18.462272 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59231bd2-19e9-4457-8a3b-7af8290730e4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:09:18.464753 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-59231bd2-19e9-4457-8a3b-7af8290730e4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:09:18.499711 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59231bd2-19e9-4457-8a3b-7af8290730e4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:09:18.501321 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59231bd2-19e9-4457-8a3b-7af8290730e4 service placement] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:09:18.512095 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1099/2138] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:09:18 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 14 13:09:20.043798 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76f19bc-79ed-4cbb-8475-e7d1293ac315 service swift] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:09:20.073788 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76f19bc-79ed-4cbb-8475-e7d1293ac315 service swift] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:09:20.077807 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93995b6-1113-4dce-924d-60cb27fa2a6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d483292f3a4794848fcacfba5b107e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:09:20.078437 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93995b6-1113-4dce-924d-60cb27fa2a6c service neutron] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:09:20.078742 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93995b6-1113-4dce-924d-60cb27fa2a6c service neutron] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:09:20.079013 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93995b6-1113-4dce-924d-60cb27fa2a6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:09:20.080713 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-c93995b6-1113-4dce-924d-60cb27fa2a6c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:09:20.145144 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93995b6-1113-4dce-924d-60cb27fa2a6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:09:20.146653 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93995b6-1113-4dce-924d-60cb27fa2a6c service neutron] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:09:20.156902 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1040/2139] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:09:20 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:09:24.441177 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59231bd2-19e9-4457-8a3b-7af8290730e4 service placement] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:09:24.451365 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59231bd2-19e9-4457-8a3b-7af8290730e4 service placement] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:09:24.455061 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553d471d-befe-446e-9378-50a563c1247a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d483292f3a4794848fcacfba5b107e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:09:24.455653 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553d471d-befe-446e-9378-50a563c1247a service neutron] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:09:24.455933 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553d471d-befe-446e-9378-50a563c1247a service neutron] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:09:24.456208 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553d471d-befe-446e-9378-50a563c1247a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:09:24.458023 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-553d471d-befe-446e-9378-50a563c1247a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:09:24.493715 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553d471d-befe-446e-9378-50a563c1247a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:09:24.495356 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553d471d-befe-446e-9378-50a563c1247a service neutron] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:09:24.514297 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1100/2140] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:09:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:09:25.957518 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93995b6-1113-4dce-924d-60cb27fa2a6c service neutron] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:09:25.971149 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93995b6-1113-4dce-924d-60cb27fa2a6c service neutron] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:09:25.975959 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a7edf7-08d9-4bd8-96a8-83828f9c1fb7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d483292f3a4794848fcacfba5b107e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:09:25.976897 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a7edf7-08d9-4bd8-96a8-83828f9c1fb7 service neutron] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:09:25.977286 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a7edf7-08d9-4bd8-96a8-83828f9c1fb7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:09:25.977659 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a7edf7-08d9-4bd8-96a8-83828f9c1fb7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:09:25.979662 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-93a7edf7-08d9-4bd8-96a8-83828f9c1fb7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:09:25.992464 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a7edf7-08d9-4bd8-96a8-83828f9c1fb7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:09:25.993945 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a7edf7-08d9-4bd8-96a8-83828f9c1fb7 service neutron] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:09:26.007868 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1041/2141] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:09:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:09:29.001956 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553d471d-befe-446e-9378-50a563c1247a service neutron] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:09:29.004140 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-553d471d-befe-446e-9378-50a563c1247a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:09:29.019245 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553d471d-befe-446e-9378-50a563c1247a service neutron] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:09:29.024496 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a24499-6f00-49fa-8e58-44b66e2abad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:09:29.025405 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a24499-6f00-49fa-8e58-44b66e2abad5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:09:29.025854 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a24499-6f00-49fa-8e58-44b66e2abad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:09:29.026442 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a24499-6f00-49fa-8e58-44b66e2abad5 admin admin] PATH_INFO: `/v3/users/a1b9ec5c477d4f01aa2ad5f634e5f73a` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:09:29.028078 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a24499-6f00-49fa-8e58-44b66e2abad5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1b9ec5c477d4f01aa2ad5f634e5f73a)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:09:29.030214 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a24499-6f00-49fa-8e58-44b66e2abad5 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:09:29.117695 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-77a24499-6f00-49fa-8e58-44b66e2abad5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1b9ec5c477d4f01aa2ad5f634e5f73a'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:09:29.132898 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-77a24499-6f00-49fa-8e58-44b66e2abad5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1b9ec5c477d4f01aa2ad5f634e5f73a'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:09:29.133802 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-77a24499-6f00-49fa-8e58-44b66e2abad5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1b9ec5c477d4f01aa2ad5f634e5f73a'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:09:29.150300 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-77a24499-6f00-49fa-8e58-44b66e2abad5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1b9ec5c477d4f01aa2ad5f634e5f73a'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:09:29.187189 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-77a24499-6f00-49fa-8e58-44b66e2abad5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1b9ec5c477d4f01aa2ad5f634e5f73a'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:09:29.206849 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1101/2142] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Oct 14 13:09:29 2022] DELETE /identity/v3/users/a1b9ec5c477d4f01aa2ad5f634e5f73a => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:09:29.387320 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a7edf7-08d9-4bd8-96a8-83828f9c1fb7 service neutron] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:09:29.401076 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a7edf7-08d9-4bd8-96a8-83828f9c1fb7 service neutron] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:09:29.463195 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae037f6-0acb-4c00-97ad-060fa5878212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:09:29.463948 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae037f6-0acb-4c00-97ad-060fa5878212 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:09:29.464346 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae037f6-0acb-4c00-97ad-060fa5878212 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:09:29.464658 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae037f6-0acb-4c00-97ad-060fa5878212 admin admin] PATH_INFO: `/v3/projects/51cb4c6730644130a77f1921a14745a1` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:09:29.465800 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae037f6-0acb-4c00-97ad-060fa5878212 admin admin] RBAC: Authorizing `identity:delete_project(project_id=51cb4c6730644130a77f1921a14745a1)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:09:29.468126 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae037f6-0acb-4c00-97ad-060fa5878212 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:09:29.547009 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-dae037f6-0acb-4c00-97ad-060fa5878212 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51cb4c6730644130a77f1921a14745a1', 'request_id': 'req-dae037f6-0acb-4c00-97ad-060fa5878212'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:09:29.552935 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-dae037f6-0acb-4c00-97ad-060fa5878212 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51cb4c6730644130a77f1921a14745a1', 'request_id': 'req-dae037f6-0acb-4c00-97ad-060fa5878212'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:09:29.561459 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-dae037f6-0acb-4c00-97ad-060fa5878212 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51cb4c6730644130a77f1921a14745a1', 'request_id': 'req-dae037f6-0acb-4c00-97ad-060fa5878212'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:09:29.567171 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:09:29.584253 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-dae037f6-0acb-4c00-97ad-060fa5878212 admin admin] The token cache is being invalidate because project 51cb4c6730644130a77f1921a14745a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:09:29.584858 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-dae037f6-0acb-4c00-97ad-060fa5878212 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:09:29.585619 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-dae037f6-0acb-4c00-97ad-060fa5878212 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:09:29.587772 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1042/2143] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Oct 14 13:09:29 2022] DELETE /identity/v3/projects/51cb4c6730644130a77f1921a14745a1 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:09:29.593223 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25aec6d-74e0-4456-83f8-ec59469087cc None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:09:29.593517 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25aec6d-74e0-4456-83f8-ec59469087cc None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:09:29.593792 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25aec6d-74e0-4456-83f8-ec59469087cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:09:29.615816 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:09:29.668508 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-b25aec6d-74e0-4456-83f8-ec59469087cc None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:09:29.669811 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-b25aec6d-74e0-4456-83f8-ec59469087cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:09:29.736987 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1102/2144] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:09:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:09:29.745301 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51dd9b2-7770-4b90-8595-ff8008d3c113 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:09:29.745841 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51dd9b2-7770-4b90-8595-ff8008d3c113 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:09:29.746207 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51dd9b2-7770-4b90-8595-ff8008d3c113 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:09:29.771689 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-f51dd9b2-7770-4b90-8595-ff8008d3c113 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:09:29.773563 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-f51dd9b2-7770-4b90-8595-ff8008d3c113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:09:29.782310 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1043/2145] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:09:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:09:29.786924 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25aec6d-74e0-4456-83f8-ec59469087cc None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:09:29.800138 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25aec6d-74e0-4456-83f8-ec59469087cc None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:09:29.805902 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df42bd84-0e2e-46d9-9c23-5beaebec9faf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:09:29.806768 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df42bd84-0e2e-46d9-9c23-5beaebec9faf admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:09:29.807120 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df42bd84-0e2e-46d9-9c23-5beaebec9faf admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:09:29.807669 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df42bd84-0e2e-46d9-9c23-5beaebec9faf admin admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:09:29.808524 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df42bd84-0e2e-46d9-9c23-5beaebec9faf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 13:09:29.808888 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df42bd84-0e2e-46d9-9c23-5beaebec9faf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:09:29.810612 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df42bd84-0e2e-46d9-9c23-5beaebec9faf admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:09:29.849045 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1103/2146] 10.222.0.17 () {58 vars in 1153 bytes} [Fri Oct 14 13:09:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 13:09:29.849596 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51dd9b2-7770-4b90-8595-ff8008d3c113 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:09:29.860652 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51dd9b2-7770-4b90-8595-ff8008d3c113 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:09:29.865267 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4633c15b-1c15-465a-9cb1-99dee8b91fb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:09:29.865942 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4633c15b-1c15-465a-9cb1-99dee8b91fb8 admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:09:29.866857 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4633c15b-1c15-465a-9cb1-99dee8b91fb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:09:29.867135 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4633c15b-1c15-465a-9cb1-99dee8b91fb8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:09:29.870594 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4633c15b-1c15-465a-9cb1-99dee8b91fb8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:09:29.872659 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4633c15b-1c15-465a-9cb1-99dee8b91fb8 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:09:29.921277 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df42bd84-0e2e-46d9-9c23-5beaebec9faf admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:09:29.921754 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1044/2147] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Oct 14 13:09:29 2022] POST /identity/v3/projects => generated 363 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 13:09:29.950550 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df42bd84-0e2e-46d9-9c23-5beaebec9faf admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:09:30.031522 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79f04f0-a51b-4858-86d3-c846c9958816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:09:30.032844 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79f04f0-a51b-4858-86d3-c846c9958816 admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:09:30.033119 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79f04f0-a51b-4858-86d3-c846c9958816 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:09:30.033595 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79f04f0-a51b-4858-86d3-c846c9958816 admin admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:09:30.034280 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79f04f0-a51b-4858-86d3-c846c9958816 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:09:30.036185 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79f04f0-a51b-4858-86d3-c846c9958816 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:09:30.061693 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1104/2148] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Oct 14 13:09:29 2022] POST /identity/v3/users => generated 282 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:09:30.065962 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4633c15b-1c15-465a-9cb1-99dee8b91fb8 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:09:30.077366 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4633c15b-1c15-465a-9cb1-99dee8b91fb8 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:09:30.082137 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396e2382-8799-40de-90ee-a49a67b460e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:09:30.082746 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396e2382-8799-40de-90ee-a49a67b460e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:09:30.083029 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396e2382-8799-40de-90ee-a49a67b460e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:09:30.083300 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396e2382-8799-40de-90ee-a49a67b460e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:09:30.084384 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396e2382-8799-40de-90ee-a49a67b460e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:09:30.086968 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396e2382-8799-40de-90ee-a49a67b460e3 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:09:30.098742 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1045/2149] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:09:30 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 14 13:09:30.102829 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79f04f0-a51b-4858-86d3-c846c9958816 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:09:30.112609 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79f04f0-a51b-4858-86d3-c846c9958816 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:09:30.117943 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a816c080-0715-4155-b187-8a4c8e51e186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:09:30.118636 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a816c080-0715-4155-b187-8a4c8e51e186 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:09:30.118980 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a816c080-0715-4155-b187-8a4c8e51e186 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:09:30.119317 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a816c080-0715-4155-b187-8a4c8e51e186 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:09:30.120022 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a816c080-0715-4155-b187-8a4c8e51e186 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:09:30.121627 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a816c080-0715-4155-b187-8a4c8e51e186 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:09:30.133880 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1105/2150] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:09:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:09:30.137656 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396e2382-8799-40de-90ee-a49a67b460e3 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:09:30.148899 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396e2382-8799-40de-90ee-a49a67b460e3 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:09:30.153599 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2899d0-969c-44ca-90f3-baf46f286214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:09:30.154295 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2899d0-969c-44ca-90f3-baf46f286214 admin admin] REQUEST_METHOD: `PUT` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:09:30.154576 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2899d0-969c-44ca-90f3-baf46f286214 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:09:30.154847 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2899d0-969c-44ca-90f3-baf46f286214 admin admin] PATH_INFO: `/v3/projects/2984f2d0b63141a9b11e834f644bd18c/users/44b5fad116a04b4ab9404b41dbece273/roles/5e8849303a75425b9eaa2681cc031af1` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:09:30.170057 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2899d0-969c-44ca-90f3-baf46f286214 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2984f2d0b63141a9b11e834f644bd18c, user_id=44b5fad116a04b4ab9404b41dbece273, role_id=5e8849303a75425b9eaa2681cc031af1)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:09:30.172795 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2899d0-969c-44ca-90f3-baf46f286214 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:09:30.188196 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1046/2151] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Oct 14 13:09:30 2022] PUT /identity/v3/projects/2984f2d0b63141a9b11e834f644bd18c/users/44b5fad116a04b4ab9404b41dbece273/roles/5e8849303a75425b9eaa2681cc031af1 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:09:30.199208 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75553e9c-9106-4a37-b7e7-f5037b236238 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:09:30.199492 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75553e9c-9106-4a37-b7e7-f5037b236238 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:09:30.199817 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75553e9c-9106-4a37-b7e7-f5037b236238 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:09:30.228023 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-75553e9c-9106-4a37-b7e7-f5037b236238 None None] MFA Rules not processed for user `44b5fad116a04b4ab9404b41dbece273`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:09:30.229157 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-75553e9c-9106-4a37-b7e7-f5037b236238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:09:30.265704 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:09:30.306967 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1106/2152] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:09:30 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 13:09:30.308279 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2899d0-969c-44ca-90f3-baf46f286214 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:09:30.412183 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2899d0-969c-44ca-90f3-baf46f286214 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:09:30.417086 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e8a031-e882-4c9c-aca0-e16d18830f71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:09:30.417759 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e8a031-e882-4c9c-aca0-e16d18830f71 admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:09:30.418104 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e8a031-e882-4c9c-aca0-e16d18830f71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:09:30.418470 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e8a031-e882-4c9c-aca0-e16d18830f71 admin admin] PATH_INFO: `/v3/projects` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:09:30.419170 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e8a031-e882-4c9c-aca0-e16d18830f71 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:09:30.421770 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e8a031-e882-4c9c-aca0-e16d18830f71 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:09:30.466940 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1047/2153] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Oct 14 13:09:30 2022] POST /identity/v3/projects => generated 363 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:09:30.470912 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75553e9c-9106-4a37-b7e7-f5037b236238 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:09:30.482920 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75553e9c-9106-4a37-b7e7-f5037b236238 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:09:30.547355 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268442ca-82cf-42a3-b5b2-ee30c6fd772a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:09:30.547888 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268442ca-82cf-42a3-b5b2-ee30c6fd772a admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:09:30.548170 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268442ca-82cf-42a3-b5b2-ee30c6fd772a admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:09:30.548444 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268442ca-82cf-42a3-b5b2-ee30c6fd772a admin admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:09:30.549094 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268442ca-82cf-42a3-b5b2-ee30c6fd772a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:09:30.551219 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268442ca-82cf-42a3-b5b2-ee30c6fd772a admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:09:30.573512 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1107/2154] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Oct 14 13:09:30 2022] POST /identity/v3/users => generated 288 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 13:09:30.577573 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e8a031-e882-4c9c-aca0-e16d18830f71 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:09:30.589543 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e8a031-e882-4c9c-aca0-e16d18830f71 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:09:30.594727 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bce554-b5bd-4a3f-b5d0-9e17101755c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:09:30.595449 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bce554-b5bd-4a3f-b5d0-9e17101755c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:09:30.595764 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bce554-b5bd-4a3f-b5d0-9e17101755c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:09:30.596037 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bce554-b5bd-4a3f-b5d0-9e17101755c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:09:30.596685 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bce554-b5bd-4a3f-b5d0-9e17101755c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:09:30.598321 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bce554-b5bd-4a3f-b5d0-9e17101755c9 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:09:30.614168 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1048/2155] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:09:30 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:09:30.615825 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268442ca-82cf-42a3-b5b2-ee30c6fd772a admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:09:30.628239 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268442ca-82cf-42a3-b5b2-ee30c6fd772a admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:09:30.634138 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9154669f-3057-459a-ba7d-a0fb50cc2989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:09:30.634817 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9154669f-3057-459a-ba7d-a0fb50cc2989 admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:09:30.635092 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9154669f-3057-459a-ba7d-a0fb50cc2989 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:09:30.635369 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9154669f-3057-459a-ba7d-a0fb50cc2989 admin admin] PATH_INFO: `/v3/projects/3039204b20764a62875587eee0e27e05/users/54fbbe82fbec4f4dbc0587383326706a/roles/7f6e29e390bc41f7a9af17659a2e95d1` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:09:30.652162 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9154669f-3057-459a-ba7d-a0fb50cc2989 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3039204b20764a62875587eee0e27e05, user_id=54fbbe82fbec4f4dbc0587383326706a, role_id=7f6e29e390bc41f7a9af17659a2e95d1)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:09:30.654812 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9154669f-3057-459a-ba7d-a0fb50cc2989 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:09:30.669182 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1108/2156] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Oct 14 13:09:30 2022] PUT /identity/v3/projects/3039204b20764a62875587eee0e27e05/users/54fbbe82fbec4f4dbc0587383326706a/roles/7f6e29e390bc41f7a9af17659a2e95d1 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:09:30.673172 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bce554-b5bd-4a3f-b5d0-9e17101755c9 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:09:30.685657 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bce554-b5bd-4a3f-b5d0-9e17101755c9 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:09:30.743261 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce7e8e2-442c-4696-92a3-8aaf7d3d7426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:09:30.743893 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce7e8e2-442c-4696-92a3-8aaf7d3d7426 admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:09:30.744169 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce7e8e2-442c-4696-92a3-8aaf7d3d7426 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:09:30.744562 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce7e8e2-442c-4696-92a3-8aaf7d3d7426 admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:09:30.745208 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce7e8e2-442c-4696-92a3-8aaf7d3d7426 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:09:30.746846 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce7e8e2-442c-4696-92a3-8aaf7d3d7426 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:09:30.757535 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1049/2157] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:09:30 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:09:30.761660 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9154669f-3057-459a-ba7d-a0fb50cc2989 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:09:30.773234 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9154669f-3057-459a-ba7d-a0fb50cc2989 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:09:30.778063 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5a0142-bbc0-4723-8fe7-4542a06133ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:09:30.778901 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5a0142-bbc0-4723-8fe7-4542a06133ef admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:09:30.779252 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5a0142-bbc0-4723-8fe7-4542a06133ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:09:30.779622 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5a0142-bbc0-4723-8fe7-4542a06133ef admin admin] PATH_INFO: `/v3/projects/3039204b20764a62875587eee0e27e05/users/54fbbe82fbec4f4dbc0587383326706a/roles/7f6e29e390bc41f7a9af17659a2e95d1` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:09:30.781632 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5a0142-bbc0-4723-8fe7-4542a06133ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=3039204b20764a62875587eee0e27e05, user_id=54fbbe82fbec4f4dbc0587383326706a, role_id=7f6e29e390bc41f7a9af17659a2e95d1)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:09:30.784379 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5a0142-bbc0-4723-8fe7-4542a06133ef admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:09:30.795853 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1109/2158] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Oct 14 13:09:30 2022] PUT /identity/v3/projects/3039204b20764a62875587eee0e27e05/users/54fbbe82fbec4f4dbc0587383326706a/roles/7f6e29e390bc41f7a9af17659a2e95d1 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 13:09:30.808772 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e94b883-4206-4f98-bd23-d9a797b09906 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:09:30.809069 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e94b883-4206-4f98-bd23-d9a797b09906 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:09:30.809348 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e94b883-4206-4f98-bd23-d9a797b09906 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:09:30.816569 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:09:30.839893 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-7e94b883-4206-4f98-bd23-d9a797b09906 None None] MFA Rules not processed for user `54fbbe82fbec4f4dbc0587383326706a`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:09:30.841246 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-7e94b883-4206-4f98-bd23-d9a797b09906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:09:30.912686 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1050/2159] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:09:30 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:09:30.924683 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5a0142-bbc0-4723-8fe7-4542a06133ef admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:09:30.926958 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-cf5a0142-bbc0-4723-8fe7-4542a06133ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:09:31.012502 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5a0142-bbc0-4723-8fe7-4542a06133ef admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:09:31.017097 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da61d12-acd2-43e4-b3f6-b3ee10234b43 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c3c564b8c548e4beef1cbfba2ad343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:09:31.017780 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da61d12-acd2-43e4-b3f6-b3ee10234b43 service cinder] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:09:31.018144 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da61d12-acd2-43e4-b3f6-b3ee10234b43 service cinder] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:09:31.018569 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da61d12-acd2-43e4-b3f6-b3ee10234b43 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:09:31.030464 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da61d12-acd2-43e4-b3f6-b3ee10234b43 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:09:31.031954 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da61d12-acd2-43e4-b3f6-b3ee10234b43 service cinder] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:09:31.042445 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1110/2160] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:09:30 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:09:31.127719 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e94b883-4206-4f98-bd23-d9a797b09906 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:09:31.138800 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e94b883-4206-4f98-bd23-d9a797b09906 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:09:31.142634 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4490fec8-effc-4a67-abcb-587343fcae43 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c3c564b8c548e4beef1cbfba2ad343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:09:31.143369 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4490fec8-effc-4a67-abcb-587343fcae43 service cinder] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:09:31.143704 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4490fec8-effc-4a67-abcb-587343fcae43 service cinder] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:09:31.144041 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4490fec8-effc-4a67-abcb-587343fcae43 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:09:31.206392 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4490fec8-effc-4a67-abcb-587343fcae43 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:09:31.207800 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4490fec8-effc-4a67-abcb-587343fcae43 service cinder] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:09:31.218320 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1051/2161] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:09:31 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:09:33.790296 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da61d12-acd2-43e4-b3f6-b3ee10234b43 service cinder] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:09:33.791722 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-6da61d12-acd2-43e4-b3f6-b3ee10234b43 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:09:33.805617 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:09:33.858337 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4490fec8-effc-4a67-abcb-587343fcae43 service cinder] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:09:33.859816 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-4490fec8-effc-4a67-abcb-587343fcae43 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:09:33.873812 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da61d12-acd2-43e4-b3f6-b3ee10234b43 service cinder] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:09:33.878991 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bdecd5-774a-4bb6-9b3e-ad5184a3751f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a5e5c35ed8b4abc877ba8d8c490dacd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:09:33.879607 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bdecd5-774a-4bb6-9b3e-ad5184a3751f service placement] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:09:33.879888 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bdecd5-774a-4bb6-9b3e-ad5184a3751f service placement] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:09:33.880163 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bdecd5-774a-4bb6-9b3e-ad5184a3751f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:09:33.882607 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-d8bdecd5-774a-4bb6-9b3e-ad5184a3751f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:09:33.894490 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bdecd5-774a-4bb6-9b3e-ad5184a3751f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:09:33.896017 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bdecd5-774a-4bb6-9b3e-ad5184a3751f service placement] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:09:33.906691 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1111/2162] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:09:33 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:09:33.931211 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4490fec8-effc-4a67-abcb-587343fcae43 service cinder] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:09:33.935718 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39c99eb-d86f-4e39-9cb6-d803da82143b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:09:33.936436 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39c99eb-d86f-4e39-9cb6-d803da82143b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:09:33.936784 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39c99eb-d86f-4e39-9cb6-d803da82143b admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:09:33.937138 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39c99eb-d86f-4e39-9cb6-d803da82143b admin admin] PATH_INFO: `/v3/users/ba64033251de498eb3cfe4c3a002f6ad` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:09:33.938414 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39c99eb-d86f-4e39-9cb6-d803da82143b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba64033251de498eb3cfe4c3a002f6ad)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:09:33.940393 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39c99eb-d86f-4e39-9cb6-d803da82143b admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:09:33.977518 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:09:34.002589 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-b39c99eb-d86f-4e39-9cb6-d803da82143b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba64033251de498eb3cfe4c3a002f6ad'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:09:34.011868 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-b39c99eb-d86f-4e39-9cb6-d803da82143b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba64033251de498eb3cfe4c3a002f6ad'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:09:34.012994 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-b39c99eb-d86f-4e39-9cb6-d803da82143b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba64033251de498eb3cfe4c3a002f6ad'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:09:34.028111 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-b39c99eb-d86f-4e39-9cb6-d803da82143b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba64033251de498eb3cfe4c3a002f6ad'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:09:34.042474 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-b39c99eb-d86f-4e39-9cb6-d803da82143b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba64033251de498eb3cfe4c3a002f6ad'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:09:34.054321 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1052/2163] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Oct 14 13:09:33 2022] DELETE /identity/v3/users/ba64033251de498eb3cfe4c3a002f6ad => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:09:34.110654 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bdecd5-774a-4bb6-9b3e-ad5184a3751f service placement] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:09:34.121427 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bdecd5-774a-4bb6-9b3e-ad5184a3751f service placement] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:09:34.179762 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6197a32d-3499-4fc4-868a-df664bd526b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:09:34.180390 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6197a32d-3499-4fc4-868a-df664bd526b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:09:34.180669 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6197a32d-3499-4fc4-868a-df664bd526b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:09:34.180941 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6197a32d-3499-4fc4-868a-df664bd526b0 admin admin] PATH_INFO: `/v3/users/44b5fad116a04b4ab9404b41dbece273` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:09:34.182057 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6197a32d-3499-4fc4-868a-df664bd526b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=44b5fad116a04b4ab9404b41dbece273)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:09:34.184001 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6197a32d-3499-4fc4-868a-df664bd526b0 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:09:34.232453 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-6197a32d-3499-4fc4-868a-df664bd526b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44b5fad116a04b4ab9404b41dbece273'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:09:34.232688 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39c99eb-d86f-4e39-9cb6-d803da82143b admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:09:34.234144 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-b39c99eb-d86f-4e39-9cb6-d803da82143b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:09:34.242837 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-6197a32d-3499-4fc4-868a-df664bd526b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44b5fad116a04b4ab9404b41dbece273'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:09:34.243653 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-6197a32d-3499-4fc4-868a-df664bd526b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44b5fad116a04b4ab9404b41dbece273'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:09:34.251478 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39c99eb-d86f-4e39-9cb6-d803da82143b admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:09:34.253844 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-6197a32d-3499-4fc4-868a-df664bd526b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44b5fad116a04b4ab9404b41dbece273'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:09:34.257242 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7a0b25-49e7-4c35-886e-0e0478fb86ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:09:34.257946 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7a0b25-49e7-4c35-886e-0e0478fb86ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:09:34.258256 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7a0b25-49e7-4c35-886e-0e0478fb86ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:09:34.258534 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7a0b25-49e7-4c35-886e-0e0478fb86ba admin admin] PATH_INFO: `/v3/projects/083f54db9f9b476882da0e741ca4e9b9` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:09:34.259678 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7a0b25-49e7-4c35-886e-0e0478fb86ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=083f54db9f9b476882da0e741ca4e9b9)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:09:34.261604 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7a0b25-49e7-4c35-886e-0e0478fb86ba admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:09:34.269170 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-6197a32d-3499-4fc4-868a-df664bd526b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44b5fad116a04b4ab9404b41dbece273'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:09:34.276150 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1112/2164] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Oct 14 13:09:34 2022] DELETE /identity/v3/users/44b5fad116a04b4ab9404b41dbece273 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:09:34.280391 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d4bf15-3a42-453e-87d6-fc15dc990449 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:09:34.280674 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d4bf15-3a42-453e-87d6-fc15dc990449 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:09:34.280951 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d4bf15-3a42-453e-87d6-fc15dc990449 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:09:34.302193 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-37d4bf15-3a42-453e-87d6-fc15dc990449 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:09:34.303430 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-37d4bf15-3a42-453e-87d6-fc15dc990449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:09:34.314280 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-1d7a0b25-49e7-4c35-886e-0e0478fb86ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '083f54db9f9b476882da0e741ca4e9b9', 'request_id': 'req-1d7a0b25-49e7-4c35-886e-0e0478fb86ba'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:09:34.315792 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:09:34.321522 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-1d7a0b25-49e7-4c35-886e-0e0478fb86ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '083f54db9f9b476882da0e741ca4e9b9', 'request_id': 'req-1d7a0b25-49e7-4c35-886e-0e0478fb86ba'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:09:34.328600 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-1d7a0b25-49e7-4c35-886e-0e0478fb86ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '083f54db9f9b476882da0e741ca4e9b9', 'request_id': 'req-1d7a0b25-49e7-4c35-886e-0e0478fb86ba'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:09:34.341890 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-1d7a0b25-49e7-4c35-886e-0e0478fb86ba admin admin] The token cache is being invalidate because project 083f54db9f9b476882da0e741ca4e9b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:09:34.342224 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-1d7a0b25-49e7-4c35-886e-0e0478fb86ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:09:34.342866 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-1d7a0b25-49e7-4c35-886e-0e0478fb86ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:09:34.347405 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1053/2165] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Oct 14 13:09:34 2022] DELETE /identity/v3/projects/083f54db9f9b476882da0e741ca4e9b9 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:09:34.349416 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7a0b25-49e7-4c35-886e-0e0478fb86ba admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:09:34.351285 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-1d7a0b25-49e7-4c35-886e-0e0478fb86ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:09:34.379601 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1113/2166] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:09:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 13:09:34.389910 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d4bf15-3a42-453e-87d6-fc15dc990449 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:09:34.391289 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-37d4bf15-3a42-453e-87d6-fc15dc990449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:09:34.419339 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7a0b25-49e7-4c35-886e-0e0478fb86ba admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:09:34.423996 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010923d6-d4d0-407c-bbe8-498defb00d9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:09:34.425010 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010923d6-d4d0-407c-bbe8-498defb00d9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:09:34.425285 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010923d6-d4d0-407c-bbe8-498defb00d9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:09:34.425554 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010923d6-d4d0-407c-bbe8-498defb00d9a admin admin] PATH_INFO: `/v3/users/54abcba47b3b4d65822086b2071eae68` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:09:34.426740 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010923d6-d4d0-407c-bbe8-498defb00d9a admin admin] RBAC: Authorizing `identity:delete_user(user_id=54abcba47b3b4d65822086b2071eae68)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:09:34.429253 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010923d6-d4d0-407c-bbe8-498defb00d9a admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:09:34.461791 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d4bf15-3a42-453e-87d6-fc15dc990449 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:09:34.464383 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:09:34.465920 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c9d51f-29ab-4b0e-9317-e8c6c6ec7850 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d483292f3a4794848fcacfba5b107e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:09:34.466896 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c9d51f-29ab-4b0e-9317-e8c6c6ec7850 service neutron] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:09:34.467225 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c9d51f-29ab-4b0e-9317-e8c6c6ec7850 service neutron] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:09:34.467494 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c9d51f-29ab-4b0e-9317-e8c6c6ec7850 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:09:34.478061 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c9d51f-29ab-4b0e-9317-e8c6c6ec7850 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:09:34.479529 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c9d51f-29ab-4b0e-9317-e8c6c6ec7850 service neutron] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:09:34.480817 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-010923d6-d4d0-407c-bbe8-498defb00d9a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54abcba47b3b4d65822086b2071eae68'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:09:34.487787 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-010923d6-d4d0-407c-bbe8-498defb00d9a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54abcba47b3b4d65822086b2071eae68'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:09:34.488483 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-010923d6-d4d0-407c-bbe8-498defb00d9a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54abcba47b3b4d65822086b2071eae68'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:09:34.489158 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1114/2167] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:09:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 14 13:09:34.496103 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-010923d6-d4d0-407c-bbe8-498defb00d9a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54abcba47b3b4d65822086b2071eae68'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:09:34.510081 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-010923d6-d4d0-407c-bbe8-498defb00d9a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54abcba47b3b4d65822086b2071eae68'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:09:34.516087 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1054/2168] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Oct 14 13:09:34 2022] DELETE /identity/v3/users/54abcba47b3b4d65822086b2071eae68 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:09:34.700987 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c9d51f-29ab-4b0e-9317-e8c6c6ec7850 service neutron] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:09:34.715359 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c9d51f-29ab-4b0e-9317-e8c6c6ec7850 service neutron] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:09:34.781401 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010923d6-d4d0-407c-bbe8-498defb00d9a admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:09:34.782915 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-010923d6-d4d0-407c-bbe8-498defb00d9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:09:34.784419 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48b1953-486e-43f4-8602-b5c12871cf5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:09:34.785046 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48b1953-486e-43f4-8602-b5c12871cf5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:09:34.785348 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48b1953-486e-43f4-8602-b5c12871cf5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:09:34.785585 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48b1953-486e-43f4-8602-b5c12871cf5c admin admin] PATH_INFO: `/v3/projects/77df8bbec29e40d282012a38798ba0a9` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:09:34.786730 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48b1953-486e-43f4-8602-b5c12871cf5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=77df8bbec29e40d282012a38798ba0a9)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:09:34.789367 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48b1953-486e-43f4-8602-b5c12871cf5c admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:09:34.804795 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010923d6-d4d0-407c-bbe8-498defb00d9a admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:09:34.811166 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9ccf4f-3d10-4df4-8a79-4dcbd665ad83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:09:34.811893 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9ccf4f-3d10-4df4-8a79-4dcbd665ad83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:09:34.812191 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9ccf4f-3d10-4df4-8a79-4dcbd665ad83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:09:34.812558 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9ccf4f-3d10-4df4-8a79-4dcbd665ad83 admin admin] PATH_INFO: `/v3/projects/2984f2d0b63141a9b11e834f644bd18c` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:09:34.813774 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9ccf4f-3d10-4df4-8a79-4dcbd665ad83 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2984f2d0b63141a9b11e834f644bd18c)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:09:34.815846 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9ccf4f-3d10-4df4-8a79-4dcbd665ad83 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:09:34.839586 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-b48b1953-486e-43f4-8602-b5c12871cf5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77df8bbec29e40d282012a38798ba0a9', 'request_id': 'req-b48b1953-486e-43f4-8602-b5c12871cf5c'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:09:34.843752 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:09:34.846371 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-b48b1953-486e-43f4-8602-b5c12871cf5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77df8bbec29e40d282012a38798ba0a9', 'request_id': 'req-b48b1953-486e-43f4-8602-b5c12871cf5c'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:09:34.854313 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-b48b1953-486e-43f4-8602-b5c12871cf5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77df8bbec29e40d282012a38798ba0a9', 'request_id': 'req-b48b1953-486e-43f4-8602-b5c12871cf5c'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:09:34.867128 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-bf9ccf4f-3d10-4df4-8a79-4dcbd665ad83 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2984f2d0b63141a9b11e834f644bd18c', 'request_id': 'req-bf9ccf4f-3d10-4df4-8a79-4dcbd665ad83'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:09:34.867644 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-b48b1953-486e-43f4-8602-b5c12871cf5c admin admin] The token cache is being invalidate because project 77df8bbec29e40d282012a38798ba0a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:09:34.867644 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-b48b1953-486e-43f4-8602-b5c12871cf5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:09:34.868133 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-b48b1953-486e-43f4-8602-b5c12871cf5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:09:34.869613 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1115/2169] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Oct 14 13:09:34 2022] DELETE /identity/v3/projects/77df8bbec29e40d282012a38798ba0a9 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:09:34.878114 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-bf9ccf4f-3d10-4df4-8a79-4dcbd665ad83 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2984f2d0b63141a9b11e834f644bd18c', 'request_id': 'req-bf9ccf4f-3d10-4df4-8a79-4dcbd665ad83'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:09:34.885763 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-bf9ccf4f-3d10-4df4-8a79-4dcbd665ad83 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2984f2d0b63141a9b11e834f644bd18c', 'request_id': 'req-bf9ccf4f-3d10-4df4-8a79-4dcbd665ad83'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:09:34.901254 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-bf9ccf4f-3d10-4df4-8a79-4dcbd665ad83 admin admin] The token cache is being invalidate because project 2984f2d0b63141a9b11e834f644bd18c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:09:34.901550 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-bf9ccf4f-3d10-4df4-8a79-4dcbd665ad83 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:09:34.902292 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-bf9ccf4f-3d10-4df4-8a79-4dcbd665ad83 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:09:34.903823 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1055/2170] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Oct 14 13:09:34 2022] DELETE /identity/v3/projects/2984f2d0b63141a9b11e834f644bd18c => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 13:09:34.908114 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48b1953-486e-43f4-8602-b5c12871cf5c admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:09:34.909541 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-b48b1953-486e-43f4-8602-b5c12871cf5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:09:34.982105 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48b1953-486e-43f4-8602-b5c12871cf5c admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:09:35.043144 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677dd9c5-440a-4ff7-ad59-4bd83d914057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:09:35.043798 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677dd9c5-440a-4ff7-ad59-4bd83d914057 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:09:35.044079 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677dd9c5-440a-4ff7-ad59-4bd83d914057 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:09:35.044354 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677dd9c5-440a-4ff7-ad59-4bd83d914057 admin admin] PATH_INFO: `/v3/users/54fbbe82fbec4f4dbc0587383326706a` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:09:35.045535 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677dd9c5-440a-4ff7-ad59-4bd83d914057 admin admin] RBAC: Authorizing `identity:delete_user(user_id=54fbbe82fbec4f4dbc0587383326706a)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:09:35.047544 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677dd9c5-440a-4ff7-ad59-4bd83d914057 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:09:35.105655 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-677dd9c5-440a-4ff7-ad59-4bd83d914057 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54fbbe82fbec4f4dbc0587383326706a'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:09:35.113092 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-677dd9c5-440a-4ff7-ad59-4bd83d914057 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54fbbe82fbec4f4dbc0587383326706a'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:09:35.113854 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-677dd9c5-440a-4ff7-ad59-4bd83d914057 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54fbbe82fbec4f4dbc0587383326706a'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:09:35.123528 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-677dd9c5-440a-4ff7-ad59-4bd83d914057 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54fbbe82fbec4f4dbc0587383326706a'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:09:35.136036 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-677dd9c5-440a-4ff7-ad59-4bd83d914057 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54fbbe82fbec4f4dbc0587383326706a'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:09:35.142028 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1116/2171] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Oct 14 13:09:34 2022] DELETE /identity/v3/users/54fbbe82fbec4f4dbc0587383326706a => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 13:09:35.408689 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9ccf4f-3d10-4df4-8a79-4dcbd665ad83 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:09:35.410296 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-bf9ccf4f-3d10-4df4-8a79-4dcbd665ad83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:09:35.424261 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9ccf4f-3d10-4df4-8a79-4dcbd665ad83 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:09:35.482504 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7891ea8a-eba3-4e32-8666-4036142663df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:09:35.483134 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7891ea8a-eba3-4e32-8666-4036142663df admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:09:35.483412 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7891ea8a-eba3-4e32-8666-4036142663df admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:09:35.483686 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7891ea8a-eba3-4e32-8666-4036142663df admin admin] PATH_INFO: `/v3/projects/3039204b20764a62875587eee0e27e05` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:09:35.484798 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7891ea8a-eba3-4e32-8666-4036142663df admin admin] RBAC: Authorizing `identity:delete_project(project_id=3039204b20764a62875587eee0e27e05)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:09:35.486814 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7891ea8a-eba3-4e32-8666-4036142663df admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:09:35.520165 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:09:35.539374 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-7891ea8a-eba3-4e32-8666-4036142663df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3039204b20764a62875587eee0e27e05', 'request_id': 'req-7891ea8a-eba3-4e32-8666-4036142663df'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:09:35.548205 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-7891ea8a-eba3-4e32-8666-4036142663df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3039204b20764a62875587eee0e27e05', 'request_id': 'req-7891ea8a-eba3-4e32-8666-4036142663df'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:09:35.554920 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-7891ea8a-eba3-4e32-8666-4036142663df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3039204b20764a62875587eee0e27e05', 'request_id': 'req-7891ea8a-eba3-4e32-8666-4036142663df'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:09:35.567243 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-7891ea8a-eba3-4e32-8666-4036142663df admin admin] The token cache is being invalidate because project 3039204b20764a62875587eee0e27e05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:09:35.567537 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-7891ea8a-eba3-4e32-8666-4036142663df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:09:35.568158 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-7891ea8a-eba3-4e32-8666-4036142663df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:09:35.569694 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1056/2172] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Oct 14 13:09:35 2022] DELETE /identity/v3/projects/3039204b20764a62875587eee0e27e05 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:09:35.574784 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f7ab89-e765-4401-8915-27fa0b396082 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:09:35.575068 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f7ab89-e765-4401-8915-27fa0b396082 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:09:35.575338 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f7ab89-e765-4401-8915-27fa0b396082 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:09:35.595700 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-91f7ab89-e765-4401-8915-27fa0b396082 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:09:35.596846 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-91f7ab89-e765-4401-8915-27fa0b396082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:09:35.601887 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:09:35.657698 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1117/2173] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:09:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:09:35.666554 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c8422b-1cb3-4a63-95f5-308edcb2941d None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:09:35.666846 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c8422b-1cb3-4a63-95f5-308edcb2941d None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:09:35.667124 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c8422b-1cb3-4a63-95f5-308edcb2941d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:09:35.687153 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-a2c8422b-1cb3-4a63-95f5-308edcb2941d None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:09:35.688366 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-a2c8422b-1cb3-4a63-95f5-308edcb2941d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:09:35.697074 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1057/2174] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:09:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:09:35.701443 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f7ab89-e765-4401-8915-27fa0b396082 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:09:35.711856 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f7ab89-e765-4401-8915-27fa0b396082 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:09:35.716499 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b187123-7210-477d-a2c1-7ccf074e5eba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:09:35.717440 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b187123-7210-477d-a2c1-7ccf074e5eba admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:09:35.717695 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b187123-7210-477d-a2c1-7ccf074e5eba admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:09:35.717992 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b187123-7210-477d-a2c1-7ccf074e5eba admin admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:09:35.718786 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b187123-7210-477d-a2c1-7ccf074e5eba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 13:09:35.719096 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b187123-7210-477d-a2c1-7ccf074e5eba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:09:35.720888 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b187123-7210-477d-a2c1-7ccf074e5eba admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:09:35.732549 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1118/2175] 10.222.0.17 () {58 vars in 1153 bytes} [Fri Oct 14 13:09:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 13:09:35.736715 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c8422b-1cb3-4a63-95f5-308edcb2941d None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:09:35.746089 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c8422b-1cb3-4a63-95f5-308edcb2941d None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:09:35.751021 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dea787f-f1f3-4961-b6cb-8799f42827e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:09:35.751630 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dea787f-f1f3-4961-b6cb-8799f42827e9 admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:09:35.751914 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dea787f-f1f3-4961-b6cb-8799f42827e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:09:35.752192 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dea787f-f1f3-4961-b6cb-8799f42827e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:09:35.752823 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dea787f-f1f3-4961-b6cb-8799f42827e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:09:35.754771 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dea787f-f1f3-4961-b6cb-8799f42827e9 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:09:35.785453 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1058/2176] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Oct 14 13:09:35 2022] POST /identity/v3/projects => generated 379 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:09:35.786923 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b187123-7210-477d-a2c1-7ccf074e5eba admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:09:35.797254 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b187123-7210-477d-a2c1-7ccf074e5eba admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:09:35.854366 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c416370-6194-4ef2-b706-133a0f8169c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:09:35.855041 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c416370-6194-4ef2-b706-133a0f8169c3 admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:09:35.855240 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c416370-6194-4ef2-b706-133a0f8169c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:09:35.855509 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c416370-6194-4ef2-b706-133a0f8169c3 admin admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:09:35.856127 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c416370-6194-4ef2-b706-133a0f8169c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:09:35.858038 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c416370-6194-4ef2-b706-133a0f8169c3 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:09:35.879544 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1119/2177] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Oct 14 13:09:35 2022] POST /identity/v3/users => generated 290 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:09:35.884570 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dea787f-f1f3-4961-b6cb-8799f42827e9 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:09:35.895285 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dea787f-f1f3-4961-b6cb-8799f42827e9 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:09:35.900842 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f73e7c-03f1-463b-8ca9-c203583f0cd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:09:35.901496 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f73e7c-03f1-463b-8ca9-c203583f0cd9 admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:09:35.901777 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f73e7c-03f1-463b-8ca9-c203583f0cd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:09:35.902049 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f73e7c-03f1-463b-8ca9-c203583f0cd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:09:35.902768 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f73e7c-03f1-463b-8ca9-c203583f0cd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:09:35.904428 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f73e7c-03f1-463b-8ca9-c203583f0cd9 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:09:35.915022 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1059/2178] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:09:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:09:35.918774 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c416370-6194-4ef2-b706-133a0f8169c3 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:09:35.928825 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c416370-6194-4ef2-b706-133a0f8169c3 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:09:35.933435 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7362ae4b-4a1d-42e1-b374-5348c324aaec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:09:35.934028 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7362ae4b-4a1d-42e1-b374-5348c324aaec admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:09:35.934341 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7362ae4b-4a1d-42e1-b374-5348c324aaec admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:09:35.934621 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7362ae4b-4a1d-42e1-b374-5348c324aaec admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:09:35.935277 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7362ae4b-4a1d-42e1-b374-5348c324aaec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:09:35.936912 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7362ae4b-4a1d-42e1-b374-5348c324aaec admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:09:35.947389 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1120/2179] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:09:35 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 14 13:09:35.951597 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f73e7c-03f1-463b-8ca9-c203583f0cd9 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:09:35.962503 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f73e7c-03f1-463b-8ca9-c203583f0cd9 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:09:35.967454 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386db82d-fc19-4a95-823b-75655570511a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:09:35.968161 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386db82d-fc19-4a95-823b-75655570511a admin admin] REQUEST_METHOD: `PUT` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:09:35.968571 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386db82d-fc19-4a95-823b-75655570511a admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:09:35.968934 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386db82d-fc19-4a95-823b-75655570511a admin admin] PATH_INFO: `/v3/projects/425982c5faaf4955858bc606d8685868/users/acfa5616e55f427a8b4f8177aa94d423/roles/5e8849303a75425b9eaa2681cc031af1` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:09:35.983697 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386db82d-fc19-4a95-823b-75655570511a admin admin] RBAC: Authorizing `identity:create_grant(project_id=425982c5faaf4955858bc606d8685868, user_id=acfa5616e55f427a8b4f8177aa94d423, role_id=5e8849303a75425b9eaa2681cc031af1)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:09:35.986428 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386db82d-fc19-4a95-823b-75655570511a admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:09:35.999232 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1060/2180] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Oct 14 13:09:35 2022] PUT /identity/v3/projects/425982c5faaf4955858bc606d8685868/users/acfa5616e55f427a8b4f8177aa94d423/roles/5e8849303a75425b9eaa2681cc031af1 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:09:36.010018 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29225910-e44b-4ed0-bf73-fda27da30902 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:09:36.010336 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29225910-e44b-4ed0-bf73-fda27da30902 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:09:36.010614 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29225910-e44b-4ed0-bf73-fda27da30902 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:09:36.037929 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-29225910-e44b-4ed0-bf73-fda27da30902 None None] MFA Rules not processed for user `acfa5616e55f427a8b4f8177aa94d423`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:09:36.039165 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-29225910-e44b-4ed0-bf73-fda27da30902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:09:36.104423 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1121/2181] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:09:36 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:09:36.108882 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386db82d-fc19-4a95-823b-75655570511a admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:09:36.170753 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386db82d-fc19-4a95-823b-75655570511a admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:09:36.175430 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5140ae-69ec-4491-9975-6d6baff6daea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:09:36.176020 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5140ae-69ec-4491-9975-6d6baff6daea admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:09:36.176297 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5140ae-69ec-4491-9975-6d6baff6daea admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:09:36.176566 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5140ae-69ec-4491-9975-6d6baff6daea admin admin] PATH_INFO: `/v3/projects` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:09:36.177196 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5140ae-69ec-4491-9975-6d6baff6daea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:09:36.179670 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5140ae-69ec-4491-9975-6d6baff6daea admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:09:36.205578 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1061/2182] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Oct 14 13:09:36 2022] POST /identity/v3/projects => generated 379 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:09:36.209821 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29225910-e44b-4ed0-bf73-fda27da30902 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:09:36.216270 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:09:36.220901 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29225910-e44b-4ed0-bf73-fda27da30902 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:09:36.277322 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05d6b96-6a7f-4518-bf51-e080517378a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:09:36.277843 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05d6b96-6a7f-4518-bf51-e080517378a4 admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:09:36.278136 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05d6b96-6a7f-4518-bf51-e080517378a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:09:36.278415 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05d6b96-6a7f-4518-bf51-e080517378a4 admin admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:09:36.279046 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05d6b96-6a7f-4518-bf51-e080517378a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:09:36.280960 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05d6b96-6a7f-4518-bf51-e080517378a4 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:09:36.302580 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1122/2183] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Oct 14 13:09:36 2022] POST /identity/v3/users => generated 290 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 13:09:36.307373 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5140ae-69ec-4491-9975-6d6baff6daea admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:09:36.318075 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5140ae-69ec-4491-9975-6d6baff6daea admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:09:36.323900 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d0165c-a92e-46ea-a54d-7c7dbb4a8093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:09:36.324498 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d0165c-a92e-46ea-a54d-7c7dbb4a8093 admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:09:36.324784 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d0165c-a92e-46ea-a54d-7c7dbb4a8093 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:09:36.325063 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d0165c-a92e-46ea-a54d-7c7dbb4a8093 admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:09:36.325707 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d0165c-a92e-46ea-a54d-7c7dbb4a8093 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:09:36.327348 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d0165c-a92e-46ea-a54d-7c7dbb4a8093 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:09:36.338108 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1062/2184] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:09:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:09:36.342344 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05d6b96-6a7f-4518-bf51-e080517378a4 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:09:36.352454 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05d6b96-6a7f-4518-bf51-e080517378a4 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:09:36.357544 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38cb70a-0665-419f-99b6-66a9485837d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:09:36.358198 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38cb70a-0665-419f-99b6-66a9485837d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:09:36.358484 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38cb70a-0665-419f-99b6-66a9485837d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:09:36.358759 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38cb70a-0665-419f-99b6-66a9485837d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:09:36.359399 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38cb70a-0665-419f-99b6-66a9485837d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:09:36.361050 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38cb70a-0665-419f-99b6-66a9485837d1 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:09:36.371491 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1123/2185] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:09:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:09:36.375613 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d0165c-a92e-46ea-a54d-7c7dbb4a8093 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:09:36.386494 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d0165c-a92e-46ea-a54d-7c7dbb4a8093 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:09:36.391192 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c747a520-52fe-4c26-93f2-ed6bf45172b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:09:36.391859 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c747a520-52fe-4c26-93f2-ed6bf45172b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:09:36.392166 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c747a520-52fe-4c26-93f2-ed6bf45172b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:09:36.392468 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c747a520-52fe-4c26-93f2-ed6bf45172b5 admin admin] PATH_INFO: `/v3/projects/c726da50797e40c2997812de0efa1393/users/204830b5d1164021910aa7b3737e2b0b/roles/5e8849303a75425b9eaa2681cc031af1` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:09:36.406998 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c747a520-52fe-4c26-93f2-ed6bf45172b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c726da50797e40c2997812de0efa1393, user_id=204830b5d1164021910aa7b3737e2b0b, role_id=5e8849303a75425b9eaa2681cc031af1)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:09:36.409673 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c747a520-52fe-4c26-93f2-ed6bf45172b5 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:09:36.423644 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1063/2186] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Oct 14 13:09:36 2022] PUT /identity/v3/projects/c726da50797e40c2997812de0efa1393/users/204830b5d1164021910aa7b3737e2b0b/roles/5e8849303a75425b9eaa2681cc031af1 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:09:36.436006 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded4f274-2307-4ea1-91e8-6360e04aa388 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:09:36.436298 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded4f274-2307-4ea1-91e8-6360e04aa388 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:09:36.436574 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded4f274-2307-4ea1-91e8-6360e04aa388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:09:36.465628 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-ded4f274-2307-4ea1-91e8-6360e04aa388 None None] MFA Rules not processed for user `204830b5d1164021910aa7b3737e2b0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:09:36.467119 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-ded4f274-2307-4ea1-91e8-6360e04aa388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:09:36.529260 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1124/2187] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:09:36 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:09:36.533627 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c747a520-52fe-4c26-93f2-ed6bf45172b5 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:09:36.543046 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:09:36.595774 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c747a520-52fe-4c26-93f2-ed6bf45172b5 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:09:36.600952 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5067e12c-9d5c-41ae-8a0d-e8a124c77600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:09:36.601562 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5067e12c-9d5c-41ae-8a0d-e8a124c77600 admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:09:36.601821 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5067e12c-9d5c-41ae-8a0d-e8a124c77600 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:09:36.602093 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5067e12c-9d5c-41ae-8a0d-e8a124c77600 admin admin] PATH_INFO: `/v3/projects` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:09:36.602746 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5067e12c-9d5c-41ae-8a0d-e8a124c77600 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:09:36.604637 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5067e12c-9d5c-41ae-8a0d-e8a124c77600 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:09:36.636011 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1064/2188] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Oct 14 13:09:36 2022] POST /identity/v3/projects => generated 379 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:09:36.639126 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded4f274-2307-4ea1-91e8-6360e04aa388 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:09:36.650659 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded4f274-2307-4ea1-91e8-6360e04aa388 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:09:36.707945 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad48caa6-b3b7-451b-bc08-c9aef296a168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:09:36.708548 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad48caa6-b3b7-451b-bc08-c9aef296a168 admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:09:36.708826 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad48caa6-b3b7-451b-bc08-c9aef296a168 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:09:36.709094 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad48caa6-b3b7-451b-bc08-c9aef296a168 admin admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:09:36.710420 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad48caa6-b3b7-451b-bc08-c9aef296a168 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:09:36.712339 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad48caa6-b3b7-451b-bc08-c9aef296a168 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:09:36.733207 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1125/2189] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Oct 14 13:09:36 2022] POST /identity/v3/users => generated 296 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:09:36.737240 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5067e12c-9d5c-41ae-8a0d-e8a124c77600 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:09:36.747555 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5067e12c-9d5c-41ae-8a0d-e8a124c77600 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:09:36.752266 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ea234c-9723-4fdc-8e85-efa914a499dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:09:36.752866 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ea234c-9723-4fdc-8e85-efa914a499dd admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:09:36.753142 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ea234c-9723-4fdc-8e85-efa914a499dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:09:36.753413 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ea234c-9723-4fdc-8e85-efa914a499dd admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:09:36.754049 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ea234c-9723-4fdc-8e85-efa914a499dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:09:36.755670 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ea234c-9723-4fdc-8e85-efa914a499dd admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:09:36.766547 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1065/2190] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:09:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:09:36.770639 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad48caa6-b3b7-451b-bc08-c9aef296a168 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:09:36.776828 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:09:36.783082 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad48caa6-b3b7-451b-bc08-c9aef296a168 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:09:36.788135 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a9e3f1-5eb6-4bcd-934e-7d6c973be4eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:09:36.788776 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a9e3f1-5eb6-4bcd-934e-7d6c973be4eb admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:09:36.789067 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a9e3f1-5eb6-4bcd-934e-7d6c973be4eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:09:36.789327 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a9e3f1-5eb6-4bcd-934e-7d6c973be4eb admin admin] PATH_INFO: `/v3/projects/787e832c9c6649ca9f27161f8681da7c/users/cce595c1cbb8475aa88c66fba2cff62e/roles/7f6e29e390bc41f7a9af17659a2e95d1` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:09:36.803980 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a9e3f1-5eb6-4bcd-934e-7d6c973be4eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=787e832c9c6649ca9f27161f8681da7c, user_id=cce595c1cbb8475aa88c66fba2cff62e, role_id=7f6e29e390bc41f7a9af17659a2e95d1)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:09:36.806706 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a9e3f1-5eb6-4bcd-934e-7d6c973be4eb admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:09:36.819986 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1126/2191] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Oct 14 13:09:36 2022] PUT /identity/v3/projects/787e832c9c6649ca9f27161f8681da7c/users/cce595c1cbb8475aa88c66fba2cff62e/roles/7f6e29e390bc41f7a9af17659a2e95d1 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 13:09:36.824093 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ea234c-9723-4fdc-8e85-efa914a499dd admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:09:36.834004 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ea234c-9723-4fdc-8e85-efa914a499dd admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:09:36.889538 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f63dad-3765-4269-92e4-c964f610cf68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:09:36.890277 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f63dad-3765-4269-92e4-c964f610cf68 admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:09:36.890563 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f63dad-3765-4269-92e4-c964f610cf68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:09:36.890837 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f63dad-3765-4269-92e4-c964f610cf68 admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:09:36.891470 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f63dad-3765-4269-92e4-c964f610cf68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:09:36.893063 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f63dad-3765-4269-92e4-c964f610cf68 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:09:36.902513 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1066/2192] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:09:36 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:09:36.906683 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a9e3f1-5eb6-4bcd-934e-7d6c973be4eb admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:09:36.917151 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a9e3f1-5eb6-4bcd-934e-7d6c973be4eb admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:09:36.921793 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159c872b-0f0d-4cb5-856f-79db3474cb1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:09:36.922502 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159c872b-0f0d-4cb5-856f-79db3474cb1d admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:09:36.922783 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159c872b-0f0d-4cb5-856f-79db3474cb1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:09:36.923057 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159c872b-0f0d-4cb5-856f-79db3474cb1d admin admin] PATH_INFO: `/v3/projects/787e832c9c6649ca9f27161f8681da7c/users/cce595c1cbb8475aa88c66fba2cff62e/roles/7f6e29e390bc41f7a9af17659a2e95d1` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:09:36.924963 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159c872b-0f0d-4cb5-856f-79db3474cb1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=787e832c9c6649ca9f27161f8681da7c, user_id=cce595c1cbb8475aa88c66fba2cff62e, role_id=7f6e29e390bc41f7a9af17659a2e95d1)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:09:36.927646 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159c872b-0f0d-4cb5-856f-79db3474cb1d admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:09:36.938126 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1127/2193] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Oct 14 13:09:36 2022] PUT /identity/v3/projects/787e832c9c6649ca9f27161f8681da7c/users/cce595c1cbb8475aa88c66fba2cff62e/roles/7f6e29e390bc41f7a9af17659a2e95d1 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:09:36.948854 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89baeb24-a29b-4c94-8f14-e6e1904b0573 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:09:36.949141 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89baeb24-a29b-4c94-8f14-e6e1904b0573 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:09:36.949415 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89baeb24-a29b-4c94-8f14-e6e1904b0573 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:09:36.976631 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-89baeb24-a29b-4c94-8f14-e6e1904b0573 None None] MFA Rules not processed for user `cce595c1cbb8475aa88c66fba2cff62e`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:09:36.977828 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-89baeb24-a29b-4c94-8f14-e6e1904b0573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:09:37.044189 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1067/2194] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:09:36 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:09:37.055793 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159c872b-0f0d-4cb5-856f-79db3474cb1d admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:09:37.057452 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-159c872b-0f0d-4cb5-856f-79db3474cb1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:09:37.115485 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159c872b-0f0d-4cb5-856f-79db3474cb1d admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:09:37.120412 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da026af8-30e7-44ea-a33f-d593adfbcb1a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c3c564b8c548e4beef1cbfba2ad343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:09:37.121019 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da026af8-30e7-44ea-a33f-d593adfbcb1a service cinder] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:09:37.121306 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da026af8-30e7-44ea-a33f-d593adfbcb1a service cinder] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:09:37.121580 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da026af8-30e7-44ea-a33f-d593adfbcb1a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:09:37.130749 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da026af8-30e7-44ea-a33f-d593adfbcb1a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:09:37.132944 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da026af8-30e7-44ea-a33f-d593adfbcb1a service cinder] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:09:37.142660 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1128/2195] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:09:37 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:09:37.184562 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89baeb24-a29b-4c94-8f14-e6e1904b0573 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:09:37.185962 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-89baeb24-a29b-4c94-8f14-e6e1904b0573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:09:37.192801 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:09:37.199986 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89baeb24-a29b-4c94-8f14-e6e1904b0573 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:09:37.204011 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886f0fdb-c1ef-42ed-bae0-36687c0a68a3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c3c564b8c548e4beef1cbfba2ad343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:09:37.204605 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886f0fdb-c1ef-42ed-bae0-36687c0a68a3 service cinder] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:09:37.204882 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886f0fdb-c1ef-42ed-bae0-36687c0a68a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:09:37.205152 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886f0fdb-c1ef-42ed-bae0-36687c0a68a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:09:37.261701 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886f0fdb-c1ef-42ed-bae0-36687c0a68a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:09:37.263243 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886f0fdb-c1ef-42ed-bae0-36687c0a68a3 service cinder] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:09:37.272202 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1068/2196] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:09:37 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:09:40.157852 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da026af8-30e7-44ea-a33f-d593adfbcb1a service cinder] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:09:40.219038 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da026af8-30e7-44ea-a33f-d593adfbcb1a service cinder] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:09:40.223538 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd32937-a9e0-49fa-9f3d-198257e1da8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:09:40.224156 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd32937-a9e0-49fa-9f3d-198257e1da8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:09:40.224436 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd32937-a9e0-49fa-9f3d-198257e1da8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:09:40.224710 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd32937-a9e0-49fa-9f3d-198257e1da8c admin admin] PATH_INFO: `/v3/users/acfa5616e55f427a8b4f8177aa94d423` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:09:40.225868 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd32937-a9e0-49fa-9f3d-198257e1da8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=acfa5616e55f427a8b4f8177aa94d423)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:09:40.227829 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd32937-a9e0-49fa-9f3d-198257e1da8c admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:09:40.273755 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-dfd32937-a9e0-49fa-9f3d-198257e1da8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'acfa5616e55f427a8b4f8177aa94d423'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:09:40.280531 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-dfd32937-a9e0-49fa-9f3d-198257e1da8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'acfa5616e55f427a8b4f8177aa94d423'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:09:40.281198 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-dfd32937-a9e0-49fa-9f3d-198257e1da8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'acfa5616e55f427a8b4f8177aa94d423'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:09:40.288110 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-dfd32937-a9e0-49fa-9f3d-198257e1da8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'acfa5616e55f427a8b4f8177aa94d423'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:09:40.293334 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:09:40.301571 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-dfd32937-a9e0-49fa-9f3d-198257e1da8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'acfa5616e55f427a8b4f8177aa94d423'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:09:40.308121 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1129/2197] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Oct 14 13:09:40 2022] DELETE /identity/v3/users/acfa5616e55f427a8b4f8177aa94d423 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:09:40.312578 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d932f48-6d6b-4531-8815-92ff47b6abbf None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:09:40.313140 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d932f48-6d6b-4531-8815-92ff47b6abbf None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:09:40.313140 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d932f48-6d6b-4531-8815-92ff47b6abbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:09:40.332473 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-7d932f48-6d6b-4531-8815-92ff47b6abbf None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:09:40.333663 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-7d932f48-6d6b-4531-8815-92ff47b6abbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:09:40.391312 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1069/2198] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:09:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:09:40.401655 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd32937-a9e0-49fa-9f3d-198257e1da8c admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:09:40.403071 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-dfd32937-a9e0-49fa-9f3d-198257e1da8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:09:40.462106 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd32937-a9e0-49fa-9f3d-198257e1da8c admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:09:40.465765 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3050fe63-4b3d-4d49-9c3f-c7f684fa3628 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d483292f3a4794848fcacfba5b107e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:09:40.466391 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3050fe63-4b3d-4d49-9c3f-c7f684fa3628 service neutron] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:09:40.467027 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3050fe63-4b3d-4d49-9c3f-c7f684fa3628 service neutron] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:09:40.467297 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3050fe63-4b3d-4d49-9c3f-c7f684fa3628 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:09:40.477018 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3050fe63-4b3d-4d49-9c3f-c7f684fa3628 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:09:40.478516 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3050fe63-4b3d-4d49-9c3f-c7f684fa3628 service neutron] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:09:40.488688 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1130/2199] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:09:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:09:41.051284 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d932f48-6d6b-4531-8815-92ff47b6abbf None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:09:41.053635 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-7d932f48-6d6b-4531-8815-92ff47b6abbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:09:41.081949 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d932f48-6d6b-4531-8815-92ff47b6abbf None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:09:41.092770 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a2f8cd-84a7-42ee-9b33-df8cf0fab043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:09:41.093422 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a2f8cd-84a7-42ee-9b33-df8cf0fab043 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:09:41.094313 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a2f8cd-84a7-42ee-9b33-df8cf0fab043 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:09:41.094927 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a2f8cd-84a7-42ee-9b33-df8cf0fab043 admin admin] PATH_INFO: `/v3/projects/425982c5faaf4955858bc606d8685868` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:09:41.096529 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a2f8cd-84a7-42ee-9b33-df8cf0fab043 admin admin] RBAC: Authorizing `identity:delete_project(project_id=425982c5faaf4955858bc606d8685868)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:09:41.098892 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a2f8cd-84a7-42ee-9b33-df8cf0fab043 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:09:41.149614 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-07a2f8cd-84a7-42ee-9b33-df8cf0fab043 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '425982c5faaf4955858bc606d8685868', 'request_id': 'req-07a2f8cd-84a7-42ee-9b33-df8cf0fab043'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:09:41.156416 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-07a2f8cd-84a7-42ee-9b33-df8cf0fab043 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '425982c5faaf4955858bc606d8685868', 'request_id': 'req-07a2f8cd-84a7-42ee-9b33-df8cf0fab043'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:09:41.163693 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-07a2f8cd-84a7-42ee-9b33-df8cf0fab043 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '425982c5faaf4955858bc606d8685868', 'request_id': 'req-07a2f8cd-84a7-42ee-9b33-df8cf0fab043'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:09:41.175922 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-07a2f8cd-84a7-42ee-9b33-df8cf0fab043 admin admin] The token cache is being invalidate because project 425982c5faaf4955858bc606d8685868 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:09:41.176216 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-07a2f8cd-84a7-42ee-9b33-df8cf0fab043 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:09:41.176862 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-07a2f8cd-84a7-42ee-9b33-df8cf0fab043 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:09:41.179112 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1070/2200] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Oct 14 13:09:41 2022] DELETE /identity/v3/projects/425982c5faaf4955858bc606d8685868 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:09:41.183211 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3050fe63-4b3d-4d49-9c3f-c7f684fa3628 service neutron] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:09:41.193114 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3050fe63-4b3d-4d49-9c3f-c7f684fa3628 service neutron] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:09:41.258101 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f859e37-1989-4f35-9d46-258f3845f1a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:09:41.258790 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f859e37-1989-4f35-9d46-258f3845f1a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:09:41.259070 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f859e37-1989-4f35-9d46-258f3845f1a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:09:41.259344 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f859e37-1989-4f35-9d46-258f3845f1a8 admin admin] PATH_INFO: `/v3/users/204830b5d1164021910aa7b3737e2b0b` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:09:41.260530 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f859e37-1989-4f35-9d46-258f3845f1a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=204830b5d1164021910aa7b3737e2b0b)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:09:41.262569 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f859e37-1989-4f35-9d46-258f3845f1a8 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:09:41.310164 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-8f859e37-1989-4f35-9d46-258f3845f1a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '204830b5d1164021910aa7b3737e2b0b'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:09:41.317137 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-8f859e37-1989-4f35-9d46-258f3845f1a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '204830b5d1164021910aa7b3737e2b0b'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:09:41.317814 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-8f859e37-1989-4f35-9d46-258f3845f1a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '204830b5d1164021910aa7b3737e2b0b'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:09:41.325951 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-8f859e37-1989-4f35-9d46-258f3845f1a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '204830b5d1164021910aa7b3737e2b0b'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:09:41.339098 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-8f859e37-1989-4f35-9d46-258f3845f1a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '204830b5d1164021910aa7b3737e2b0b'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:09:41.345873 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1131/2201] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Oct 14 13:09:41 2022] DELETE /identity/v3/users/204830b5d1164021910aa7b3737e2b0b => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:09:41.649615 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a2f8cd-84a7-42ee-9b33-df8cf0fab043 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:09:41.653155 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-07a2f8cd-84a7-42ee-9b33-df8cf0fab043 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:09:41.675194 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a2f8cd-84a7-42ee-9b33-df8cf0fab043 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:09:41.701828 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:09:41.759857 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128023c8-535b-4427-809f-ed827ec5ec2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:09:41.760786 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128023c8-535b-4427-809f-ed827ec5ec2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:09:41.760786 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128023c8-535b-4427-809f-ed827ec5ec2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:09:41.761050 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128023c8-535b-4427-809f-ed827ec5ec2c admin admin] PATH_INFO: `/v3/projects/c726da50797e40c2997812de0efa1393` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:09:41.763182 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128023c8-535b-4427-809f-ed827ec5ec2c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c726da50797e40c2997812de0efa1393)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:09:41.764285 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128023c8-535b-4427-809f-ed827ec5ec2c admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:09:41.821845 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-128023c8-535b-4427-809f-ed827ec5ec2c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c726da50797e40c2997812de0efa1393', 'request_id': 'req-128023c8-535b-4427-809f-ed827ec5ec2c'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:09:41.827622 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-128023c8-535b-4427-809f-ed827ec5ec2c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c726da50797e40c2997812de0efa1393', 'request_id': 'req-128023c8-535b-4427-809f-ed827ec5ec2c'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:09:41.833965 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-128023c8-535b-4427-809f-ed827ec5ec2c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c726da50797e40c2997812de0efa1393', 'request_id': 'req-128023c8-535b-4427-809f-ed827ec5ec2c'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:09:41.847955 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-128023c8-535b-4427-809f-ed827ec5ec2c admin admin] The token cache is being invalidate because project c726da50797e40c2997812de0efa1393 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:09:41.848244 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-128023c8-535b-4427-809f-ed827ec5ec2c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:09:41.848865 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-128023c8-535b-4427-809f-ed827ec5ec2c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:09:41.850662 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1071/2202] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Oct 14 13:09:41 2022] DELETE /identity/v3/projects/c726da50797e40c2997812de0efa1393 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:09:41.854634 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f859e37-1989-4f35-9d46-258f3845f1a8 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:09:41.856214 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-8f859e37-1989-4f35-9d46-258f3845f1a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:09:41.869061 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f859e37-1989-4f35-9d46-258f3845f1a8 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:09:41.873980 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:09:41.948347 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23186555-efe8-4453-be13-237e9e559793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:09:41.949234 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23186555-efe8-4453-be13-237e9e559793 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:09:41.949510 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23186555-efe8-4453-be13-237e9e559793 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:09:41.949780 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23186555-efe8-4453-be13-237e9e559793 admin admin] PATH_INFO: `/v3/users/cce595c1cbb8475aa88c66fba2cff62e` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:09:41.950987 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23186555-efe8-4453-be13-237e9e559793 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cce595c1cbb8475aa88c66fba2cff62e)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:09:41.953180 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23186555-efe8-4453-be13-237e9e559793 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:09:42.029226 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-23186555-efe8-4453-be13-237e9e559793 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cce595c1cbb8475aa88c66fba2cff62e'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:09:42.040620 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-23186555-efe8-4453-be13-237e9e559793 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cce595c1cbb8475aa88c66fba2cff62e'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:09:42.041379 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-23186555-efe8-4453-be13-237e9e559793 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cce595c1cbb8475aa88c66fba2cff62e'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:09:42.049650 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-23186555-efe8-4453-be13-237e9e559793 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cce595c1cbb8475aa88c66fba2cff62e'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:09:42.063244 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-23186555-efe8-4453-be13-237e9e559793 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cce595c1cbb8475aa88c66fba2cff62e'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:09:42.073602 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1132/2203] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Oct 14 13:09:41 2022] DELETE /identity/v3/users/cce595c1cbb8475aa88c66fba2cff62e => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:09:42.371163 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128023c8-535b-4427-809f-ed827ec5ec2c admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:09:42.372705 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-128023c8-535b-4427-809f-ed827ec5ec2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:09:42.387437 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128023c8-535b-4427-809f-ed827ec5ec2c admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:09:42.448547 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca6efd5-3349-4f33-9a7e-f0fb32f1ade6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:09:42.449186 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca6efd5-3349-4f33-9a7e-f0fb32f1ade6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:09:42.449466 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca6efd5-3349-4f33-9a7e-f0fb32f1ade6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:09:42.449740 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca6efd5-3349-4f33-9a7e-f0fb32f1ade6 admin admin] PATH_INFO: `/v3/projects/787e832c9c6649ca9f27161f8681da7c` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:09:42.450904 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca6efd5-3349-4f33-9a7e-f0fb32f1ade6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=787e832c9c6649ca9f27161f8681da7c)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:09:42.452826 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca6efd5-3349-4f33-9a7e-f0fb32f1ade6 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:09:42.501845 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-dca6efd5-3349-4f33-9a7e-f0fb32f1ade6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '787e832c9c6649ca9f27161f8681da7c', 'request_id': 'req-dca6efd5-3349-4f33-9a7e-f0fb32f1ade6'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:09:42.506371 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:09:42.507741 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-dca6efd5-3349-4f33-9a7e-f0fb32f1ade6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '787e832c9c6649ca9f27161f8681da7c', 'request_id': 'req-dca6efd5-3349-4f33-9a7e-f0fb32f1ade6'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:09:42.515682 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-dca6efd5-3349-4f33-9a7e-f0fb32f1ade6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '787e832c9c6649ca9f27161f8681da7c', 'request_id': 'req-dca6efd5-3349-4f33-9a7e-f0fb32f1ade6'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:09:42.528981 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-dca6efd5-3349-4f33-9a7e-f0fb32f1ade6 admin admin] The token cache is being invalidate because project 787e832c9c6649ca9f27161f8681da7c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:09:42.529297 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-dca6efd5-3349-4f33-9a7e-f0fb32f1ade6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:09:42.529906 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-dca6efd5-3349-4f33-9a7e-f0fb32f1ade6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:09:42.531504 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1072/2204] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Oct 14 13:09:42 2022] DELETE /identity/v3/projects/787e832c9c6649ca9f27161f8681da7c => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:09:42.537981 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d6f008-6931-43f3-b961-331d82f4add6 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:09:42.538642 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d6f008-6931-43f3-b961-331d82f4add6 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:09:42.538738 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d6f008-6931-43f3-b961-331d82f4add6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:09:42.561068 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-31d6f008-6931-43f3-b961-331d82f4add6 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:09:42.562457 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-31d6f008-6931-43f3-b961-331d82f4add6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:09:42.628063 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1133/2205] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:09:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:09:42.637819 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aade20bf-276c-41cf-81e5-8e070f278148 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:09:42.638106 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aade20bf-276c-41cf-81e5-8e070f278148 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:09:42.638425 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aade20bf-276c-41cf-81e5-8e070f278148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:09:42.658208 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-aade20bf-276c-41cf-81e5-8e070f278148 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:09:42.659409 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-aade20bf-276c-41cf-81e5-8e070f278148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:09:42.668501 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1073/2206] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:09:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:09:42.672794 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d6f008-6931-43f3-b961-331d82f4add6 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:09:42.683321 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d6f008-6931-43f3-b961-331d82f4add6 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:09:42.687998 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b9d953-f5d3-4c6a-97c8-f590d1b741c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:09:42.689184 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b9d953-f5d3-4c6a-97c8-f590d1b741c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:09:42.689479 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b9d953-f5d3-4c6a-97c8-f590d1b741c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:09:42.689756 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b9d953-f5d3-4c6a-97c8-f590d1b741c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:09:42.690443 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b9d953-f5d3-4c6a-97c8-f590d1b741c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 13:09:42.690752 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b9d953-f5d3-4c6a-97c8-f590d1b741c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:09:42.692365 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b9d953-f5d3-4c6a-97c8-f590d1b741c5 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:09:42.704859 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1134/2207] 10.222.0.17 () {58 vars in 1153 bytes} [Fri Oct 14 13:09:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 13:09:42.709042 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aade20bf-276c-41cf-81e5-8e070f278148 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:09:42.720279 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aade20bf-276c-41cf-81e5-8e070f278148 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:09:42.725708 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aafd85e-ecc8-4415-81f5-41c9e723e0fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:09:42.726353 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aafd85e-ecc8-4415-81f5-41c9e723e0fb admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:09:42.726662 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aafd85e-ecc8-4415-81f5-41c9e723e0fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:09:42.726940 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aafd85e-ecc8-4415-81f5-41c9e723e0fb admin admin] PATH_INFO: `/v3/projects` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:09:42.727586 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aafd85e-ecc8-4415-81f5-41c9e723e0fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:09:42.729500 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aafd85e-ecc8-4415-81f5-41c9e723e0fb admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:09:42.759223 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1074/2208] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Oct 14 13:09:42 2022] POST /identity/v3/projects => generated 383 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:09:42.763506 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b9d953-f5d3-4c6a-97c8-f590d1b741c5 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:09:42.774323 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b9d953-f5d3-4c6a-97c8-f590d1b741c5 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:09:42.786787 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:09:42.834667 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c26711-8ef6-4c1e-b8ab-9c74454135c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:09:42.835369 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c26711-8ef6-4c1e-b8ab-9c74454135c3 admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:09:42.835647 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c26711-8ef6-4c1e-b8ab-9c74454135c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:09:42.835921 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c26711-8ef6-4c1e-b8ab-9c74454135c3 admin admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:09:42.836552 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c26711-8ef6-4c1e-b8ab-9c74454135c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:09:42.838504 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c26711-8ef6-4c1e-b8ab-9c74454135c3 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:09:42.860271 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1135/2209] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Oct 14 13:09:42 2022] POST /identity/v3/users => generated 292 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:09:42.864259 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aafd85e-ecc8-4415-81f5-41c9e723e0fb admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:09:42.875038 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aafd85e-ecc8-4415-81f5-41c9e723e0fb admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:09:42.879715 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1225826b-bebc-418c-9b23-05e538ee55e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:09:42.880307 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1225826b-bebc-418c-9b23-05e538ee55e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:09:42.880589 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1225826b-bebc-418c-9b23-05e538ee55e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:09:42.880864 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1225826b-bebc-418c-9b23-05e538ee55e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:09:42.881650 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1225826b-bebc-418c-9b23-05e538ee55e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:09:42.883223 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1225826b-bebc-418c-9b23-05e538ee55e9 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:09:42.893111 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1075/2210] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:09:42 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:09:42.897515 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c26711-8ef6-4c1e-b8ab-9c74454135c3 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:09:42.907578 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c26711-8ef6-4c1e-b8ab-9c74454135c3 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:09:42.912820 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d37e10e-e595-4be0-ba5b-69d784a95031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:09:42.913390 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d37e10e-e595-4be0-ba5b-69d784a95031 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:09:42.913666 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d37e10e-e595-4be0-ba5b-69d784a95031 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:09:42.913939 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d37e10e-e595-4be0-ba5b-69d784a95031 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:09:42.914685 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d37e10e-e595-4be0-ba5b-69d784a95031 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:09:42.916202 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d37e10e-e595-4be0-ba5b-69d784a95031 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:09:42.926770 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1136/2211] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:09:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 14 13:09:42.930923 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1225826b-bebc-418c-9b23-05e538ee55e9 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:09:42.940662 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1225826b-bebc-418c-9b23-05e538ee55e9 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:09:42.945197 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50023500-e449-40b6-9eb5-8915aadd2551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:09:42.945833 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50023500-e449-40b6-9eb5-8915aadd2551 admin admin] REQUEST_METHOD: `PUT` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:09:42.946107 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50023500-e449-40b6-9eb5-8915aadd2551 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:09:42.946413 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50023500-e449-40b6-9eb5-8915aadd2551 admin admin] PATH_INFO: `/v3/projects/6e09658e504f450c8854a652ba6e25f4/users/e2230d5fce41467ea0324649edd2f2bc/roles/5e8849303a75425b9eaa2681cc031af1` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:09:42.960890 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50023500-e449-40b6-9eb5-8915aadd2551 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e09658e504f450c8854a652ba6e25f4, user_id=e2230d5fce41467ea0324649edd2f2bc, role_id=5e8849303a75425b9eaa2681cc031af1)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:09:42.963562 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50023500-e449-40b6-9eb5-8915aadd2551 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:09:42.976683 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1076/2212] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Oct 14 13:09:42 2022] PUT /identity/v3/projects/6e09658e504f450c8854a652ba6e25f4/users/e2230d5fce41467ea0324649edd2f2bc/roles/5e8849303a75425b9eaa2681cc031af1 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:09:42.987933 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b95ab70-e97c-49ff-bb33-78326e114990 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:09:42.988222 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b95ab70-e97c-49ff-bb33-78326e114990 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:09:42.988497 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b95ab70-e97c-49ff-bb33-78326e114990 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:09:43.016696 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-2b95ab70-e97c-49ff-bb33-78326e114990 None None] MFA Rules not processed for user `e2230d5fce41467ea0324649edd2f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:09:43.017953 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-2b95ab70-e97c-49ff-bb33-78326e114990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:09:43.088667 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1137/2213] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:09:42 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:09:43.093538 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50023500-e449-40b6-9eb5-8915aadd2551 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:09:43.157214 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50023500-e449-40b6-9eb5-8915aadd2551 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:09:43.164874 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40691e57-2a07-42dd-9f9e-3af60007aef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:09:43.165489 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40691e57-2a07-42dd-9f9e-3af60007aef7 admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:09:43.165768 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40691e57-2a07-42dd-9f9e-3af60007aef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:09:43.166038 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40691e57-2a07-42dd-9f9e-3af60007aef7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:09:43.166713 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40691e57-2a07-42dd-9f9e-3af60007aef7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:09:43.168652 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40691e57-2a07-42dd-9f9e-3af60007aef7 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:09:43.200274 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1077/2214] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Oct 14 13:09:43 2022] POST /identity/v3/projects => generated 385 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:09:43.201429 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b95ab70-e97c-49ff-bb33-78326e114990 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:09:43.212953 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b95ab70-e97c-49ff-bb33-78326e114990 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:09:43.286165 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395bb4b6-53ad-4669-a35f-41becc505210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:09:43.286871 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395bb4b6-53ad-4669-a35f-41becc505210 admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:09:43.287191 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395bb4b6-53ad-4669-a35f-41becc505210 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:09:43.287466 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395bb4b6-53ad-4669-a35f-41becc505210 admin admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:09:43.288090 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395bb4b6-53ad-4669-a35f-41becc505210 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:09:43.290275 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395bb4b6-53ad-4669-a35f-41becc505210 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:09:43.313883 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1138/2215] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Oct 14 13:09:43 2022] POST /identity/v3/users => generated 299 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:09:43.316047 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40691e57-2a07-42dd-9f9e-3af60007aef7 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:09:43.327766 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40691e57-2a07-42dd-9f9e-3af60007aef7 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:09:43.332769 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8f274f-766e-4852-94df-fef7974b1ef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:09:43.333375 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8f274f-766e-4852-94df-fef7974b1ef1 admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:09:43.333687 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8f274f-766e-4852-94df-fef7974b1ef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:09:43.333972 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8f274f-766e-4852-94df-fef7974b1ef1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:09:43.335370 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8f274f-766e-4852-94df-fef7974b1ef1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:09:43.336987 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8f274f-766e-4852-94df-fef7974b1ef1 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:09:43.348733 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1078/2216] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:09:43 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:09:43.353013 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395bb4b6-53ad-4669-a35f-41becc505210 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:09:43.363516 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395bb4b6-53ad-4669-a35f-41becc505210 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:09:43.368837 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536031ca-190f-41e8-83e3-79c2ed943398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:09:43.369580 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536031ca-190f-41e8-83e3-79c2ed943398 admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:09:43.369925 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536031ca-190f-41e8-83e3-79c2ed943398 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:09:43.370316 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536031ca-190f-41e8-83e3-79c2ed943398 admin admin] PATH_INFO: `/v3/projects/5425569924fa4c11b2643077b295c4fb/users/83d1ea16eb674534b1ecc0af81b113a2/roles/7f6e29e390bc41f7a9af17659a2e95d1` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:09:43.383990 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:09:43.388916 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536031ca-190f-41e8-83e3-79c2ed943398 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5425569924fa4c11b2643077b295c4fb, user_id=83d1ea16eb674534b1ecc0af81b113a2, role_id=7f6e29e390bc41f7a9af17659a2e95d1)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:09:43.392731 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536031ca-190f-41e8-83e3-79c2ed943398 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:09:43.406741 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1139/2217] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Oct 14 13:09:43 2022] PUT /identity/v3/projects/5425569924fa4c11b2643077b295c4fb/users/83d1ea16eb674534b1ecc0af81b113a2/roles/7f6e29e390bc41f7a9af17659a2e95d1 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:09:43.410614 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8f274f-766e-4852-94df-fef7974b1ef1 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:09:43.421482 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8f274f-766e-4852-94df-fef7974b1ef1 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:09:43.474565 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:09:43.483965 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f1da73-b412-4132-ad48-f2f83a246a0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:09:43.484742 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f1da73-b412-4132-ad48-f2f83a246a0e admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:09:43.485254 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f1da73-b412-4132-ad48-f2f83a246a0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:09:43.485742 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f1da73-b412-4132-ad48-f2f83a246a0e admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:09:43.486588 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f1da73-b412-4132-ad48-f2f83a246a0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:09:43.488230 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f1da73-b412-4132-ad48-f2f83a246a0e admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:09:43.502408 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1079/2218] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:09:43 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:09:43.503754 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536031ca-190f-41e8-83e3-79c2ed943398 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:09:43.514628 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536031ca-190f-41e8-83e3-79c2ed943398 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:09:43.519373 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a845cd-27d7-4dc7-ac45-78cb7e331bd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:09:43.520017 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a845cd-27d7-4dc7-ac45-78cb7e331bd1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:09:43.520414 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a845cd-27d7-4dc7-ac45-78cb7e331bd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:09:43.520691 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a845cd-27d7-4dc7-ac45-78cb7e331bd1 admin admin] PATH_INFO: `/v3/projects/5425569924fa4c11b2643077b295c4fb/users/83d1ea16eb674534b1ecc0af81b113a2/roles/7f6e29e390bc41f7a9af17659a2e95d1` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:09:43.522814 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a845cd-27d7-4dc7-ac45-78cb7e331bd1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5425569924fa4c11b2643077b295c4fb, user_id=83d1ea16eb674534b1ecc0af81b113a2, role_id=7f6e29e390bc41f7a9af17659a2e95d1)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:09:43.525475 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a845cd-27d7-4dc7-ac45-78cb7e331bd1 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:09:43.536526 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1140/2219] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Oct 14 13:09:43 2022] PUT /identity/v3/projects/5425569924fa4c11b2643077b295c4fb/users/83d1ea16eb674534b1ecc0af81b113a2/roles/7f6e29e390bc41f7a9af17659a2e95d1 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:09:43.548618 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152a3347-acf7-4b3a-b5dc-ad510e3ca3b9 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:09:43.548999 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152a3347-acf7-4b3a-b5dc-ad510e3ca3b9 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:09:43.549390 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152a3347-acf7-4b3a-b5dc-ad510e3ca3b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:09:43.578817 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-152a3347-acf7-4b3a-b5dc-ad510e3ca3b9 None None] MFA Rules not processed for user `83d1ea16eb674534b1ecc0af81b113a2`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:09:43.580039 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-152a3347-acf7-4b3a-b5dc-ad510e3ca3b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:09:43.661570 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1080/2220] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:09:43 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:09:43.672948 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a845cd-27d7-4dc7-ac45-78cb7e331bd1 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:09:43.674865 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-f7a845cd-27d7-4dc7-ac45-78cb7e331bd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:09:43.741020 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a845cd-27d7-4dc7-ac45-78cb7e331bd1 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:09:43.745247 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3587df-9f7f-4643-a466-a1721f81cba2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c3c564b8c548e4beef1cbfba2ad343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:09:43.745887 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3587df-9f7f-4643-a466-a1721f81cba2 service cinder] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:09:43.746193 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3587df-9f7f-4643-a466-a1721f81cba2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:09:43.746471 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3587df-9f7f-4643-a466-a1721f81cba2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:09:43.808533 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3587df-9f7f-4643-a466-a1721f81cba2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:09:43.810224 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3587df-9f7f-4643-a466-a1721f81cba2 service cinder] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:09:43.821269 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1141/2221] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:09:43 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:09:46.145470 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152a3347-acf7-4b3a-b5dc-ad510e3ca3b9 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:09:46.147731 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-152a3347-acf7-4b3a-b5dc-ad510e3ca3b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:09:46.203326 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152a3347-acf7-4b3a-b5dc-ad510e3ca3b9 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:09:46.206807 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603ac7e4-75b4-482a-b127-7ba39efc0114 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d483292f3a4794848fcacfba5b107e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:09:46.207410 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603ac7e4-75b4-482a-b127-7ba39efc0114 service neutron] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:09:46.207691 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603ac7e4-75b4-482a-b127-7ba39efc0114 service neutron] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:09:46.207963 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603ac7e4-75b4-482a-b127-7ba39efc0114 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:09:46.210547 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-603ac7e4-75b4-482a-b127-7ba39efc0114 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:09:46.271948 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603ac7e4-75b4-482a-b127-7ba39efc0114 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:09:46.273429 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603ac7e4-75b4-482a-b127-7ba39efc0114 service neutron] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:09:46.283302 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1081/2222] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:09:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:09:48.093810 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3587df-9f7f-4643-a466-a1721f81cba2 service cinder] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:09:48.103382 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-cd3587df-9f7f-4643-a466-a1721f81cba2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:09:48.119277 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3587df-9f7f-4643-a466-a1721f81cba2 service cinder] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:09:48.123915 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef11982-4c49-4c53-906d-d722d1aa3d8f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c3c564b8c548e4beef1cbfba2ad343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:09:48.124647 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef11982-4c49-4c53-906d-d722d1aa3d8f service cinder] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:09:48.125025 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef11982-4c49-4c53-906d-d722d1aa3d8f service cinder] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:09:48.125405 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef11982-4c49-4c53-906d-d722d1aa3d8f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:09:48.136464 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef11982-4c49-4c53-906d-d722d1aa3d8f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:09:48.138066 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef11982-4c49-4c53-906d-d722d1aa3d8f service cinder] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:09:48.167744 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1142/2223] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:09:48 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:09:49.518956 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603ac7e4-75b4-482a-b127-7ba39efc0114 service neutron] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:09:49.520976 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-603ac7e4-75b4-482a-b127-7ba39efc0114 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:09:49.535290 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603ac7e4-75b4-482a-b127-7ba39efc0114 service neutron] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:09:49.540719 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2114bc16-63e3-4748-81b2-fcc5916d9249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:09:49.541552 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2114bc16-63e3-4748-81b2-fcc5916d9249 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:09:49.541877 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2114bc16-63e3-4748-81b2-fcc5916d9249 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:09:49.542177 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2114bc16-63e3-4748-81b2-fcc5916d9249 admin admin] PATH_INFO: `/v3/users/9434562e690740bda182577b25f70774` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:09:49.543326 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2114bc16-63e3-4748-81b2-fcc5916d9249 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9434562e690740bda182577b25f70774)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:09:49.545240 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2114bc16-63e3-4748-81b2-fcc5916d9249 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:09:49.570251 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:09:49.595668 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-2114bc16-63e3-4748-81b2-fcc5916d9249 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9434562e690740bda182577b25f70774'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:09:49.602596 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-2114bc16-63e3-4748-81b2-fcc5916d9249 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9434562e690740bda182577b25f70774'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:09:49.603264 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-2114bc16-63e3-4748-81b2-fcc5916d9249 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9434562e690740bda182577b25f70774'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:09:49.610881 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-2114bc16-63e3-4748-81b2-fcc5916d9249 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9434562e690740bda182577b25f70774'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:09:49.630050 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-2114bc16-63e3-4748-81b2-fcc5916d9249 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9434562e690740bda182577b25f70774'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:09:49.639992 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1082/2224] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Oct 14 13:09:49 2022] DELETE /identity/v3/users/9434562e690740bda182577b25f70774 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:09:49.834426 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef11982-4c49-4c53-906d-d722d1aa3d8f service cinder] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:09:49.851428 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef11982-4c49-4c53-906d-d722d1aa3d8f service cinder] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:09:49.912372 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d66db3-c375-434f-a8d5-8a051b133f64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:09:49.913296 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d66db3-c375-434f-a8d5-8a051b133f64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:09:49.913569 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d66db3-c375-434f-a8d5-8a051b133f64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:09:49.913839 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d66db3-c375-434f-a8d5-8a051b133f64 admin admin] PATH_INFO: `/v3/projects/40f6daff348f4fa6a783e398ca257fc7` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:09:49.915072 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d66db3-c375-434f-a8d5-8a051b133f64 admin admin] RBAC: Authorizing `identity:delete_project(project_id=40f6daff348f4fa6a783e398ca257fc7)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:09:49.917342 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d66db3-c375-434f-a8d5-8a051b133f64 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:09:49.940569 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:09:49.979549 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-b6d66db3-c375-434f-a8d5-8a051b133f64 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40f6daff348f4fa6a783e398ca257fc7', 'request_id': 'req-b6d66db3-c375-434f-a8d5-8a051b133f64'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:09:49.987916 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-b6d66db3-c375-434f-a8d5-8a051b133f64 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40f6daff348f4fa6a783e398ca257fc7', 'request_id': 'req-b6d66db3-c375-434f-a8d5-8a051b133f64'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:09:49.994612 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-b6d66db3-c375-434f-a8d5-8a051b133f64 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40f6daff348f4fa6a783e398ca257fc7', 'request_id': 'req-b6d66db3-c375-434f-a8d5-8a051b133f64'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:09:50.008862 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-b6d66db3-c375-434f-a8d5-8a051b133f64 admin admin] The token cache is being invalidate because project 40f6daff348f4fa6a783e398ca257fc7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:09:50.009159 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-b6d66db3-c375-434f-a8d5-8a051b133f64 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:09:50.009819 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-b6d66db3-c375-434f-a8d5-8a051b133f64 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:09:50.011652 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1143/2225] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Oct 14 13:09:49 2022] DELETE /identity/v3/projects/40f6daff348f4fa6a783e398ca257fc7 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:09:50.016355 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db834a9-32e0-4915-b7d1-9dbe3badec26 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:09:50.016647 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db834a9-32e0-4915-b7d1-9dbe3badec26 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:09:50.016925 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db834a9-32e0-4915-b7d1-9dbe3badec26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:09:50.037971 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-1db834a9-32e0-4915-b7d1-9dbe3badec26 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:09:50.039246 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-1db834a9-32e0-4915-b7d1-9dbe3badec26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:09:50.100630 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1083/2226] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:09:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:09:50.108520 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf945e26-81c2-403f-96ed-9a1229d79660 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:09:50.108812 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf945e26-81c2-403f-96ed-9a1229d79660 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:09:50.109088 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf945e26-81c2-403f-96ed-9a1229d79660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:09:50.128593 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-cf945e26-81c2-403f-96ed-9a1229d79660 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:09:50.129776 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-cf945e26-81c2-403f-96ed-9a1229d79660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:09:50.138348 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1144/2227] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:09:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:09:50.142536 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db834a9-32e0-4915-b7d1-9dbe3badec26 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:09:50.153443 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db834a9-32e0-4915-b7d1-9dbe3badec26 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:09:50.157977 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c857cf90-b8cb-446a-b0b8-c66a80836b0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:09:50.158603 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c857cf90-b8cb-446a-b0b8-c66a80836b0b admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:09:50.158883 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c857cf90-b8cb-446a-b0b8-c66a80836b0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:09:50.159157 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c857cf90-b8cb-446a-b0b8-c66a80836b0b admin admin] PATH_INFO: `/v3/domains` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:09:50.159799 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c857cf90-b8cb-446a-b0b8-c66a80836b0b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 13:09:50.160134 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c857cf90-b8cb-446a-b0b8-c66a80836b0b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:09:50.161725 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c857cf90-b8cb-446a-b0b8-c66a80836b0b admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:09:50.174313 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1084/2228] 10.222.0.17 () {58 vars in 1153 bytes} [Fri Oct 14 13:09:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 13:09:50.179150 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf945e26-81c2-403f-96ed-9a1229d79660 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:09:50.188262 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf945e26-81c2-403f-96ed-9a1229d79660 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:09:50.192972 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c24ed6a-0560-4e8c-9518-2faa89f4e525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:09:50.193640 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c24ed6a-0560-4e8c-9518-2faa89f4e525 admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:09:50.193921 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c24ed6a-0560-4e8c-9518-2faa89f4e525 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:09:50.194237 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c24ed6a-0560-4e8c-9518-2faa89f4e525 admin admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:09:50.194868 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c24ed6a-0560-4e8c-9518-2faa89f4e525 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:09:50.196769 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c24ed6a-0560-4e8c-9518-2faa89f4e525 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:09:50.224154 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1145/2229] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Oct 14 13:09:50 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:09:50.228901 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c857cf90-b8cb-446a-b0b8-c66a80836b0b admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:09:50.238776 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c857cf90-b8cb-446a-b0b8-c66a80836b0b admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:09:50.294818 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4d262f-9b27-42e6-8630-1fbaae70fe07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:09:50.295423 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4d262f-9b27-42e6-8630-1fbaae70fe07 admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:09:50.295710 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4d262f-9b27-42e6-8630-1fbaae70fe07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:09:50.295987 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4d262f-9b27-42e6-8630-1fbaae70fe07 admin admin] PATH_INFO: `/v3/users` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:09:50.296616 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4d262f-9b27-42e6-8630-1fbaae70fe07 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:09:50.298578 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4d262f-9b27-42e6-8630-1fbaae70fe07 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:09:50.320099 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1085/2230] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Oct 14 13:09:50 2022] POST /identity/v3/users => generated 287 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:09:50.324245 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c24ed6a-0560-4e8c-9518-2faa89f4e525 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:09:50.334728 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c24ed6a-0560-4e8c-9518-2faa89f4e525 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:09:50.339279 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab4a3f6-0d42-443b-9c3f-35d95d4d6728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:09:50.339958 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab4a3f6-0d42-443b-9c3f-35d95d4d6728 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:09:50.340138 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab4a3f6-0d42-443b-9c3f-35d95d4d6728 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:09:50.340462 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab4a3f6-0d42-443b-9c3f-35d95d4d6728 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:09:50.341042 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab4a3f6-0d42-443b-9c3f-35d95d4d6728 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:09:50.342940 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab4a3f6-0d42-443b-9c3f-35d95d4d6728 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:09:50.353393 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1146/2231] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:09:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:09:50.357317 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4d262f-9b27-42e6-8630-1fbaae70fe07 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:09:50.367504 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4d262f-9b27-42e6-8630-1fbaae70fe07 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:09:50.372156 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5264f984-b4ff-46f6-b1f4-d7d606fe4451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:09:50.372743 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5264f984-b4ff-46f6-b1f4-d7d606fe4451 admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:09:50.373022 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5264f984-b4ff-46f6-b1f4-d7d606fe4451 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:09:50.373295 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5264f984-b4ff-46f6-b1f4-d7d606fe4451 admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:09:50.373957 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5264f984-b4ff-46f6-b1f4-d7d606fe4451 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:09:50.375584 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5264f984-b4ff-46f6-b1f4-d7d606fe4451 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:09:50.386175 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1086/2232] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:09:50 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 14 13:09:50.390258 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab4a3f6-0d42-443b-9c3f-35d95d4d6728 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:09:50.401146 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab4a3f6-0d42-443b-9c3f-35d95d4d6728 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:09:50.405822 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac155d6-e811-45fd-a871-ed5ee22e0f3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:09:50.406483 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac155d6-e811-45fd-a871-ed5ee22e0f3e admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:09:50.406765 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac155d6-e811-45fd-a871-ed5ee22e0f3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:09:50.407042 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac155d6-e811-45fd-a871-ed5ee22e0f3e admin admin] PATH_INFO: `/v3/projects/ab34856e86f742b3a1a3cdf529af8588/users/e376a2fd12ae40679a4aed5881f6862c/roles/5e8849303a75425b9eaa2681cc031af1` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:09:50.421677 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac155d6-e811-45fd-a871-ed5ee22e0f3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab34856e86f742b3a1a3cdf529af8588, user_id=e376a2fd12ae40679a4aed5881f6862c, role_id=5e8849303a75425b9eaa2681cc031af1)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:09:50.424365 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac155d6-e811-45fd-a871-ed5ee22e0f3e admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:09:50.437297 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1147/2233] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Oct 14 13:09:50 2022] PUT /identity/v3/projects/ab34856e86f742b3a1a3cdf529af8588/users/e376a2fd12ae40679a4aed5881f6862c/roles/5e8849303a75425b9eaa2681cc031af1 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:09:50.447449 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cf71d8-1235-45a9-88bb-c1695856b3e1 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:09:50.447740 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cf71d8-1235-45a9-88bb-c1695856b3e1 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:09:50.448016 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cf71d8-1235-45a9-88bb-c1695856b3e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:09:50.456672 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:09:50.478448 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-e6cf71d8-1235-45a9-88bb-c1695856b3e1 None None] MFA Rules not processed for user `e376a2fd12ae40679a4aed5881f6862c`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:09:50.479705 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-e6cf71d8-1235-45a9-88bb-c1695856b3e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:09:50.542390 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1087/2234] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:09:50 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:09:50.553798 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac155d6-e811-45fd-a871-ed5ee22e0f3e admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:09:50.555570 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-cac155d6-e811-45fd-a871-ed5ee22e0f3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:09:50.655044 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac155d6-e811-45fd-a871-ed5ee22e0f3e admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:09:50.660944 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f780a9-66db-4e61-8c08-d3fc438ce3cd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '931f4e32c8764514b5efed31b0785be7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:09:50.661549 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f780a9-66db-4e61-8c08-d3fc438ce3cd service nova] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:09:50.661962 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f780a9-66db-4e61-8c08-d3fc438ce3cd service nova] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:09:50.662359 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f780a9-66db-4e61-8c08-d3fc438ce3cd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:09:50.670334 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f780a9-66db-4e61-8c08-d3fc438ce3cd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:09:50.671922 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f780a9-66db-4e61-8c08-d3fc438ce3cd service nova] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:09:50.681053 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1148/2235] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:09:50 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:09:50.891707 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cf71d8-1235-45a9-88bb-c1695856b3e1 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:09:50.962250 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cf71d8-1235-45a9-88bb-c1695856b3e1 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:09:50.965896 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1269b5d-0943-4330-8dc3-3c53804496d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:09:50.966889 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1269b5d-0943-4330-8dc3-3c53804496d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:09:50.967229 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1269b5d-0943-4330-8dc3-3c53804496d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:09:50.967527 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1269b5d-0943-4330-8dc3-3c53804496d3 admin admin] PATH_INFO: `/v3/users/e376a2fd12ae40679a4aed5881f6862c` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:09:50.968726 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1269b5d-0943-4330-8dc3-3c53804496d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e376a2fd12ae40679a4aed5881f6862c)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:09:50.970833 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1269b5d-0943-4330-8dc3-3c53804496d3 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:09:51.019168 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-f1269b5d-0943-4330-8dc3-3c53804496d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e376a2fd12ae40679a4aed5881f6862c'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:09:51.026904 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-f1269b5d-0943-4330-8dc3-3c53804496d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e376a2fd12ae40679a4aed5881f6862c'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:09:51.027668 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-f1269b5d-0943-4330-8dc3-3c53804496d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e376a2fd12ae40679a4aed5881f6862c'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:09:51.035557 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-f1269b5d-0943-4330-8dc3-3c53804496d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e376a2fd12ae40679a4aed5881f6862c'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:09:51.050686 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-f1269b5d-0943-4330-8dc3-3c53804496d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e376a2fd12ae40679a4aed5881f6862c'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:09:51.057716 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1088/2236] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Oct 14 13:09:50 2022] DELETE /identity/v3/users/e376a2fd12ae40679a4aed5881f6862c => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:09:51.062276 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf719b0-1ea7-4795-a7bd-eb2a2acde44d None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:09:51.062744 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf719b0-1ea7-4795-a7bd-eb2a2acde44d None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:09:51.062862 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf719b0-1ea7-4795-a7bd-eb2a2acde44d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:09:51.071098 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:09:51.088231 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-9bf719b0-1ea7-4795-a7bd-eb2a2acde44d None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:09:51.089516 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-9bf719b0-1ea7-4795-a7bd-eb2a2acde44d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:09:51.149334 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1149/2237] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:09:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:09:51.159084 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1269b5d-0943-4330-8dc3-3c53804496d3 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:09:51.160548 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-f1269b5d-0943-4330-8dc3-3c53804496d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:09:51.175594 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:09:51.221731 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1269b5d-0943-4330-8dc3-3c53804496d3 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:09:51.225508 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7911bd-bc22-4ce2-a4b0-3ac7d399f004 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d483292f3a4794848fcacfba5b107e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:09:51.226136 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7911bd-bc22-4ce2-a4b0-3ac7d399f004 service neutron] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:09:51.226426 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7911bd-bc22-4ce2-a4b0-3ac7d399f004 service neutron] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:09:51.226694 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7911bd-bc22-4ce2-a4b0-3ac7d399f004 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:09:51.235569 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7911bd-bc22-4ce2-a4b0-3ac7d399f004 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:09:51.236984 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7911bd-bc22-4ce2-a4b0-3ac7d399f004 service neutron] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:09:51.246857 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1089/2238] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:09:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:09:51.509531 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf719b0-1ea7-4795-a7bd-eb2a2acde44d None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:09:51.511102 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-9bf719b0-1ea7-4795-a7bd-eb2a2acde44d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:09:51.525094 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf719b0-1ea7-4795-a7bd-eb2a2acde44d None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:09:51.529814 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e1cc71-8adf-4b42-8875-c88601e53bcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:09:51.530515 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e1cc71-8adf-4b42-8875-c88601e53bcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:09:51.530799 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e1cc71-8adf-4b42-8875-c88601e53bcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:09:51.531073 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e1cc71-8adf-4b42-8875-c88601e53bcd admin admin] PATH_INFO: `/v3/projects/ab34856e86f742b3a1a3cdf529af8588` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:09:51.532482 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e1cc71-8adf-4b42-8875-c88601e53bcd admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab34856e86f742b3a1a3cdf529af8588)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:09:51.534495 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e1cc71-8adf-4b42-8875-c88601e53bcd admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:09:51.581566 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-78e1cc71-8adf-4b42-8875-c88601e53bcd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab34856e86f742b3a1a3cdf529af8588', 'request_id': 'req-78e1cc71-8adf-4b42-8875-c88601e53bcd'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:09:51.587221 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-78e1cc71-8adf-4b42-8875-c88601e53bcd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab34856e86f742b3a1a3cdf529af8588', 'request_id': 'req-78e1cc71-8adf-4b42-8875-c88601e53bcd'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:09:51.593571 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-78e1cc71-8adf-4b42-8875-c88601e53bcd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab34856e86f742b3a1a3cdf529af8588', 'request_id': 'req-78e1cc71-8adf-4b42-8875-c88601e53bcd'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:09:51.606328 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-78e1cc71-8adf-4b42-8875-c88601e53bcd admin admin] The token cache is being invalidate because project ab34856e86f742b3a1a3cdf529af8588 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:09:51.606618 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-78e1cc71-8adf-4b42-8875-c88601e53bcd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:09:51.607241 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-78e1cc71-8adf-4b42-8875-c88601e53bcd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:09:51.608711 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1150/2239] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Oct 14 13:09:51 2022] DELETE /identity/v3/projects/ab34856e86f742b3a1a3cdf529af8588 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:09:51.613665 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3f139f-8083-4144-b10b-5ca7f4c4dc00 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:09:51.614144 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3f139f-8083-4144-b10b-5ca7f4c4dc00 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:09:51.614262 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3f139f-8083-4144-b10b-5ca7f4c4dc00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:09:51.634340 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-ce3f139f-8083-4144-b10b-5ca7f4c4dc00 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:09:51.635533 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-ce3f139f-8083-4144-b10b-5ca7f4c4dc00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:09:51.700631 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1090/2240] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:09:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:09:51.709923 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffe40af-f5c4-4161-b7e5-d9ce64fd3d09 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:09:51.710235 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffe40af-f5c4-4161-b7e5-d9ce64fd3d09 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:09:51.710516 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffe40af-f5c4-4161-b7e5-d9ce64fd3d09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:09:51.731210 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-3ffe40af-f5c4-4161-b7e5-d9ce64fd3d09 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:09:51.732419 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-3ffe40af-f5c4-4161-b7e5-d9ce64fd3d09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:09:51.746552 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1151/2241] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:09:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:09:51.750860 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3f139f-8083-4144-b10b-5ca7f4c4dc00 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:09:51.760921 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3f139f-8083-4144-b10b-5ca7f4c4dc00 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:09:51.765616 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e96314-46f7-48a7-9f2c-901a24b1b9fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:09:51.766276 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e96314-46f7-48a7-9f2c-901a24b1b9fc admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:09:51.766552 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e96314-46f7-48a7-9f2c-901a24b1b9fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:09:51.766828 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e96314-46f7-48a7-9f2c-901a24b1b9fc admin admin] PATH_INFO: `/v3/domains` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:09:51.767515 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e96314-46f7-48a7-9f2c-901a24b1b9fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 13:09:51.767815 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e96314-46f7-48a7-9f2c-901a24b1b9fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:09:51.769399 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e96314-46f7-48a7-9f2c-901a24b1b9fc admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:09:51.781010 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1091/2242] 10.222.0.17 () {58 vars in 1153 bytes} [Fri Oct 14 13:09:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 13:09:51.785182 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffe40af-f5c4-4161-b7e5-d9ce64fd3d09 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:09:51.794945 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffe40af-f5c4-4161-b7e5-d9ce64fd3d09 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:09:51.799567 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159fe0be-d81d-47fb-888c-37f9c66de948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:09:51.800148 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159fe0be-d81d-47fb-888c-37f9c66de948 admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:09:51.800421 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159fe0be-d81d-47fb-888c-37f9c66de948 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:09:51.800695 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159fe0be-d81d-47fb-888c-37f9c66de948 admin admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:09:51.801310 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159fe0be-d81d-47fb-888c-37f9c66de948 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:09:51.804070 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159fe0be-d81d-47fb-888c-37f9c66de948 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:09:51.831490 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1152/2243] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Oct 14 13:09:51 2022] POST /identity/v3/projects => generated 379 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:09:51.836246 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e96314-46f7-48a7-9f2c-901a24b1b9fc admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:09:51.846855 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e96314-46f7-48a7-9f2c-901a24b1b9fc admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:09:51.902057 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2246bd45-7895-47fd-b1ee-cbc06fde1bd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:09:51.902684 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2246bd45-7895-47fd-b1ee-cbc06fde1bd5 admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:09:51.902964 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2246bd45-7895-47fd-b1ee-cbc06fde1bd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:09:51.903236 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2246bd45-7895-47fd-b1ee-cbc06fde1bd5 admin admin] PATH_INFO: `/v3/users` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:09:51.903867 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2246bd45-7895-47fd-b1ee-cbc06fde1bd5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:09:51.905760 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2246bd45-7895-47fd-b1ee-cbc06fde1bd5 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:09:51.926415 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1092/2244] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Oct 14 13:09:51 2022] POST /identity/v3/users => generated 290 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:09:51.931127 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159fe0be-d81d-47fb-888c-37f9c66de948 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:09:51.941435 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159fe0be-d81d-47fb-888c-37f9c66de948 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:09:51.946828 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d128953-4885-410f-9c21-602e711d21da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:09:51.947423 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d128953-4885-410f-9c21-602e711d21da admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:09:51.947702 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d128953-4885-410f-9c21-602e711d21da admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:09:51.947976 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d128953-4885-410f-9c21-602e711d21da admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:09:51.948648 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d128953-4885-410f-9c21-602e711d21da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:09:51.950276 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d128953-4885-410f-9c21-602e711d21da admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:09:51.960484 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1153/2245] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:09:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:09:51.964322 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2246bd45-7895-47fd-b1ee-cbc06fde1bd5 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:09:51.975644 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2246bd45-7895-47fd-b1ee-cbc06fde1bd5 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:09:51.980361 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4647450-14de-47b3-820f-7c031cc57621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:09:51.980960 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4647450-14de-47b3-820f-7c031cc57621 admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:09:51.981243 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4647450-14de-47b3-820f-7c031cc57621 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:09:51.981583 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4647450-14de-47b3-820f-7c031cc57621 admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:09:51.982173 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4647450-14de-47b3-820f-7c031cc57621 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:09:51.983790 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4647450-14de-47b3-820f-7c031cc57621 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:09:51.995307 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1093/2246] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:09:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:09:51.999467 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d128953-4885-410f-9c21-602e711d21da admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:09:52.010179 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d128953-4885-410f-9c21-602e711d21da admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:09:52.014875 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26354344-e032-47fa-97f0-da777db3e06f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:09:52.015522 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26354344-e032-47fa-97f0-da777db3e06f admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:09:52.015799 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26354344-e032-47fa-97f0-da777db3e06f admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:09:52.016070 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26354344-e032-47fa-97f0-da777db3e06f admin admin] PATH_INFO: `/v3/projects/f4e165fbbbb140f5957f97d152a35a26/users/af78c673e50046deb0232b18048a5a7e/roles/5e8849303a75425b9eaa2681cc031af1` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:09:52.032408 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26354344-e032-47fa-97f0-da777db3e06f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4e165fbbbb140f5957f97d152a35a26, user_id=af78c673e50046deb0232b18048a5a7e, role_id=5e8849303a75425b9eaa2681cc031af1)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:09:52.035343 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26354344-e032-47fa-97f0-da777db3e06f admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:09:52.054604 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1154/2247] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Oct 14 13:09:51 2022] PUT /identity/v3/projects/f4e165fbbbb140f5957f97d152a35a26/users/af78c673e50046deb0232b18048a5a7e/roles/5e8849303a75425b9eaa2681cc031af1 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:09:52.066846 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646de209-968a-4d46-b699-be026e504254 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:09:52.067148 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646de209-968a-4d46-b699-be026e504254 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:09:52.067438 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646de209-968a-4d46-b699-be026e504254 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:09:52.101637 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-646de209-968a-4d46-b699-be026e504254 None None] MFA Rules not processed for user `af78c673e50046deb0232b18048a5a7e`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:09:52.103123 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-646de209-968a-4d46-b699-be026e504254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:09:52.112791 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:09:52.169464 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1094/2248] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:09:52 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:09:52.174003 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26354344-e032-47fa-97f0-da777db3e06f admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:09:52.201959 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:09:52.244028 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26354344-e032-47fa-97f0-da777db3e06f admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:09:52.248703 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153b6a73-c3dd-4968-b2e6-115ff7398956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:09:52.249309 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153b6a73-c3dd-4968-b2e6-115ff7398956 admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:09:52.249588 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153b6a73-c3dd-4968-b2e6-115ff7398956 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:09:52.249876 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153b6a73-c3dd-4968-b2e6-115ff7398956 admin admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:09:52.250523 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153b6a73-c3dd-4968-b2e6-115ff7398956 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:09:52.252444 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153b6a73-c3dd-4968-b2e6-115ff7398956 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:09:52.278985 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1155/2249] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Oct 14 13:09:52 2022] POST /identity/v3/projects => generated 379 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:09:52.283121 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646de209-968a-4d46-b699-be026e504254 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:09:52.294515 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646de209-968a-4d46-b699-be026e504254 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:09:52.351727 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af83af88-82fc-45e8-ba94-6a4a64adfd1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:09:52.352287 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af83af88-82fc-45e8-ba94-6a4a64adfd1d admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:09:52.352565 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af83af88-82fc-45e8-ba94-6a4a64adfd1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:09:52.352837 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af83af88-82fc-45e8-ba94-6a4a64adfd1d admin admin] PATH_INFO: `/v3/users` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:09:52.353486 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af83af88-82fc-45e8-ba94-6a4a64adfd1d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:09:52.355477 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af83af88-82fc-45e8-ba94-6a4a64adfd1d admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:09:52.377720 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1095/2250] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Oct 14 13:09:52 2022] POST /identity/v3/users => generated 296 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:09:52.381335 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153b6a73-c3dd-4968-b2e6-115ff7398956 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:09:52.391775 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153b6a73-c3dd-4968-b2e6-115ff7398956 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:09:52.396444 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025f0319-38d5-46cb-8740-440ae3f18ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:09:52.397032 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025f0319-38d5-46cb-8740-440ae3f18ba6 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:09:52.397316 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025f0319-38d5-46cb-8740-440ae3f18ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:09:52.397592 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025f0319-38d5-46cb-8740-440ae3f18ba6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:09:52.398271 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025f0319-38d5-46cb-8740-440ae3f18ba6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:09:52.399878 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025f0319-38d5-46cb-8740-440ae3f18ba6 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:09:52.410440 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1156/2251] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:09:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:09:52.415099 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af83af88-82fc-45e8-ba94-6a4a64adfd1d admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:09:52.425144 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af83af88-82fc-45e8-ba94-6a4a64adfd1d admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:09:52.430758 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b69bd8b-4d70-4b21-b898-21132cb6e94b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:09:52.431434 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b69bd8b-4d70-4b21-b898-21132cb6e94b admin admin] REQUEST_METHOD: `PUT` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:09:52.431762 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b69bd8b-4d70-4b21-b898-21132cb6e94b admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:09:52.432042 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b69bd8b-4d70-4b21-b898-21132cb6e94b admin admin] PATH_INFO: `/v3/projects/2d84628962054d12a597919e45261b9c/users/fdba4035271342feb20d437e33e819da/roles/7f6e29e390bc41f7a9af17659a2e95d1` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:09:52.447361 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b69bd8b-4d70-4b21-b898-21132cb6e94b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d84628962054d12a597919e45261b9c, user_id=fdba4035271342feb20d437e33e819da, role_id=7f6e29e390bc41f7a9af17659a2e95d1)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:09:52.450494 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b69bd8b-4d70-4b21-b898-21132cb6e94b admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:09:52.463688 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1096/2252] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Oct 14 13:09:52 2022] PUT /identity/v3/projects/2d84628962054d12a597919e45261b9c/users/fdba4035271342feb20d437e33e819da/roles/7f6e29e390bc41f7a9af17659a2e95d1 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:09:52.467893 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025f0319-38d5-46cb-8740-440ae3f18ba6 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:09:52.478988 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025f0319-38d5-46cb-8740-440ae3f18ba6 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:09:52.535850 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f06e6b-9a1c-41f3-adb3-8177627b760f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:09:52.536538 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f06e6b-9a1c-41f3-adb3-8177627b760f admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:09:52.537442 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f06e6b-9a1c-41f3-adb3-8177627b760f admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:09:52.537781 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f06e6b-9a1c-41f3-adb3-8177627b760f admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:09:52.538388 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f06e6b-9a1c-41f3-adb3-8177627b760f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:09:52.540002 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f06e6b-9a1c-41f3-adb3-8177627b760f admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:09:52.549439 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1157/2253] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:09:52 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:09:52.554388 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b69bd8b-4d70-4b21-b898-21132cb6e94b admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:09:52.564643 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b69bd8b-4d70-4b21-b898-21132cb6e94b admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:09:52.569850 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b10006-7560-48cf-baea-c4d6ded91f0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:09:52.570545 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b10006-7560-48cf-baea-c4d6ded91f0e admin admin] REQUEST_METHOD: `PUT` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:09:52.570819 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b10006-7560-48cf-baea-c4d6ded91f0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:09:52.571086 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b10006-7560-48cf-baea-c4d6ded91f0e admin admin] PATH_INFO: `/v3/projects/2d84628962054d12a597919e45261b9c/users/fdba4035271342feb20d437e33e819da/roles/7f6e29e390bc41f7a9af17659a2e95d1` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:09:52.573087 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b10006-7560-48cf-baea-c4d6ded91f0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d84628962054d12a597919e45261b9c, user_id=fdba4035271342feb20d437e33e819da, role_id=7f6e29e390bc41f7a9af17659a2e95d1)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:09:52.575763 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b10006-7560-48cf-baea-c4d6ded91f0e admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:09:52.586486 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1097/2254] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Oct 14 13:09:52 2022] PUT /identity/v3/projects/2d84628962054d12a597919e45261b9c/users/fdba4035271342feb20d437e33e819da/roles/7f6e29e390bc41f7a9af17659a2e95d1 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:09:52.596820 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b13a6f-914f-4c05-ab1b-04d0ff0b4712 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:09:52.597104 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b13a6f-914f-4c05-ab1b-04d0ff0b4712 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:09:52.597372 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b13a6f-914f-4c05-ab1b-04d0ff0b4712 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:09:52.624798 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-f4b13a6f-914f-4c05-ab1b-04d0ff0b4712 None None] MFA Rules not processed for user `fdba4035271342feb20d437e33e819da`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:09:52.625923 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-f4b13a6f-914f-4c05-ab1b-04d0ff0b4712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:09:52.690894 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1158/2255] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:09:52 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:09:52.703837 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b10006-7560-48cf-baea-c4d6ded91f0e admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:09:52.705623 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-86b10006-7560-48cf-baea-c4d6ded91f0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:09:52.766091 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b10006-7560-48cf-baea-c4d6ded91f0e admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:09:52.769882 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba61363-37fc-4a49-bee7-1813195db18d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c3c564b8c548e4beef1cbfba2ad343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:09:52.770540 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba61363-37fc-4a49-bee7-1813195db18d service cinder] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:09:52.770816 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba61363-37fc-4a49-bee7-1813195db18d service cinder] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:09:52.771722 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba61363-37fc-4a49-bee7-1813195db18d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:09:52.782808 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba61363-37fc-4a49-bee7-1813195db18d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:09:52.784317 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba61363-37fc-4a49-bee7-1813195db18d service cinder] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:09:52.795027 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1098/2256] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:09:52 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:09:52.876112 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b13a6f-914f-4c05-ab1b-04d0ff0b4712 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:09:52.885696 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b13a6f-914f-4c05-ab1b-04d0ff0b4712 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:09:52.889714 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f334e3eb-b030-4ebd-8d75-b9d379e2cd10 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c3c564b8c548e4beef1cbfba2ad343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:09:52.890479 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f334e3eb-b030-4ebd-8d75-b9d379e2cd10 service cinder] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:09:52.890768 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f334e3eb-b030-4ebd-8d75-b9d379e2cd10 service cinder] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:09:52.891079 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f334e3eb-b030-4ebd-8d75-b9d379e2cd10 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:09:52.904889 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:09:52.951007 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f334e3eb-b030-4ebd-8d75-b9d379e2cd10 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:09:52.952465 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f334e3eb-b030-4ebd-8d75-b9d379e2cd10 service cinder] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:09:52.962239 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1159/2257] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:09:52 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:09:53.129912 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba61363-37fc-4a49-bee7-1813195db18d service cinder] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:09:53.132674 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-aba61363-37fc-4a49-bee7-1813195db18d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:09:53.143355 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:09:53.207919 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba61363-37fc-4a49-bee7-1813195db18d service cinder] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:09:53.213524 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f5371e-0419-4763-bdc5-891e871a939e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:09:53.214190 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f5371e-0419-4763-bdc5-891e871a939e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:09:53.214482 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f5371e-0419-4763-bdc5-891e871a939e admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:09:53.214759 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f5371e-0419-4763-bdc5-891e871a939e admin admin] PATH_INFO: `/v3/users/e2230d5fce41467ea0324649edd2f2bc` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:09:53.215926 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f5371e-0419-4763-bdc5-891e871a939e admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2230d5fce41467ea0324649edd2f2bc)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:09:53.218183 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f5371e-0419-4763-bdc5-891e871a939e admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:09:53.267818 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-b6f5371e-0419-4763-bdc5-891e871a939e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2230d5fce41467ea0324649edd2f2bc'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:09:53.275301 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-b6f5371e-0419-4763-bdc5-891e871a939e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2230d5fce41467ea0324649edd2f2bc'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:09:53.276017 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-b6f5371e-0419-4763-bdc5-891e871a939e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2230d5fce41467ea0324649edd2f2bc'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:09:53.284236 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-b6f5371e-0419-4763-bdc5-891e871a939e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2230d5fce41467ea0324649edd2f2bc'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:09:53.298539 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-b6f5371e-0419-4763-bdc5-891e871a939e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2230d5fce41467ea0324649edd2f2bc'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:09:53.305452 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1099/2258] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Oct 14 13:09:53 2022] DELETE /identity/v3/users/e2230d5fce41467ea0324649edd2f2bc => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:09:53.310790 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab639ae-ed70-4fec-a03f-558821340388 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:09:53.311276 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab639ae-ed70-4fec-a03f-558821340388 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:09:53.311469 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab639ae-ed70-4fec-a03f-558821340388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:09:53.331599 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-5ab639ae-ed70-4fec-a03f-558821340388 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:09:53.332813 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-5ab639ae-ed70-4fec-a03f-558821340388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:09:53.393527 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1160/2259] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:09:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:09:53.404305 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f5371e-0419-4763-bdc5-891e871a939e admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:09:53.405741 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-b6f5371e-0419-4763-bdc5-891e871a939e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:09:53.464109 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f5371e-0419-4763-bdc5-891e871a939e admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:09:53.468213 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036abcca-09ca-48be-8de3-8eb9927f3253 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d483292f3a4794848fcacfba5b107e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:09:53.468939 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036abcca-09ca-48be-8de3-8eb9927f3253 service neutron] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:09:53.469226 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036abcca-09ca-48be-8de3-8eb9927f3253 service neutron] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:09:53.469498 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036abcca-09ca-48be-8de3-8eb9927f3253 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:09:53.479845 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036abcca-09ca-48be-8de3-8eb9927f3253 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:09:53.481342 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036abcca-09ca-48be-8de3-8eb9927f3253 service neutron] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:09:53.491805 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1100/2260] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:09:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:09:53.773849 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab639ae-ed70-4fec-a03f-558821340388 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:09:53.775522 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-5ab639ae-ed70-4fec-a03f-558821340388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:09:53.788622 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab639ae-ed70-4fec-a03f-558821340388 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:09:53.793994 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ce93f0-90e5-4519-8e4e-c372c54d7e34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:09:53.794734 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ce93f0-90e5-4519-8e4e-c372c54d7e34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:09:53.795015 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ce93f0-90e5-4519-8e4e-c372c54d7e34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:09:53.795290 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ce93f0-90e5-4519-8e4e-c372c54d7e34 admin admin] PATH_INFO: `/v3/projects/6e09658e504f450c8854a652ba6e25f4` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:09:53.796409 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ce93f0-90e5-4519-8e4e-c372c54d7e34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e09658e504f450c8854a652ba6e25f4)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:09:53.798486 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ce93f0-90e5-4519-8e4e-c372c54d7e34 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:09:53.845179 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-72ce93f0-90e5-4519-8e4e-c372c54d7e34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e09658e504f450c8854a652ba6e25f4', 'request_id': 'req-72ce93f0-90e5-4519-8e4e-c372c54d7e34'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:09:53.851214 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-72ce93f0-90e5-4519-8e4e-c372c54d7e34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e09658e504f450c8854a652ba6e25f4', 'request_id': 'req-72ce93f0-90e5-4519-8e4e-c372c54d7e34'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:09:53.857376 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-72ce93f0-90e5-4519-8e4e-c372c54d7e34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e09658e504f450c8854a652ba6e25f4', 'request_id': 'req-72ce93f0-90e5-4519-8e4e-c372c54d7e34'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:09:53.871542 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-72ce93f0-90e5-4519-8e4e-c372c54d7e34 admin admin] The token cache is being invalidate because project 6e09658e504f450c8854a652ba6e25f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:09:53.871835 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-72ce93f0-90e5-4519-8e4e-c372c54d7e34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:09:53.872460 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-72ce93f0-90e5-4519-8e4e-c372c54d7e34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:09:53.874056 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1161/2261] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Oct 14 13:09:53 2022] DELETE /identity/v3/projects/6e09658e504f450c8854a652ba6e25f4 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:09:53.878045 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036abcca-09ca-48be-8de3-8eb9927f3253 service neutron] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:09:53.887820 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036abcca-09ca-48be-8de3-8eb9927f3253 service neutron] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:09:53.913660 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:09:53.946090 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed46ae1-b630-40b1-b2d6-32c6f90a3cf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:09:53.946745 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed46ae1-b630-40b1-b2d6-32c6f90a3cf0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:09:53.947032 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed46ae1-b630-40b1-b2d6-32c6f90a3cf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:09:53.947295 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed46ae1-b630-40b1-b2d6-32c6f90a3cf0 admin admin] PATH_INFO: `/v3/users/83d1ea16eb674534b1ecc0af81b113a2` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:09:53.948412 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed46ae1-b630-40b1-b2d6-32c6f90a3cf0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=83d1ea16eb674534b1ecc0af81b113a2)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:09:53.950360 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed46ae1-b630-40b1-b2d6-32c6f90a3cf0 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:09:53.995868 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-4ed46ae1-b630-40b1-b2d6-32c6f90a3cf0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83d1ea16eb674534b1ecc0af81b113a2'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:09:54.002714 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-4ed46ae1-b630-40b1-b2d6-32c6f90a3cf0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83d1ea16eb674534b1ecc0af81b113a2'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:09:54.003359 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-4ed46ae1-b630-40b1-b2d6-32c6f90a3cf0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83d1ea16eb674534b1ecc0af81b113a2'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:09:54.010536 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-4ed46ae1-b630-40b1-b2d6-32c6f90a3cf0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83d1ea16eb674534b1ecc0af81b113a2'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:09:54.023207 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-4ed46ae1-b630-40b1-b2d6-32c6f90a3cf0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83d1ea16eb674534b1ecc0af81b113a2'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:09:54.028859 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1101/2262] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Oct 14 13:09:53 2022] DELETE /identity/v3/users/83d1ea16eb674534b1ecc0af81b113a2 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:09:54.297541 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ce93f0-90e5-4519-8e4e-c372c54d7e34 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:09:54.299104 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-72ce93f0-90e5-4519-8e4e-c372c54d7e34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:09:54.313770 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ce93f0-90e5-4519-8e4e-c372c54d7e34 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:09:54.358620 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:09:54.383643 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a34c308-9934-4428-8b3a-a524191c6008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:09:54.384481 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a34c308-9934-4428-8b3a-a524191c6008 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:09:54.384770 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a34c308-9934-4428-8b3a-a524191c6008 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:09:54.385049 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a34c308-9934-4428-8b3a-a524191c6008 admin admin] PATH_INFO: `/v3/projects/5425569924fa4c11b2643077b295c4fb` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:09:54.386755 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a34c308-9934-4428-8b3a-a524191c6008 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5425569924fa4c11b2643077b295c4fb)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:09:54.388840 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a34c308-9934-4428-8b3a-a524191c6008 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:09:54.443839 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-3a34c308-9934-4428-8b3a-a524191c6008 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5425569924fa4c11b2643077b295c4fb', 'request_id': 'req-3a34c308-9934-4428-8b3a-a524191c6008'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:09:54.450146 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-3a34c308-9934-4428-8b3a-a524191c6008 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5425569924fa4c11b2643077b295c4fb', 'request_id': 'req-3a34c308-9934-4428-8b3a-a524191c6008'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:09:54.457401 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-3a34c308-9934-4428-8b3a-a524191c6008 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5425569924fa4c11b2643077b295c4fb', 'request_id': 'req-3a34c308-9934-4428-8b3a-a524191c6008'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:09:54.473798 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-3a34c308-9934-4428-8b3a-a524191c6008 admin admin] The token cache is being invalidate because project 5425569924fa4c11b2643077b295c4fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:09:54.474142 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-3a34c308-9934-4428-8b3a-a524191c6008 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:09:54.474892 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-3a34c308-9934-4428-8b3a-a524191c6008 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:09:54.476521 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1162/2263] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Oct 14 13:09:54 2022] DELETE /identity/v3/projects/5425569924fa4c11b2643077b295c4fb => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:09:54.483035 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b790080-ee9b-4f21-9179-b91bd26beca4 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:09:54.483495 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b790080-ee9b-4f21-9179-b91bd26beca4 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:09:54.483755 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b790080-ee9b-4f21-9179-b91bd26beca4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:09:54.507484 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-5b790080-ee9b-4f21-9179-b91bd26beca4 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:09:54.508903 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-5b790080-ee9b-4f21-9179-b91bd26beca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:09:54.569666 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1102/2264] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:09:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:09:54.579196 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd28e90-58ca-42c3-99b9-9f114e1cbc03 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:09:54.579480 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd28e90-58ca-42c3-99b9-9f114e1cbc03 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:09:54.579754 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd28e90-58ca-42c3-99b9-9f114e1cbc03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:09:54.600793 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-1fd28e90-58ca-42c3-99b9-9f114e1cbc03 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:09:54.602005 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-1fd28e90-58ca-42c3-99b9-9f114e1cbc03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:09:54.609928 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1163/2265] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:09:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:09:54.614090 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b790080-ee9b-4f21-9179-b91bd26beca4 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:09:54.624247 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b790080-ee9b-4f21-9179-b91bd26beca4 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:09:54.628816 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a954e4-1659-4b52-a8bc-28ddbc05302f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:09:54.629406 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a954e4-1659-4b52-a8bc-28ddbc05302f admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:09:54.629688 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a954e4-1659-4b52-a8bc-28ddbc05302f admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:09:54.629964 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a954e4-1659-4b52-a8bc-28ddbc05302f admin admin] PATH_INFO: `/v3/domains` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:09:54.631200 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a954e4-1659-4b52-a8bc-28ddbc05302f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 13:09:54.631503 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a954e4-1659-4b52-a8bc-28ddbc05302f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:09:54.633095 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a954e4-1659-4b52-a8bc-28ddbc05302f admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:09:54.644434 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1103/2266] 10.222.0.17 () {58 vars in 1153 bytes} [Fri Oct 14 13:09:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 13:09:54.649430 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd28e90-58ca-42c3-99b9-9f114e1cbc03 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:09:54.658705 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd28e90-58ca-42c3-99b9-9f114e1cbc03 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:09:54.663352 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0ab2cb-84b9-440b-8172-11024a4558c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:09:54.663938 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0ab2cb-84b9-440b-8172-11024a4558c7 admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:09:54.664220 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0ab2cb-84b9-440b-8172-11024a4558c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:09:54.664494 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0ab2cb-84b9-440b-8172-11024a4558c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:09:54.665233 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0ab2cb-84b9-440b-8172-11024a4558c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:09:54.667151 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0ab2cb-84b9-440b-8172-11024a4558c7 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:09:54.695011 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1164/2267] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Oct 14 13:09:54 2022] POST /identity/v3/projects => generated 361 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:09:54.698663 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a954e4-1659-4b52-a8bc-28ddbc05302f admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:09:54.710326 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a954e4-1659-4b52-a8bc-28ddbc05302f admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:09:54.744193 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:09:54.772810 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c7efa3-df2d-43c5-a96b-952bb6159f69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:09:54.773416 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c7efa3-df2d-43c5-a96b-952bb6159f69 admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:09:54.773701 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c7efa3-df2d-43c5-a96b-952bb6159f69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:09:54.773977 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c7efa3-df2d-43c5-a96b-952bb6159f69 admin admin] PATH_INFO: `/v3/users` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:09:54.774655 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c7efa3-df2d-43c5-a96b-952bb6159f69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:09:54.776575 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c7efa3-df2d-43c5-a96b-952bb6159f69 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:09:54.797368 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1104/2268] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Oct 14 13:09:54 2022] POST /identity/v3/users => generated 281 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:09:54.801614 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0ab2cb-84b9-440b-8172-11024a4558c7 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:09:54.813309 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0ab2cb-84b9-440b-8172-11024a4558c7 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:09:54.818705 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39670305-b31d-4aa6-bfb2-90111de0e1a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:09:54.819176 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39670305-b31d-4aa6-bfb2-90111de0e1a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:09:54.819483 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39670305-b31d-4aa6-bfb2-90111de0e1a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:09:54.819757 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39670305-b31d-4aa6-bfb2-90111de0e1a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:09:54.820398 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39670305-b31d-4aa6-bfb2-90111de0e1a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:09:54.822000 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39670305-b31d-4aa6-bfb2-90111de0e1a5 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:09:54.831770 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1165/2269] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:09:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:09:54.836425 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c7efa3-df2d-43c5-a96b-952bb6159f69 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:09:54.846683 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c7efa3-df2d-43c5-a96b-952bb6159f69 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:09:54.851574 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1574507c-66ee-47e4-af49-3a7c8fbca714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:09:54.852158 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1574507c-66ee-47e4-af49-3a7c8fbca714 admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:09:54.852437 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1574507c-66ee-47e4-af49-3a7c8fbca714 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:09:54.852706 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1574507c-66ee-47e4-af49-3a7c8fbca714 admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:09:54.853334 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1574507c-66ee-47e4-af49-3a7c8fbca714 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:09:54.854970 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1574507c-66ee-47e4-af49-3a7c8fbca714 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:09:54.865153 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1105/2270] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:09:54 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:09:54.869374 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39670305-b31d-4aa6-bfb2-90111de0e1a5 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:09:54.879411 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39670305-b31d-4aa6-bfb2-90111de0e1a5 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:09:54.885177 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a80531-63e8-4842-94c7-af24b18398f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:09:54.885853 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a80531-63e8-4842-94c7-af24b18398f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:09:54.886216 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a80531-63e8-4842-94c7-af24b18398f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:09:54.886504 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a80531-63e8-4842-94c7-af24b18398f9 admin admin] PATH_INFO: `/v3/projects/353853d6e4ce4add9ab93fc66e3d4f33/users/0d43cfae69894d33a5cc8eefc9f7cbfb/roles/5e8849303a75425b9eaa2681cc031af1` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:09:54.901569 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a80531-63e8-4842-94c7-af24b18398f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=353853d6e4ce4add9ab93fc66e3d4f33, user_id=0d43cfae69894d33a5cc8eefc9f7cbfb, role_id=5e8849303a75425b9eaa2681cc031af1)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:09:54.904350 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a80531-63e8-4842-94c7-af24b18398f9 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:09:54.916801 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1166/2271] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Oct 14 13:09:54 2022] PUT /identity/v3/projects/353853d6e4ce4add9ab93fc66e3d4f33/users/0d43cfae69894d33a5cc8eefc9f7cbfb/roles/5e8849303a75425b9eaa2681cc031af1 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 13:09:54.929133 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a77cf3-9a78-428a-87f1-aa224c93fb1b None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:09:54.929657 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a77cf3-9a78-428a-87f1-aa224c93fb1b None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:09:54.929875 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a77cf3-9a78-428a-87f1-aa224c93fb1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:09:54.958244 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-22a77cf3-9a78-428a-87f1-aa224c93fb1b None None] MFA Rules not processed for user `0d43cfae69894d33a5cc8eefc9f7cbfb`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:09:54.959728 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-22a77cf3-9a78-428a-87f1-aa224c93fb1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:09:55.023527 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1106/2272] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:09:54 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:09:55.058165 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a80531-63e8-4842-94c7-af24b18398f9 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:09:55.059981 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-77a80531-63e8-4842-94c7-af24b18398f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:09:55.117572 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a80531-63e8-4842-94c7-af24b18398f9 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:09:55.121422 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a881102-3b73-4963-998e-ad0b94d256da service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c3c564b8c548e4beef1cbfba2ad343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:09:55.122025 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a881102-3b73-4963-998e-ad0b94d256da service cinder] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:09:55.122336 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a881102-3b73-4963-998e-ad0b94d256da service cinder] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:09:55.122615 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a881102-3b73-4963-998e-ad0b94d256da service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:09:55.131631 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a881102-3b73-4963-998e-ad0b94d256da service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:09:55.133082 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a881102-3b73-4963-998e-ad0b94d256da service cinder] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:09:55.141751 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1167/2273] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:09:55 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:09:55.157111 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a77cf3-9a78-428a-87f1-aa224c93fb1b None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:09:55.218781 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a77cf3-9a78-428a-87f1-aa224c93fb1b None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:09:55.223346 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c77ed1-1af6-4146-8084-1eaaafd9a7f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:09:55.223971 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c77ed1-1af6-4146-8084-1eaaafd9a7f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:09:55.224280 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c77ed1-1af6-4146-8084-1eaaafd9a7f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:09:55.225135 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c77ed1-1af6-4146-8084-1eaaafd9a7f9 admin admin] PATH_INFO: `/v3/users/0d43cfae69894d33a5cc8eefc9f7cbfb` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:09:55.226389 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c77ed1-1af6-4146-8084-1eaaafd9a7f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d43cfae69894d33a5cc8eefc9f7cbfb)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:09:55.228323 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c77ed1-1af6-4146-8084-1eaaafd9a7f9 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:09:55.272687 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:09:55.274478 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-b9c77ed1-1af6-4146-8084-1eaaafd9a7f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d43cfae69894d33a5cc8eefc9f7cbfb'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:09:55.283161 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-b9c77ed1-1af6-4146-8084-1eaaafd9a7f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d43cfae69894d33a5cc8eefc9f7cbfb'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:09:55.283825 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-b9c77ed1-1af6-4146-8084-1eaaafd9a7f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d43cfae69894d33a5cc8eefc9f7cbfb'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:09:55.291033 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-b9c77ed1-1af6-4146-8084-1eaaafd9a7f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d43cfae69894d33a5cc8eefc9f7cbfb'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:09:55.303300 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-b9c77ed1-1af6-4146-8084-1eaaafd9a7f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d43cfae69894d33a5cc8eefc9f7cbfb'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:09:55.309074 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1107/2274] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Oct 14 13:09:55 2022] DELETE /identity/v3/users/0d43cfae69894d33a5cc8eefc9f7cbfb => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:09:55.313643 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d949dd-8707-41e7-934b-a12565469bab None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:09:55.313934 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d949dd-8707-41e7-934b-a12565469bab None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:09:55.314511 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d949dd-8707-41e7-934b-a12565469bab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:09:55.333325 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-c4d949dd-8707-41e7-934b-a12565469bab None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:09:55.335287 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-c4d949dd-8707-41e7-934b-a12565469bab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:09:55.339185 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:09:55.396607 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1168/2275] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:09:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:09:55.406259 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c77ed1-1af6-4146-8084-1eaaafd9a7f9 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:09:55.407662 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-b9c77ed1-1af6-4146-8084-1eaaafd9a7f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:09:55.465783 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c77ed1-1af6-4146-8084-1eaaafd9a7f9 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:09:55.469800 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ad52ed-4b5c-44f8-963e-85a7ac2b7479 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d483292f3a4794848fcacfba5b107e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:09:55.470374 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ad52ed-4b5c-44f8-963e-85a7ac2b7479 service neutron] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:09:55.470653 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ad52ed-4b5c-44f8-963e-85a7ac2b7479 service neutron] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:09:55.470925 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ad52ed-4b5c-44f8-963e-85a7ac2b7479 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:09:55.480442 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ad52ed-4b5c-44f8-963e-85a7ac2b7479 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:09:55.481869 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ad52ed-4b5c-44f8-963e-85a7ac2b7479 service neutron] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:09:55.491943 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1108/2276] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:09:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:09:55.770177 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d949dd-8707-41e7-934b-a12565469bab None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:09:55.772739 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-c4d949dd-8707-41e7-934b-a12565469bab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:09:55.786163 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d949dd-8707-41e7-934b-a12565469bab None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:09:55.792990 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bbde20-5a89-47a7-b5c7-34921edd5c38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:09:55.793789 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bbde20-5a89-47a7-b5c7-34921edd5c38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:09:55.794232 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bbde20-5a89-47a7-b5c7-34921edd5c38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:09:55.794617 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bbde20-5a89-47a7-b5c7-34921edd5c38 admin admin] PATH_INFO: `/v3/projects/353853d6e4ce4add9ab93fc66e3d4f33` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:09:55.795869 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bbde20-5a89-47a7-b5c7-34921edd5c38 admin admin] RBAC: Authorizing `identity:delete_project(project_id=353853d6e4ce4add9ab93fc66e3d4f33)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:09:55.797887 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bbde20-5a89-47a7-b5c7-34921edd5c38 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:09:55.851923 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-b5bbde20-5a89-47a7-b5c7-34921edd5c38 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '353853d6e4ce4add9ab93fc66e3d4f33', 'request_id': 'req-b5bbde20-5a89-47a7-b5c7-34921edd5c38'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:09:55.857520 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-b5bbde20-5a89-47a7-b5c7-34921edd5c38 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '353853d6e4ce4add9ab93fc66e3d4f33', 'request_id': 'req-b5bbde20-5a89-47a7-b5c7-34921edd5c38'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:09:55.864391 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-b5bbde20-5a89-47a7-b5c7-34921edd5c38 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '353853d6e4ce4add9ab93fc66e3d4f33', 'request_id': 'req-b5bbde20-5a89-47a7-b5c7-34921edd5c38'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:09:55.876941 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-b5bbde20-5a89-47a7-b5c7-34921edd5c38 admin admin] The token cache is being invalidate because project 353853d6e4ce4add9ab93fc66e3d4f33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:09:55.877232 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-b5bbde20-5a89-47a7-b5c7-34921edd5c38 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:09:55.877883 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-b5bbde20-5a89-47a7-b5c7-34921edd5c38 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:09:55.879352 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1169/2277] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Oct 14 13:09:55 2022] DELETE /identity/v3/projects/353853d6e4ce4add9ab93fc66e3d4f33 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:09:55.884335 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5a9b10-cbad-41eb-a4f6-994f6ed12d60 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:09:55.884627 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5a9b10-cbad-41eb-a4f6-994f6ed12d60 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:09:55.884914 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5a9b10-cbad-41eb-a4f6-994f6ed12d60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:09:55.905624 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-7d5a9b10-cbad-41eb-a4f6-994f6ed12d60 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:09:55.906922 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-7d5a9b10-cbad-41eb-a4f6-994f6ed12d60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:09:55.971196 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1109/2278] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:09:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 13:09:55.981124 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f265da71-45cd-4495-bf62-eb2a7493bed3 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:09:55.981351 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f265da71-45cd-4495-bf62-eb2a7493bed3 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:09:55.981607 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f265da71-45cd-4495-bf62-eb2a7493bed3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:09:56.002617 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-f265da71-45cd-4495-bf62-eb2a7493bed3 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:09:56.003841 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-f265da71-45cd-4495-bf62-eb2a7493bed3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:09:56.013495 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1170/2279] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:09:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:09:56.017679 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5a9b10-cbad-41eb-a4f6-994f6ed12d60 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:09:56.028131 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5a9b10-cbad-41eb-a4f6-994f6ed12d60 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:09:56.033017 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88341a65-5491-4091-bba8-128e7cdfdf83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:09:56.033750 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88341a65-5491-4091-bba8-128e7cdfdf83 admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:09:56.034141 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88341a65-5491-4091-bba8-128e7cdfdf83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:09:56.034528 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88341a65-5491-4091-bba8-128e7cdfdf83 admin admin] PATH_INFO: `/v3/domains` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:09:56.035309 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88341a65-5491-4091-bba8-128e7cdfdf83 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 13:09:56.035699 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88341a65-5491-4091-bba8-128e7cdfdf83 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:09:56.037315 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88341a65-5491-4091-bba8-128e7cdfdf83 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:09:56.052391 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1110/2280] 10.222.0.17 () {58 vars in 1153 bytes} [Fri Oct 14 13:09:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 13:09:56.053542 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f265da71-45cd-4495-bf62-eb2a7493bed3 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:09:56.062911 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f265da71-45cd-4495-bf62-eb2a7493bed3 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:09:56.067693 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711d8657-08a5-41b8-a05f-f3ef41f1f863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:09:56.069087 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711d8657-08a5-41b8-a05f-f3ef41f1f863 admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:09:56.069370 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711d8657-08a5-41b8-a05f-f3ef41f1f863 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:09:56.069645 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711d8657-08a5-41b8-a05f-f3ef41f1f863 admin admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:09:56.070434 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711d8657-08a5-41b8-a05f-f3ef41f1f863 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:09:56.072385 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711d8657-08a5-41b8-a05f-f3ef41f1f863 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:09:56.101080 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1171/2281] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Oct 14 13:09:56 2022] POST /identity/v3/projects => generated 377 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:09:56.105199 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88341a65-5491-4091-bba8-128e7cdfdf83 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:09:56.115174 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88341a65-5491-4091-bba8-128e7cdfdf83 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:09:56.162214 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:09:56.172640 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc052f3a-72db-4b57-8926-2c2240310920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:09:56.173642 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc052f3a-72db-4b57-8926-2c2240310920 admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:09:56.174272 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc052f3a-72db-4b57-8926-2c2240310920 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:09:56.174719 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc052f3a-72db-4b57-8926-2c2240310920 admin admin] PATH_INFO: `/v3/users` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:09:56.175371 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc052f3a-72db-4b57-8926-2c2240310920 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:09:56.177442 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc052f3a-72db-4b57-8926-2c2240310920 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:09:56.198840 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1111/2282] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Oct 14 13:09:56 2022] POST /identity/v3/users => generated 289 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:09:56.203556 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711d8657-08a5-41b8-a05f-f3ef41f1f863 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:09:56.214386 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711d8657-08a5-41b8-a05f-f3ef41f1f863 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:09:56.219722 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0138cd1-1c91-4ecb-b9ee-1fc3d4276329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:09:56.220314 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0138cd1-1c91-4ecb-b9ee-1fc3d4276329 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:09:56.220587 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0138cd1-1c91-4ecb-b9ee-1fc3d4276329 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:09:56.220855 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0138cd1-1c91-4ecb-b9ee-1fc3d4276329 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:09:56.221492 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0138cd1-1c91-4ecb-b9ee-1fc3d4276329 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:09:56.223114 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0138cd1-1c91-4ecb-b9ee-1fc3d4276329 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:09:56.233644 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1172/2283] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:09:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:09:56.238032 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc052f3a-72db-4b57-8926-2c2240310920 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:09:56.248607 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc052f3a-72db-4b57-8926-2c2240310920 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:09:56.253244 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49986c3-9376-4eb5-ad5f-c0b89a8bf7c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:09:56.253836 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49986c3-9376-4eb5-ad5f-c0b89a8bf7c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:09:56.254143 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49986c3-9376-4eb5-ad5f-c0b89a8bf7c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:09:56.254427 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49986c3-9376-4eb5-ad5f-c0b89a8bf7c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:09:56.255073 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49986c3-9376-4eb5-ad5f-c0b89a8bf7c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:09:56.257212 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49986c3-9376-4eb5-ad5f-c0b89a8bf7c9 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:09:56.267873 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1112/2284] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:09:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:09:56.272565 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0138cd1-1c91-4ecb-b9ee-1fc3d4276329 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:09:56.282539 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0138cd1-1c91-4ecb-b9ee-1fc3d4276329 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:09:56.287245 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eafe940-4f31-4bc7-afeb-0fd1a0eba7c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:09:56.287885 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eafe940-4f31-4bc7-afeb-0fd1a0eba7c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:09:56.288155 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eafe940-4f31-4bc7-afeb-0fd1a0eba7c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:09:56.288430 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eafe940-4f31-4bc7-afeb-0fd1a0eba7c9 admin admin] PATH_INFO: `/v3/projects/8e12c36b0e1047ec9c075a36ab65d17c/users/36da803a1ede4194a68fd7e82a9e6ccc/roles/5e8849303a75425b9eaa2681cc031af1` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:09:56.304422 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eafe940-4f31-4bc7-afeb-0fd1a0eba7c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e12c36b0e1047ec9c075a36ab65d17c, user_id=36da803a1ede4194a68fd7e82a9e6ccc, role_id=5e8849303a75425b9eaa2681cc031af1)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:09:56.307202 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eafe940-4f31-4bc7-afeb-0fd1a0eba7c9 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:09:56.320290 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1173/2285] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Oct 14 13:09:56 2022] PUT /identity/v3/projects/8e12c36b0e1047ec9c075a36ab65d17c/users/36da803a1ede4194a68fd7e82a9e6ccc/roles/5e8849303a75425b9eaa2681cc031af1 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:09:56.330457 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af011327-2b0e-42e2-bd8f-246cb5a4d900 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:09:56.330743 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af011327-2b0e-42e2-bd8f-246cb5a4d900 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:09:56.331017 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af011327-2b0e-42e2-bd8f-246cb5a4d900 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:09:56.358350 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-af011327-2b0e-42e2-bd8f-246cb5a4d900 None None] MFA Rules not processed for user `36da803a1ede4194a68fd7e82a9e6ccc`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:09:56.359593 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-af011327-2b0e-42e2-bd8f-246cb5a4d900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:09:56.422656 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1113/2286] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:09:56 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:09:56.427223 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eafe940-4f31-4bc7-afeb-0fd1a0eba7c9 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:09:56.458537 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:09:56.490714 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eafe940-4f31-4bc7-afeb-0fd1a0eba7c9 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:09:56.495349 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb04cfe-5d64-4fc9-9ca2-6220d477ad5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:09:56.495944 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb04cfe-5d64-4fc9-9ca2-6220d477ad5a admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:09:56.496219 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb04cfe-5d64-4fc9-9ca2-6220d477ad5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:09:56.496489 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb04cfe-5d64-4fc9-9ca2-6220d477ad5a admin admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:09:56.497106 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb04cfe-5d64-4fc9-9ca2-6220d477ad5a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:09:56.499049 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb04cfe-5d64-4fc9-9ca2-6220d477ad5a admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:09:56.525102 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1174/2287] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Oct 14 13:09:56 2022] POST /identity/v3/projects => generated 375 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 13:09:56.529134 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af011327-2b0e-42e2-bd8f-246cb5a4d900 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:09:56.539966 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af011327-2b0e-42e2-bd8f-246cb5a4d900 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:09:56.595419 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d487fa-e074-4eb9-a0be-bab5ca22c8b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:09:56.596023 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d487fa-e074-4eb9-a0be-bab5ca22c8b8 admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:09:56.596302 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d487fa-e074-4eb9-a0be-bab5ca22c8b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:09:56.596570 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d487fa-e074-4eb9-a0be-bab5ca22c8b8 admin admin] PATH_INFO: `/v3/users` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:09:56.597205 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d487fa-e074-4eb9-a0be-bab5ca22c8b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:09:56.599184 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d487fa-e074-4eb9-a0be-bab5ca22c8b8 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:09:56.620748 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1114/2288] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Oct 14 13:09:56 2022] POST /identity/v3/users => generated 288 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:09:56.624715 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb04cfe-5d64-4fc9-9ca2-6220d477ad5a admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:09:56.636777 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb04cfe-5d64-4fc9-9ca2-6220d477ad5a admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:09:56.641447 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0397f9a-ab98-4d62-9c17-2ae9c1b955e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:09:56.642041 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0397f9a-ab98-4d62-9c17-2ae9c1b955e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:09:56.642351 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0397f9a-ab98-4d62-9c17-2ae9c1b955e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:09:56.642623 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0397f9a-ab98-4d62-9c17-2ae9c1b955e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:09:56.643262 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0397f9a-ab98-4d62-9c17-2ae9c1b955e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:09:56.644886 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0397f9a-ab98-4d62-9c17-2ae9c1b955e6 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:09:56.655626 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1175/2289] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:09:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 14 13:09:56.659789 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d487fa-e074-4eb9-a0be-bab5ca22c8b8 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:09:56.670020 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d487fa-e074-4eb9-a0be-bab5ca22c8b8 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:09:56.674884 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564c5012-738e-4236-becf-397b4f624a9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:09:56.675471 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564c5012-738e-4236-becf-397b4f624a9c admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:09:56.675751 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564c5012-738e-4236-becf-397b4f624a9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:09:56.676024 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564c5012-738e-4236-becf-397b4f624a9c admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:09:56.676665 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564c5012-738e-4236-becf-397b4f624a9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:09:56.679116 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564c5012-738e-4236-becf-397b4f624a9c admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:09:56.688849 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1115/2290] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:09:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:09:56.693023 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0397f9a-ab98-4d62-9c17-2ae9c1b955e6 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:09:56.703625 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0397f9a-ab98-4d62-9c17-2ae9c1b955e6 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:09:56.708205 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e0555f-efc8-4cb5-bee8-277ead458fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:09:56.708850 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e0555f-efc8-4cb5-bee8-277ead458fc1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:09:56.709187 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e0555f-efc8-4cb5-bee8-277ead458fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:09:56.709566 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e0555f-efc8-4cb5-bee8-277ead458fc1 admin admin] PATH_INFO: `/v3/projects/e2cd28c005184424860517a5a8e5f141/users/2c2809da5fd042ac8587ee2d887e4db7/roles/5e8849303a75425b9eaa2681cc031af1` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:09:56.726251 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e0555f-efc8-4cb5-bee8-277ead458fc1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2cd28c005184424860517a5a8e5f141, user_id=2c2809da5fd042ac8587ee2d887e4db7, role_id=5e8849303a75425b9eaa2681cc031af1)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:09:56.728999 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e0555f-efc8-4cb5-bee8-277ead458fc1 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:09:56.741827 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1176/2291] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Oct 14 13:09:56 2022] PUT /identity/v3/projects/e2cd28c005184424860517a5a8e5f141/users/2c2809da5fd042ac8587ee2d887e4db7/roles/5e8849303a75425b9eaa2681cc031af1 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:09:56.752099 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09e8a97-02ba-4edc-abe4-7e919365e282 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:09:56.752391 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09e8a97-02ba-4edc-abe4-7e919365e282 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:09:56.752669 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09e8a97-02ba-4edc-abe4-7e919365e282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:09:56.780551 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-b09e8a97-02ba-4edc-abe4-7e919365e282 None None] MFA Rules not processed for user `2c2809da5fd042ac8587ee2d887e4db7`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:09:56.781770 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-b09e8a97-02ba-4edc-abe4-7e919365e282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:09:56.811153 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:09:56.846515 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1116/2292] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:09:56 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:09:56.851595 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e0555f-efc8-4cb5-bee8-277ead458fc1 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:09:56.915337 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e0555f-efc8-4cb5-bee8-277ead458fc1 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:09:56.920038 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c95e9d-6190-4d22-a579-408c27ea6cbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:09:56.920645 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c95e9d-6190-4d22-a579-408c27ea6cbd admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:09:56.920928 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c95e9d-6190-4d22-a579-408c27ea6cbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:09:56.921205 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c95e9d-6190-4d22-a579-408c27ea6cbd admin admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:09:56.921847 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c95e9d-6190-4d22-a579-408c27ea6cbd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:09:56.923825 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c95e9d-6190-4d22-a579-408c27ea6cbd admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:09:56.955772 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1177/2293] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Oct 14 13:09:56 2022] POST /identity/v3/projects => generated 377 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:09:56.956919 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09e8a97-02ba-4edc-abe4-7e919365e282 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:09:56.969556 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09e8a97-02ba-4edc-abe4-7e919365e282 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:09:57.035128 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fe80ea-6d2b-4746-9cb9-ca6fdbe5c1c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:09:57.035726 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fe80ea-6d2b-4746-9cb9-ca6fdbe5c1c1 admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:09:57.036013 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fe80ea-6d2b-4746-9cb9-ca6fdbe5c1c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:09:57.036315 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fe80ea-6d2b-4746-9cb9-ca6fdbe5c1c1 admin admin] PATH_INFO: `/v3/users` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:09:57.037503 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fe80ea-6d2b-4746-9cb9-ca6fdbe5c1c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:09:57.039658 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fe80ea-6d2b-4746-9cb9-ca6fdbe5c1c1 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:09:57.065388 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1117/2294] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Oct 14 13:09:56 2022] POST /identity/v3/users => generated 295 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:09:57.067061 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c95e9d-6190-4d22-a579-408c27ea6cbd admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:09:57.079661 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c95e9d-6190-4d22-a579-408c27ea6cbd admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:09:57.085568 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17743a46-06fc-4899-9659-67e07a851c92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:09:57.086365 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17743a46-06fc-4899-9659-67e07a851c92 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:09:57.086712 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17743a46-06fc-4899-9659-67e07a851c92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:09:57.087064 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17743a46-06fc-4899-9659-67e07a851c92 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:09:57.087897 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17743a46-06fc-4899-9659-67e07a851c92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:09:57.089676 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17743a46-06fc-4899-9659-67e07a851c92 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:09:57.103318 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1178/2295] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:09:57 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 14 13:09:57.107764 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fe80ea-6d2b-4746-9cb9-ca6fdbe5c1c1 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:09:57.119053 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fe80ea-6d2b-4746-9cb9-ca6fdbe5c1c1 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:09:57.124495 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19d372b-d82e-43f9-b6a5-7cf8f55f8efb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:09:57.125297 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19d372b-d82e-43f9-b6a5-7cf8f55f8efb admin admin] REQUEST_METHOD: `PUT` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:09:57.125579 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19d372b-d82e-43f9-b6a5-7cf8f55f8efb admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:09:57.125931 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19d372b-d82e-43f9-b6a5-7cf8f55f8efb admin admin] PATH_INFO: `/v3/projects/ce061cb3153c4bbea1e16124e9aa7abc/users/329e9c8b61924f64aa1b0d9b043268d5/roles/7f6e29e390bc41f7a9af17659a2e95d1` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:09:57.147762 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19d372b-d82e-43f9-b6a5-7cf8f55f8efb admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce061cb3153c4bbea1e16124e9aa7abc, user_id=329e9c8b61924f64aa1b0d9b043268d5, role_id=7f6e29e390bc41f7a9af17659a2e95d1)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:09:57.150416 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19d372b-d82e-43f9-b6a5-7cf8f55f8efb admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:09:57.164792 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1118/2296] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Oct 14 13:09:57 2022] PUT /identity/v3/projects/ce061cb3153c4bbea1e16124e9aa7abc/users/329e9c8b61924f64aa1b0d9b043268d5/roles/7f6e29e390bc41f7a9af17659a2e95d1 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:09:57.168799 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17743a46-06fc-4899-9659-67e07a851c92 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:09:57.178817 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17743a46-06fc-4899-9659-67e07a851c92 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:09:57.230975 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:09:57.247632 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed294a40-bb9a-412e-b27e-2a0d4f20dd13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:09:57.248603 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed294a40-bb9a-412e-b27e-2a0d4f20dd13 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:09:57.249088 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed294a40-bb9a-412e-b27e-2a0d4f20dd13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:09:57.249499 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed294a40-bb9a-412e-b27e-2a0d4f20dd13 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:09:57.251058 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed294a40-bb9a-412e-b27e-2a0d4f20dd13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:09:57.252850 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed294a40-bb9a-412e-b27e-2a0d4f20dd13 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:09:57.265836 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1179/2297] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:09:57 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 14 13:09:57.270018 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19d372b-d82e-43f9-b6a5-7cf8f55f8efb admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:09:57.282148 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19d372b-d82e-43f9-b6a5-7cf8f55f8efb admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:09:57.287464 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65663d22-ce8b-46e2-9d04-3b1069e5407a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:09:57.290536 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65663d22-ce8b-46e2-9d04-3b1069e5407a admin admin] REQUEST_METHOD: `PUT` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:09:57.290821 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65663d22-ce8b-46e2-9d04-3b1069e5407a admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:09:57.291098 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65663d22-ce8b-46e2-9d04-3b1069e5407a admin admin] PATH_INFO: `/v3/projects/ce061cb3153c4bbea1e16124e9aa7abc/users/329e9c8b61924f64aa1b0d9b043268d5/roles/7f6e29e390bc41f7a9af17659a2e95d1` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:09:57.293352 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65663d22-ce8b-46e2-9d04-3b1069e5407a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce061cb3153c4bbea1e16124e9aa7abc, user_id=329e9c8b61924f64aa1b0d9b043268d5, role_id=7f6e29e390bc41f7a9af17659a2e95d1)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:09:57.296066 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65663d22-ce8b-46e2-9d04-3b1069e5407a admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:09:57.308612 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1119/2298] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Oct 14 13:09:57 2022] PUT /identity/v3/projects/ce061cb3153c4bbea1e16124e9aa7abc/users/329e9c8b61924f64aa1b0d9b043268d5/roles/7f6e29e390bc41f7a9af17659a2e95d1 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:09:57.378878 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c93f74-7235-4e0a-a1ba-2e5c07f7b319 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:09:57.379378 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c93f74-7235-4e0a-a1ba-2e5c07f7b319 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:09:57.379494 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c93f74-7235-4e0a-a1ba-2e5c07f7b319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:09:57.415723 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-73c93f74-7235-4e0a-a1ba-2e5c07f7b319 None None] MFA Rules not processed for user `329e9c8b61924f64aa1b0d9b043268d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:09:57.416928 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-73c93f74-7235-4e0a-a1ba-2e5c07f7b319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:09:57.488116 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1180/2299] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:09:57 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:09:57.500917 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65663d22-ce8b-46e2-9d04-3b1069e5407a admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:09:57.502590 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-65663d22-ce8b-46e2-9d04-3b1069e5407a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:09:57.559155 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65663d22-ce8b-46e2-9d04-3b1069e5407a admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:09:57.562812 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd007ee-01bc-4a77-8614-dc7f276c391d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c3c564b8c548e4beef1cbfba2ad343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:09:57.563409 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd007ee-01bc-4a77-8614-dc7f276c391d service cinder] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:09:57.563689 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd007ee-01bc-4a77-8614-dc7f276c391d service cinder] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:09:57.563963 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd007ee-01bc-4a77-8614-dc7f276c391d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:09:57.596731 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:09:57.621015 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd007ee-01bc-4a77-8614-dc7f276c391d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:09:57.622488 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd007ee-01bc-4a77-8614-dc7f276c391d service cinder] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:09:57.631483 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1120/2300] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:09:57 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:09:59.170246 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c93f74-7235-4e0a-a1ba-2e5c07f7b319 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:09:59.171764 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-73c93f74-7235-4e0a-a1ba-2e5c07f7b319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:09:59.184063 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c93f74-7235-4e0a-a1ba-2e5c07f7b319 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:09:59.187585 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4896c0-dccf-4481-9b31-d5c459cad655 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c3c564b8c548e4beef1cbfba2ad343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:09:59.188177 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4896c0-dccf-4481-9b31-d5c459cad655 service cinder] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:09:59.188456 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4896c0-dccf-4481-9b31-d5c459cad655 service cinder] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:09:59.188727 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4896c0-dccf-4481-9b31-d5c459cad655 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:09:59.251983 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4896c0-dccf-4481-9b31-d5c459cad655 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:09:59.253472 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4896c0-dccf-4481-9b31-d5c459cad655 service cinder] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:09:59.263508 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1181/2301] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:09:59 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:09:59.903488 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd007ee-01bc-4a77-8614-dc7f276c391d service cinder] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:09:59.904922 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-1bd007ee-01bc-4a77-8614-dc7f276c391d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:09:59.963377 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4896c0-dccf-4481-9b31-d5c459cad655 service cinder] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:09:59.972218 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4896c0-dccf-4481-9b31-d5c459cad655 service cinder] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:09:59.975786 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd007ee-01bc-4a77-8614-dc7f276c391d service cinder] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:09:59.976309 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf48a0c9-53ce-4250-b487-fda266244664 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c3c564b8c548e4beef1cbfba2ad343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:09:59.976902 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf48a0c9-53ce-4250-b487-fda266244664 service cinder] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:09:59.977248 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf48a0c9-53ce-4250-b487-fda266244664 service cinder] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:09:59.977457 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf48a0c9-53ce-4250-b487-fda266244664 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:09:59.980412 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2091d767-788b-46de-9544-3eda309cfdfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:09:59.981033 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2091d767-788b-46de-9544-3eda309cfdfd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:09:59.981310 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2091d767-788b-46de-9544-3eda309cfdfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:09:59.981580 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2091d767-788b-46de-9544-3eda309cfdfd admin admin] PATH_INFO: `/v3/users/af78c673e50046deb0232b18048a5a7e` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:09:59.982724 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2091d767-788b-46de-9544-3eda309cfdfd admin admin] RBAC: Authorizing `identity:delete_user(user_id=af78c673e50046deb0232b18048a5a7e)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:09:59.984636 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2091d767-788b-46de-9544-3eda309cfdfd admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:09:59.986498 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf48a0c9-53ce-4250-b487-fda266244664 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:09:59.987864 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf48a0c9-53ce-4250-b487-fda266244664 service cinder] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:09:59.997403 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1182/2302] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:09:59 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 14 13:10:00.034372 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-2091d767-788b-46de-9544-3eda309cfdfd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af78c673e50046deb0232b18048a5a7e'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:10:00.041694 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-2091d767-788b-46de-9544-3eda309cfdfd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af78c673e50046deb0232b18048a5a7e'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:10:00.042430 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-2091d767-788b-46de-9544-3eda309cfdfd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af78c673e50046deb0232b18048a5a7e'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:10:00.051010 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-2091d767-788b-46de-9544-3eda309cfdfd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af78c673e50046deb0232b18048a5a7e'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:10:00.066067 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-2091d767-788b-46de-9544-3eda309cfdfd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af78c673e50046deb0232b18048a5a7e'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:10:00.075944 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1121/2303] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Oct 14 13:09:59 2022] DELETE /identity/v3/users/af78c673e50046deb0232b18048a5a7e => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:10:00.080711 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00621107-824f-495f-89a1-7d162fbe37a0 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:10:00.081186 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00621107-824f-495f-89a1-7d162fbe37a0 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:10:00.081372 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00621107-824f-495f-89a1-7d162fbe37a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:10:00.106731 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-00621107-824f-495f-89a1-7d162fbe37a0 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:10:00.107980 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-00621107-824f-495f-89a1-7d162fbe37a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:10:00.159508 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:10:00.168975 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1183/2304] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:10:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:10:00.179855 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2091d767-788b-46de-9544-3eda309cfdfd admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:10:00.181350 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-2091d767-788b-46de-9544-3eda309cfdfd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:10:00.241630 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2091d767-788b-46de-9544-3eda309cfdfd admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:10:00.245168 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243b2e16-de25-4a36-be9f-9c213084b06a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d483292f3a4794848fcacfba5b107e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:10:00.245768 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243b2e16-de25-4a36-be9f-9c213084b06a service neutron] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:10:00.246051 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243b2e16-de25-4a36-be9f-9c213084b06a service neutron] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:10:00.246356 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243b2e16-de25-4a36-be9f-9c213084b06a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:10:00.255320 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243b2e16-de25-4a36-be9f-9c213084b06a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:10:00.257325 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243b2e16-de25-4a36-be9f-9c213084b06a service neutron] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:10:00.261232 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:10:00.270388 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1122/2305] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:10:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 14 13:10:00.547370 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00621107-824f-495f-89a1-7d162fbe37a0 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:10:00.548865 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-00621107-824f-495f-89a1-7d162fbe37a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:10:00.562062 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00621107-824f-495f-89a1-7d162fbe37a0 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:10:00.566694 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286dfb41-b0a1-4c6a-9fba-3909675d2bf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:10:00.567525 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286dfb41-b0a1-4c6a-9fba-3909675d2bf9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:10:00.568404 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286dfb41-b0a1-4c6a-9fba-3909675d2bf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:10:00.568968 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286dfb41-b0a1-4c6a-9fba-3909675d2bf9 admin admin] PATH_INFO: `/v3/projects/f4e165fbbbb140f5957f97d152a35a26` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:10:00.570185 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286dfb41-b0a1-4c6a-9fba-3909675d2bf9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4e165fbbbb140f5957f97d152a35a26)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:10:00.572196 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286dfb41-b0a1-4c6a-9fba-3909675d2bf9 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:10:00.625687 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-286dfb41-b0a1-4c6a-9fba-3909675d2bf9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4e165fbbbb140f5957f97d152a35a26', 'request_id': 'req-286dfb41-b0a1-4c6a-9fba-3909675d2bf9'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:10:00.632096 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-286dfb41-b0a1-4c6a-9fba-3909675d2bf9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4e165fbbbb140f5957f97d152a35a26', 'request_id': 'req-286dfb41-b0a1-4c6a-9fba-3909675d2bf9'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:10:00.638483 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-286dfb41-b0a1-4c6a-9fba-3909675d2bf9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4e165fbbbb140f5957f97d152a35a26', 'request_id': 'req-286dfb41-b0a1-4c6a-9fba-3909675d2bf9'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:10:00.655016 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-286dfb41-b0a1-4c6a-9fba-3909675d2bf9 admin admin] The token cache is being invalidate because project f4e165fbbbb140f5957f97d152a35a26 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:10:00.655303 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-286dfb41-b0a1-4c6a-9fba-3909675d2bf9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:10:00.655940 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-286dfb41-b0a1-4c6a-9fba-3909675d2bf9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:10:00.657455 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1184/2306] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Oct 14 13:10:00 2022] DELETE /identity/v3/projects/f4e165fbbbb140f5957f97d152a35a26 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:10:00.661583 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243b2e16-de25-4a36-be9f-9c213084b06a service neutron] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:10:00.671630 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243b2e16-de25-4a36-be9f-9c213084b06a service neutron] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:10:00.729764 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1283fdaa-1604-404e-89ef-9da2199fad52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:10:00.730413 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1283fdaa-1604-404e-89ef-9da2199fad52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:10:00.730694 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1283fdaa-1604-404e-89ef-9da2199fad52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:10:00.730968 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1283fdaa-1604-404e-89ef-9da2199fad52 admin admin] PATH_INFO: `/v3/users/fdba4035271342feb20d437e33e819da` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:10:00.732099 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1283fdaa-1604-404e-89ef-9da2199fad52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fdba4035271342feb20d437e33e819da)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:10:00.734018 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1283fdaa-1604-404e-89ef-9da2199fad52 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:10:00.779679 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-1283fdaa-1604-404e-89ef-9da2199fad52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fdba4035271342feb20d437e33e819da'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:10:00.788016 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-1283fdaa-1604-404e-89ef-9da2199fad52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fdba4035271342feb20d437e33e819da'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:10:00.788698 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-1283fdaa-1604-404e-89ef-9da2199fad52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fdba4035271342feb20d437e33e819da'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:10:00.795949 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-1283fdaa-1604-404e-89ef-9da2199fad52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fdba4035271342feb20d437e33e819da'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:10:00.808469 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-1283fdaa-1604-404e-89ef-9da2199fad52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fdba4035271342feb20d437e33e819da'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:10:00.814211 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1123/2307] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Oct 14 13:10:00 2022] DELETE /identity/v3/users/fdba4035271342feb20d437e33e819da => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:10:01.074060 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286dfb41-b0a1-4c6a-9fba-3909675d2bf9 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:10:01.075515 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-286dfb41-b0a1-4c6a-9fba-3909675d2bf9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:10:01.089643 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286dfb41-b0a1-4c6a-9fba-3909675d2bf9 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:10:01.151594 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8654632-fff9-4e80-b7fd-a2e6f49407dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:10:01.152235 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8654632-fff9-4e80-b7fd-a2e6f49407dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:10:01.152518 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8654632-fff9-4e80-b7fd-a2e6f49407dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:10:01.152797 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8654632-fff9-4e80-b7fd-a2e6f49407dc admin admin] PATH_INFO: `/v3/projects/2d84628962054d12a597919e45261b9c` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:10:01.153945 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8654632-fff9-4e80-b7fd-a2e6f49407dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d84628962054d12a597919e45261b9c)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:10:01.155860 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8654632-fff9-4e80-b7fd-a2e6f49407dc admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:10:01.203377 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-c8654632-fff9-4e80-b7fd-a2e6f49407dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d84628962054d12a597919e45261b9c', 'request_id': 'req-c8654632-fff9-4e80-b7fd-a2e6f49407dc'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:10:01.209724 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-c8654632-fff9-4e80-b7fd-a2e6f49407dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d84628962054d12a597919e45261b9c', 'request_id': 'req-c8654632-fff9-4e80-b7fd-a2e6f49407dc'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:10:01.215920 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-c8654632-fff9-4e80-b7fd-a2e6f49407dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d84628962054d12a597919e45261b9c', 'request_id': 'req-c8654632-fff9-4e80-b7fd-a2e6f49407dc'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:10:01.230692 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-c8654632-fff9-4e80-b7fd-a2e6f49407dc admin admin] The token cache is being invalidate because project 2d84628962054d12a597919e45261b9c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:10:01.230983 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-c8654632-fff9-4e80-b7fd-a2e6f49407dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:10:01.231656 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-c8654632-fff9-4e80-b7fd-a2e6f49407dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:10:01.233280 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1185/2308] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Oct 14 13:10:01 2022] DELETE /identity/v3/projects/2d84628962054d12a597919e45261b9c => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:10:01.238219 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a768f744-7387-43e5-bd4e-96e8b03dfde3 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:10:01.238693 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a768f744-7387-43e5-bd4e-96e8b03dfde3 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:10:01.238812 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a768f744-7387-43e5-bd4e-96e8b03dfde3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:10:01.258881 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-a768f744-7387-43e5-bd4e-96e8b03dfde3 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:10:01.260225 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-a768f744-7387-43e5-bd4e-96e8b03dfde3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:10:01.324025 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1124/2309] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:10:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 13:10:01.332444 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017ac881-c215-4b2c-a199-fc5491f27c0a None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:10:01.332751 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017ac881-c215-4b2c-a199-fc5491f27c0a None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:10:01.333031 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017ac881-c215-4b2c-a199-fc5491f27c0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:10:01.360999 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-017ac881-c215-4b2c-a199-fc5491f27c0a None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:10:01.362257 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-017ac881-c215-4b2c-a199-fc5491f27c0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:10:01.371776 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1186/2310] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:10:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 13:10:01.376042 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a768f744-7387-43e5-bd4e-96e8b03dfde3 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:10:01.386584 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a768f744-7387-43e5-bd4e-96e8b03dfde3 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:10:01.392507 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfd81f6-f467-4f9a-aef3-e73e82b9a6cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:10:01.393196 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfd81f6-f467-4f9a-aef3-e73e82b9a6cd admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:10:01.393544 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfd81f6-f467-4f9a-aef3-e73e82b9a6cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:10:01.393883 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfd81f6-f467-4f9a-aef3-e73e82b9a6cd admin admin] PATH_INFO: `/v3/domains` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:10:01.394654 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfd81f6-f467-4f9a-aef3-e73e82b9a6cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 13:10:01.395047 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfd81f6-f467-4f9a-aef3-e73e82b9a6cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:10:01.397762 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfd81f6-f467-4f9a-aef3-e73e82b9a6cd admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:10:01.412410 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1125/2311] 10.222.0.17 () {58 vars in 1153 bytes} [Fri Oct 14 13:10:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 13:10:01.416932 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017ac881-c215-4b2c-a199-fc5491f27c0a None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:10:01.426197 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017ac881-c215-4b2c-a199-fc5491f27c0a None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:10:01.431578 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6dbced-6869-4ecc-9e31-f575e1beed70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:10:01.432183 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6dbced-6869-4ecc-9e31-f575e1beed70 admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:10:01.432460 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6dbced-6869-4ecc-9e31-f575e1beed70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:10:01.432734 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6dbced-6869-4ecc-9e31-f575e1beed70 admin admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:10:01.433477 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6dbced-6869-4ecc-9e31-f575e1beed70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:10:01.435713 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6dbced-6869-4ecc-9e31-f575e1beed70 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:10:01.440875 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:10:01.465791 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1187/2312] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Oct 14 13:10:01 2022] POST /identity/v3/projects => generated 365 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:10:01.470206 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfd81f6-f467-4f9a-aef3-e73e82b9a6cd admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:10:01.477000 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:10:01.480737 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfd81f6-f467-4f9a-aef3-e73e82b9a6cd admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:10:01.540063 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae030cb7-9fcc-4bdf-b8d0-aee0f40dd74d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:10:01.540665 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae030cb7-9fcc-4bdf-b8d0-aee0f40dd74d admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:10:01.540946 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae030cb7-9fcc-4bdf-b8d0-aee0f40dd74d admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:10:01.541222 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae030cb7-9fcc-4bdf-b8d0-aee0f40dd74d admin admin] PATH_INFO: `/v3/users` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:10:01.541845 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae030cb7-9fcc-4bdf-b8d0-aee0f40dd74d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:10:01.543853 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae030cb7-9fcc-4bdf-b8d0-aee0f40dd74d admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:10:01.568382 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1126/2313] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Oct 14 13:10:01 2022] POST /identity/v3/users => generated 283 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:10:01.569828 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6dbced-6869-4ecc-9e31-f575e1beed70 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:10:01.579964 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6dbced-6869-4ecc-9e31-f575e1beed70 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:10:01.585647 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5675eb3-ed31-4ec6-9c41-2e5b26be3d57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:10:01.586271 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5675eb3-ed31-4ec6-9c41-2e5b26be3d57 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:10:01.586552 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5675eb3-ed31-4ec6-9c41-2e5b26be3d57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:10:01.586851 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5675eb3-ed31-4ec6-9c41-2e5b26be3d57 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:10:01.587491 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5675eb3-ed31-4ec6-9c41-2e5b26be3d57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:10:01.589090 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5675eb3-ed31-4ec6-9c41-2e5b26be3d57 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:10:01.600188 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1188/2314] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:10:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:10:01.604187 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae030cb7-9fcc-4bdf-b8d0-aee0f40dd74d admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:10:01.613940 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae030cb7-9fcc-4bdf-b8d0-aee0f40dd74d admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:10:01.618627 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042d6194-0029-4b27-ac59-c6686ac296bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:10:01.619206 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042d6194-0029-4b27-ac59-c6686ac296bd admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:10:01.619508 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042d6194-0029-4b27-ac59-c6686ac296bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:10:01.619778 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042d6194-0029-4b27-ac59-c6686ac296bd admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:10:01.620410 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042d6194-0029-4b27-ac59-c6686ac296bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:10:01.622021 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042d6194-0029-4b27-ac59-c6686ac296bd admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:10:01.631797 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1127/2315] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:10:01 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:10:01.635833 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5675eb3-ed31-4ec6-9c41-2e5b26be3d57 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:10:01.646386 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5675eb3-ed31-4ec6-9c41-2e5b26be3d57 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:10:01.651660 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73317c7f-75ea-4193-bf96-5630643a8876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:10:01.652311 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73317c7f-75ea-4193-bf96-5630643a8876 admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:10:01.652593 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73317c7f-75ea-4193-bf96-5630643a8876 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:10:01.652871 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73317c7f-75ea-4193-bf96-5630643a8876 admin admin] PATH_INFO: `/v3/projects/07bfd64884974413a820d44b9fd67134/users/a0bbca729c9544459e492ed18b0e3c2e/roles/5e8849303a75425b9eaa2681cc031af1` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:10:01.672948 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73317c7f-75ea-4193-bf96-5630643a8876 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07bfd64884974413a820d44b9fd67134, user_id=a0bbca729c9544459e492ed18b0e3c2e, role_id=5e8849303a75425b9eaa2681cc031af1)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:10:01.675681 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73317c7f-75ea-4193-bf96-5630643a8876 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:10:01.689976 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1189/2316] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Oct 14 13:10:01 2022] PUT /identity/v3/projects/07bfd64884974413a820d44b9fd67134/users/a0bbca729c9544459e492ed18b0e3c2e/roles/5e8849303a75425b9eaa2681cc031af1 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:10:01.700654 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4de369a-6e3d-4018-8189-7128f919c5d7 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:10:01.701011 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4de369a-6e3d-4018-8189-7128f919c5d7 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:10:01.701293 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4de369a-6e3d-4018-8189-7128f919c5d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:10:01.732321 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-b4de369a-6e3d-4018-8189-7128f919c5d7 None None] MFA Rules not processed for user `a0bbca729c9544459e492ed18b0e3c2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:10:01.733842 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-b4de369a-6e3d-4018-8189-7128f919c5d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:10:01.800131 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1128/2317] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:10:01 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:10:01.807455 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73317c7f-75ea-4193-bf96-5630643a8876 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:10:01.872692 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73317c7f-75ea-4193-bf96-5630643a8876 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:10:01.877733 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877a20ee-a582-429f-ad81-b4a6bf0f16a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:10:01.878358 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877a20ee-a582-429f-ad81-b4a6bf0f16a9 admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:10:01.878739 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877a20ee-a582-429f-ad81-b4a6bf0f16a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:10:01.879154 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877a20ee-a582-429f-ad81-b4a6bf0f16a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:10:01.880028 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877a20ee-a582-429f-ad81-b4a6bf0f16a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:10:01.882491 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877a20ee-a582-429f-ad81-b4a6bf0f16a9 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:10:01.910003 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1190/2318] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Oct 14 13:10:01 2022] POST /identity/v3/projects => generated 363 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:10:01.914799 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4de369a-6e3d-4018-8189-7128f919c5d7 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:10:01.925319 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4de369a-6e3d-4018-8189-7128f919c5d7 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:10:01.981695 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2a2a60-5c18-4ae5-b527-b135351e5558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:10:01.982315 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2a2a60-5c18-4ae5-b527-b135351e5558 admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:10:01.982597 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2a2a60-5c18-4ae5-b527-b135351e5558 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:10:01.982871 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2a2a60-5c18-4ae5-b527-b135351e5558 admin admin] PATH_INFO: `/v3/users` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:10:01.983510 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2a2a60-5c18-4ae5-b527-b135351e5558 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:10:01.985416 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2a2a60-5c18-4ae5-b527-b135351e5558 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:10:02.007245 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1129/2319] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Oct 14 13:10:01 2022] POST /identity/v3/users => generated 288 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:10:02.010828 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877a20ee-a582-429f-ad81-b4a6bf0f16a9 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:10:02.021665 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877a20ee-a582-429f-ad81-b4a6bf0f16a9 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:10:02.026345 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b750bbaf-ac27-434e-9c06-7dfd7b75f27f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:10:02.026941 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b750bbaf-ac27-434e-9c06-7dfd7b75f27f admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:10:02.027225 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b750bbaf-ac27-434e-9c06-7dfd7b75f27f admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:10:02.027501 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b750bbaf-ac27-434e-9c06-7dfd7b75f27f admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:10:02.028137 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b750bbaf-ac27-434e-9c06-7dfd7b75f27f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:10:02.029734 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b750bbaf-ac27-434e-9c06-7dfd7b75f27f admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:10:02.040314 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1191/2320] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:10:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 14 13:10:02.044299 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2a2a60-5c18-4ae5-b527-b135351e5558 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:10:02.049370 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:10:02.056437 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2a2a60-5c18-4ae5-b527-b135351e5558 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:10:02.061020 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3deb64e0-6e07-4c6b-a90d-77f1f6bdfc4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:10:02.061659 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deb64e0-6e07-4c6b-a90d-77f1f6bdfc4b admin admin] REQUEST_METHOD: `PUT` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:10:02.061947 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deb64e0-6e07-4c6b-a90d-77f1f6bdfc4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:10:02.062271 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deb64e0-6e07-4c6b-a90d-77f1f6bdfc4b admin admin] PATH_INFO: `/v3/projects/4ef6941a0b0142839de600dfbdb74b05/users/17be3fb1d3144eb29a789209d0d58ebc/roles/7f6e29e390bc41f7a9af17659a2e95d1` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:10:02.077571 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3deb64e0-6e07-4c6b-a90d-77f1f6bdfc4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ef6941a0b0142839de600dfbdb74b05, user_id=17be3fb1d3144eb29a789209d0d58ebc, role_id=7f6e29e390bc41f7a9af17659a2e95d1)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:10:02.080245 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3deb64e0-6e07-4c6b-a90d-77f1f6bdfc4b admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:10:02.095158 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1130/2321] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Oct 14 13:10:02 2022] PUT /identity/v3/projects/4ef6941a0b0142839de600dfbdb74b05/users/17be3fb1d3144eb29a789209d0d58ebc/roles/7f6e29e390bc41f7a9af17659a2e95d1 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:10:02.099126 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b750bbaf-ac27-434e-9c06-7dfd7b75f27f admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:10:02.109486 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b750bbaf-ac27-434e-9c06-7dfd7b75f27f admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:10:02.164991 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ce9c58-894c-4853-ba5c-51231817db0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:10:02.165515 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ce9c58-894c-4853-ba5c-51231817db0b admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:10:02.165795 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ce9c58-894c-4853-ba5c-51231817db0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:10:02.166069 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ce9c58-894c-4853-ba5c-51231817db0b admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:10:02.166745 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ce9c58-894c-4853-ba5c-51231817db0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:10:02.168345 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ce9c58-894c-4853-ba5c-51231817db0b admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:10:02.178368 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1192/2322] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:10:02 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:10:02.182969 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3deb64e0-6e07-4c6b-a90d-77f1f6bdfc4b admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:10:02.195269 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3deb64e0-6e07-4c6b-a90d-77f1f6bdfc4b admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:10:02.200231 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd4bc24-5b1e-4b8d-82b7-994dedee8b3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:10:02.200899 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd4bc24-5b1e-4b8d-82b7-994dedee8b3f admin admin] REQUEST_METHOD: `PUT` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:10:02.201234 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd4bc24-5b1e-4b8d-82b7-994dedee8b3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:10:02.201474 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd4bc24-5b1e-4b8d-82b7-994dedee8b3f admin admin] PATH_INFO: `/v3/projects/4ef6941a0b0142839de600dfbdb74b05/users/17be3fb1d3144eb29a789209d0d58ebc/roles/7f6e29e390bc41f7a9af17659a2e95d1` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:10:02.203812 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd4bc24-5b1e-4b8d-82b7-994dedee8b3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ef6941a0b0142839de600dfbdb74b05, user_id=17be3fb1d3144eb29a789209d0d58ebc, role_id=7f6e29e390bc41f7a9af17659a2e95d1)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:10:02.206538 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd4bc24-5b1e-4b8d-82b7-994dedee8b3f admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:10:02.217805 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1131/2323] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Oct 14 13:10:02 2022] PUT /identity/v3/projects/4ef6941a0b0142839de600dfbdb74b05/users/17be3fb1d3144eb29a789209d0d58ebc/roles/7f6e29e390bc41f7a9af17659a2e95d1 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:10:02.229090 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55bd5cd-46c6-4c7a-83df-a2beeca55e23 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:10:02.229376 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55bd5cd-46c6-4c7a-83df-a2beeca55e23 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:10:02.229649 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55bd5cd-46c6-4c7a-83df-a2beeca55e23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:10:02.257938 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-b55bd5cd-46c6-4c7a-83df-a2beeca55e23 None None] MFA Rules not processed for user `17be3fb1d3144eb29a789209d0d58ebc`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:10:02.259312 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-b55bd5cd-46c6-4c7a-83df-a2beeca55e23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:10:02.267191 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:10:02.330483 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1193/2324] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:10:02 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:10:02.342554 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd4bc24-5b1e-4b8d-82b7-994dedee8b3f admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:10:02.344291 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-ffd4bc24-5b1e-4b8d-82b7-994dedee8b3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:10:02.402646 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd4bc24-5b1e-4b8d-82b7-994dedee8b3f admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:10:02.406333 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b1f59e-3958-4f0c-95a1-1a7db920b933 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c3c564b8c548e4beef1cbfba2ad343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:10:02.406936 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b1f59e-3958-4f0c-95a1-1a7db920b933 service cinder] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:10:02.407213 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b1f59e-3958-4f0c-95a1-1a7db920b933 service cinder] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:10:02.407488 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b1f59e-3958-4f0c-95a1-1a7db920b933 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:10:02.416467 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b1f59e-3958-4f0c-95a1-1a7db920b933 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:10:02.417846 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b1f59e-3958-4f0c-95a1-1a7db920b933 service cinder] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:10:02.428005 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1132/2325] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:10:02 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:10:02.874326 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55bd5cd-46c6-4c7a-83df-a2beeca55e23 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:10:02.942149 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55bd5cd-46c6-4c7a-83df-a2beeca55e23 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:10:02.948469 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41178bb-fb31-41c6-97d3-4916724d1d2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:10:02.949109 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41178bb-fb31-41c6-97d3-4916724d1d2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:10:02.949514 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41178bb-fb31-41c6-97d3-4916724d1d2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:10:02.949795 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41178bb-fb31-41c6-97d3-4916724d1d2b admin admin] PATH_INFO: `/v3/users/a0bbca729c9544459e492ed18b0e3c2e` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:10:02.950971 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41178bb-fb31-41c6-97d3-4916724d1d2b admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0bbca729c9544459e492ed18b0e3c2e)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:10:02.953273 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41178bb-fb31-41c6-97d3-4916724d1d2b admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:10:03.007929 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-d41178bb-fb31-41c6-97d3-4916724d1d2b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0bbca729c9544459e492ed18b0e3c2e'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:10:03.014797 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-d41178bb-fb31-41c6-97d3-4916724d1d2b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0bbca729c9544459e492ed18b0e3c2e'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:10:03.015424 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-d41178bb-fb31-41c6-97d3-4916724d1d2b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0bbca729c9544459e492ed18b0e3c2e'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:10:03.023201 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-d41178bb-fb31-41c6-97d3-4916724d1d2b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0bbca729c9544459e492ed18b0e3c2e'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:10:03.035198 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-d41178bb-fb31-41c6-97d3-4916724d1d2b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0bbca729c9544459e492ed18b0e3c2e'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:10:03.041162 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1194/2326] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Oct 14 13:10:02 2022] DELETE /identity/v3/users/a0bbca729c9544459e492ed18b0e3c2e => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:10:03.045661 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5bf8c0-e4bd-46bc-a835-bd51aa76e2d8 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:10:03.045949 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5bf8c0-e4bd-46bc-a835-bd51aa76e2d8 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:10:03.046258 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5bf8c0-e4bd-46bc-a835-bd51aa76e2d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:10:03.065418 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-ab5bf8c0-e4bd-46bc-a835-bd51aa76e2d8 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:10:03.066700 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-ab5bf8c0-e4bd-46bc-a835-bd51aa76e2d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:10:03.125628 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1133/2327] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:10:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:10:03.135973 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41178bb-fb31-41c6-97d3-4916724d1d2b admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:10:03.137413 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-d41178bb-fb31-41c6-97d3-4916724d1d2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:10:03.164757 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:10:03.195443 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41178bb-fb31-41c6-97d3-4916724d1d2b admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:10:03.199027 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4e91cb-e3a0-43ac-99f1-565f37031a30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d483292f3a4794848fcacfba5b107e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:10:03.199627 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4e91cb-e3a0-43ac-99f1-565f37031a30 service neutron] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:10:03.199907 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4e91cb-e3a0-43ac-99f1-565f37031a30 service neutron] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:10:03.200177 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4e91cb-e3a0-43ac-99f1-565f37031a30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:10:03.209751 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4e91cb-e3a0-43ac-99f1-565f37031a30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:10:03.211236 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4e91cb-e3a0-43ac-99f1-565f37031a30 service neutron] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:10:03.220756 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1195/2328] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:10:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:10:03.487047 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5bf8c0-e4bd-46bc-a835-bd51aa76e2d8 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:10:03.488577 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-ab5bf8c0-e4bd-46bc-a835-bd51aa76e2d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:10:03.501578 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5bf8c0-e4bd-46bc-a835-bd51aa76e2d8 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:10:03.509179 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da48c635-ecce-49b4-a669-4c29db6efaa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:10:03.509955 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da48c635-ecce-49b4-a669-4c29db6efaa7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:10:03.510267 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da48c635-ecce-49b4-a669-4c29db6efaa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:10:03.510544 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da48c635-ecce-49b4-a669-4c29db6efaa7 admin admin] PATH_INFO: `/v3/projects/07bfd64884974413a820d44b9fd67134` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:10:03.511682 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da48c635-ecce-49b4-a669-4c29db6efaa7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=07bfd64884974413a820d44b9fd67134)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:10:03.513631 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da48c635-ecce-49b4-a669-4c29db6efaa7 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:10:03.562175 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-da48c635-ecce-49b4-a669-4c29db6efaa7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07bfd64884974413a820d44b9fd67134', 'request_id': 'req-da48c635-ecce-49b4-a669-4c29db6efaa7'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:10:03.567803 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-da48c635-ecce-49b4-a669-4c29db6efaa7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07bfd64884974413a820d44b9fd67134', 'request_id': 'req-da48c635-ecce-49b4-a669-4c29db6efaa7'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:10:03.574222 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-da48c635-ecce-49b4-a669-4c29db6efaa7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07bfd64884974413a820d44b9fd67134', 'request_id': 'req-da48c635-ecce-49b4-a669-4c29db6efaa7'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:10:03.575853 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:10:03.587606 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-da48c635-ecce-49b4-a669-4c29db6efaa7 admin admin] The token cache is being invalidate because project 07bfd64884974413a820d44b9fd67134 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:10:03.588129 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-da48c635-ecce-49b4-a669-4c29db6efaa7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:10:03.588763 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-da48c635-ecce-49b4-a669-4c29db6efaa7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:10:03.590516 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1134/2329] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Oct 14 13:10:03 2022] DELETE /identity/v3/projects/07bfd64884974413a820d44b9fd67134 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:10:03.594475 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4e91cb-e3a0-43ac-99f1-565f37031a30 service neutron] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:10:03.604639 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4e91cb-e3a0-43ac-99f1-565f37031a30 service neutron] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:10:03.659533 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac926411-5894-4913-b46a-1cfd9e619835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:10:03.660149 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac926411-5894-4913-b46a-1cfd9e619835 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:10:03.660424 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac926411-5894-4913-b46a-1cfd9e619835 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:10:03.660692 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac926411-5894-4913-b46a-1cfd9e619835 admin admin] PATH_INFO: `/v3/users/17be3fb1d3144eb29a789209d0d58ebc` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:10:03.662359 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac926411-5894-4913-b46a-1cfd9e619835 admin admin] RBAC: Authorizing `identity:delete_user(user_id=17be3fb1d3144eb29a789209d0d58ebc)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:10:03.664273 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac926411-5894-4913-b46a-1cfd9e619835 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:10:03.713524 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-ac926411-5894-4913-b46a-1cfd9e619835 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17be3fb1d3144eb29a789209d0d58ebc'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:10:03.720933 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-ac926411-5894-4913-b46a-1cfd9e619835 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17be3fb1d3144eb29a789209d0d58ebc'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:10:03.721612 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-ac926411-5894-4913-b46a-1cfd9e619835 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17be3fb1d3144eb29a789209d0d58ebc'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:10:03.729801 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-ac926411-5894-4913-b46a-1cfd9e619835 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17be3fb1d3144eb29a789209d0d58ebc'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:10:03.742410 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-ac926411-5894-4913-b46a-1cfd9e619835 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17be3fb1d3144eb29a789209d0d58ebc'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:10:03.748300 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1196/2330] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Oct 14 13:10:03 2022] DELETE /identity/v3/users/17be3fb1d3144eb29a789209d0d58ebc => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:10:03.905832 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da48c635-ecce-49b4-a669-4c29db6efaa7 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:10:03.907495 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-da48c635-ecce-49b4-a669-4c29db6efaa7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:10:03.921616 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da48c635-ecce-49b4-a669-4c29db6efaa7 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:10:03.988934 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5f1320-3ffd-483c-b2c4-45f5422a0e2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:10:03.990106 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5f1320-3ffd-483c-b2c4-45f5422a0e2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:10:03.990466 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5f1320-3ffd-483c-b2c4-45f5422a0e2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:10:03.990872 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5f1320-3ffd-483c-b2c4-45f5422a0e2b admin admin] PATH_INFO: `/v3/users/36da803a1ede4194a68fd7e82a9e6ccc` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:10:03.992006 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5f1320-3ffd-483c-b2c4-45f5422a0e2b admin admin] RBAC: Authorizing `identity:delete_user(user_id=36da803a1ede4194a68fd7e82a9e6ccc)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:10:03.993920 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5f1320-3ffd-483c-b2c4-45f5422a0e2b admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:10:04.043193 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac926411-5894-4913-b46a-1cfd9e619835 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:10:04.045013 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-ac926411-5894-4913-b46a-1cfd9e619835 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:10:04.060325 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-eb5f1320-3ffd-483c-b2c4-45f5422a0e2b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36da803a1ede4194a68fd7e82a9e6ccc'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:10:04.070753 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac926411-5894-4913-b46a-1cfd9e619835 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:10:04.075751 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d92927b-9d80-4908-9850-efedc0a0ba5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:10:04.076539 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d92927b-9d80-4908-9850-efedc0a0ba5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:10:04.076911 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d92927b-9d80-4908-9850-efedc0a0ba5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:10:04.077277 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d92927b-9d80-4908-9850-efedc0a0ba5c admin admin] PATH_INFO: `/v3/projects/4ef6941a0b0142839de600dfbdb74b05` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:10:04.078484 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d92927b-9d80-4908-9850-efedc0a0ba5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ef6941a0b0142839de600dfbdb74b05)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:10:04.079466 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-eb5f1320-3ffd-483c-b2c4-45f5422a0e2b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36da803a1ede4194a68fd7e82a9e6ccc'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:10:04.080210 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-eb5f1320-3ffd-483c-b2c4-45f5422a0e2b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36da803a1ede4194a68fd7e82a9e6ccc'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:10:04.080555 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d92927b-9d80-4908-9850-efedc0a0ba5c admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:10:04.091407 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-eb5f1320-3ffd-483c-b2c4-45f5422a0e2b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36da803a1ede4194a68fd7e82a9e6ccc'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:10:04.107289 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-eb5f1320-3ffd-483c-b2c4-45f5422a0e2b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36da803a1ede4194a68fd7e82a9e6ccc'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:10:04.115586 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1135/2331] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Oct 14 13:10:03 2022] DELETE /identity/v3/users/36da803a1ede4194a68fd7e82a9e6ccc => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 13:10:04.120257 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7361045d-74eb-4080-ac0e-a747557187b3 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:10:04.120552 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7361045d-74eb-4080-ac0e-a747557187b3 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:10:04.120835 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7361045d-74eb-4080-ac0e-a747557187b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:10:04.135092 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:10:04.141897 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-7361045d-74eb-4080-ac0e-a747557187b3 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:10:04.143234 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-5d92927b-9d80-4908-9850-efedc0a0ba5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ef6941a0b0142839de600dfbdb74b05', 'request_id': 'req-5d92927b-9d80-4908-9850-efedc0a0ba5c'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:10:04.143380 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-7361045d-74eb-4080-ac0e-a747557187b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:10:04.150901 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-5d92927b-9d80-4908-9850-efedc0a0ba5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ef6941a0b0142839de600dfbdb74b05', 'request_id': 'req-5d92927b-9d80-4908-9850-efedc0a0ba5c'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:10:04.158196 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-5d92927b-9d80-4908-9850-efedc0a0ba5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ef6941a0b0142839de600dfbdb74b05', 'request_id': 'req-5d92927b-9d80-4908-9850-efedc0a0ba5c'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:10:04.177630 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-5d92927b-9d80-4908-9850-efedc0a0ba5c admin admin] The token cache is being invalidate because project 4ef6941a0b0142839de600dfbdb74b05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:10:04.178386 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-5d92927b-9d80-4908-9850-efedc0a0ba5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:10:04.179332 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-5d92927b-9d80-4908-9850-efedc0a0ba5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:10:04.181088 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1197/2332] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Oct 14 13:10:04 2022] DELETE /identity/v3/projects/4ef6941a0b0142839de600dfbdb74b05 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:10:04.186028 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945337b6-d4ef-4c15-a7d4-7de58ad9e5fd None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:10:04.186372 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945337b6-d4ef-4c15-a7d4-7de58ad9e5fd None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:10:04.187066 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945337b6-d4ef-4c15-a7d4-7de58ad9e5fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:10:04.218463 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-945337b6-d4ef-4c15-a7d4-7de58ad9e5fd None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:10:04.218463 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-945337b6-d4ef-4c15-a7d4-7de58ad9e5fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:10:04.218631 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1136/2333] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:10:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:10:04.222701 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7361045d-74eb-4080-ac0e-a747557187b3 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:10:04.223171 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-7361045d-74eb-4080-ac0e-a747557187b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:10:04.224773 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1198/2334] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:10:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 13:10:04.232464 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30de87c9-46d2-4fed-9f57-b3738678dda6 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:10:04.232682 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30de87c9-46d2-4fed-9f57-b3738678dda6 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:10:04.232960 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30de87c9-46d2-4fed-9f57-b3738678dda6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:10:04.237270 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:10:04.253471 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-30de87c9-46d2-4fed-9f57-b3738678dda6 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:10:04.254690 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-30de87c9-46d2-4fed-9f57-b3738678dda6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:10:04.262584 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1199/2335] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:10:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 13:10:04.266668 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30de87c9-46d2-4fed-9f57-b3738678dda6 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:10:04.275747 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30de87c9-46d2-4fed-9f57-b3738678dda6 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:10:04.280281 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9455575c-f3ea-452d-b1a8-429b4c2780ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:10:04.280863 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9455575c-f3ea-452d-b1a8-429b4c2780ab admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:10:04.281136 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9455575c-f3ea-452d-b1a8-429b4c2780ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:10:04.281405 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9455575c-f3ea-452d-b1a8-429b4c2780ab admin admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:10:04.282037 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9455575c-f3ea-452d-b1a8-429b4c2780ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 13:10:04.282375 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9455575c-f3ea-452d-b1a8-429b4c2780ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:10:04.283972 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9455575c-f3ea-452d-b1a8-429b4c2780ab admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:10:04.284590 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7361045d-74eb-4080-ac0e-a747557187b3 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:10:04.288910 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5366a7-e4cc-46cb-b832-dc3f6c551468 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d483292f3a4794848fcacfba5b107e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:10:04.289515 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5366a7-e4cc-46cb-b832-dc3f6c551468 service neutron] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:10:04.289798 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5366a7-e4cc-46cb-b832-dc3f6c551468 service neutron] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:10:04.290074 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5366a7-e4cc-46cb-b832-dc3f6c551468 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:10:04.296291 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1200/2336] 10.222.0.17 () {58 vars in 1153 bytes} [Fri Oct 14 13:10:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 13:10:04.299788 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5366a7-e4cc-46cb-b832-dc3f6c551468 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:10:04.300434 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9455575c-f3ea-452d-b1a8-429b4c2780ab admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:10:04.301239 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5366a7-e4cc-46cb-b832-dc3f6c551468 service neutron] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:10:04.311075 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9455575c-f3ea-452d-b1a8-429b4c2780ab admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:10:04.312563 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1137/2337] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:10:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 14 13:10:04.315938 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e618f2-31a2-4fe5-94bf-0548788a3492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:10:04.316531 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e618f2-31a2-4fe5-94bf-0548788a3492 admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:10:04.316814 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e618f2-31a2-4fe5-94bf-0548788a3492 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:10:04.317088 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e618f2-31a2-4fe5-94bf-0548788a3492 admin admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:10:04.317773 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e618f2-31a2-4fe5-94bf-0548788a3492 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:10:04.319788 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e618f2-31a2-4fe5-94bf-0548788a3492 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:10:04.348181 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1201/2338] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Oct 14 13:10:04 2022] POST /identity/v3/projects => generated 355 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 13:10:04.353444 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5366a7-e4cc-46cb-b832-dc3f6c551468 service neutron] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:10:04.366518 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5366a7-e4cc-46cb-b832-dc3f6c551468 service neutron] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:10:04.429863 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11eff585-adbf-48bc-880a-d8d52d402c48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:10:04.430506 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eff585-adbf-48bc-880a-d8d52d402c48 admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:10:04.430804 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eff585-adbf-48bc-880a-d8d52d402c48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:10:04.431078 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eff585-adbf-48bc-880a-d8d52d402c48 admin admin] PATH_INFO: `/v3/users` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:10:04.431703 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11eff585-adbf-48bc-880a-d8d52d402c48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:10:04.433611 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11eff585-adbf-48bc-880a-d8d52d402c48 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:10:04.457862 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1138/2339] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Oct 14 13:10:04 2022] POST /identity/v3/users => generated 278 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:10:04.459338 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e618f2-31a2-4fe5-94bf-0548788a3492 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:10:04.478961 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e618f2-31a2-4fe5-94bf-0548788a3492 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:10:04.484115 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67513c7-8916-4060-b677-b2b9bab772a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:10:04.484675 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67513c7-8916-4060-b677-b2b9bab772a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:10:04.484959 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67513c7-8916-4060-b677-b2b9bab772a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:10:04.485291 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67513c7-8916-4060-b677-b2b9bab772a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:10:04.485954 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67513c7-8916-4060-b677-b2b9bab772a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:10:04.487768 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67513c7-8916-4060-b677-b2b9bab772a0 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:10:04.502051 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1202/2340] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:10:04 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:10:04.503262 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11eff585-adbf-48bc-880a-d8d52d402c48 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:10:04.513458 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11eff585-adbf-48bc-880a-d8d52d402c48 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:10:04.518226 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd25854-26b8-4bba-9fb7-549e88199901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:10:04.518893 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd25854-26b8-4bba-9fb7-549e88199901 admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:10:04.519177 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd25854-26b8-4bba-9fb7-549e88199901 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:10:04.519565 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd25854-26b8-4bba-9fb7-549e88199901 admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:10:04.520072 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd25854-26b8-4bba-9fb7-549e88199901 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:10:04.521856 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd25854-26b8-4bba-9fb7-549e88199901 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:10:04.534150 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1139/2341] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:10:04 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:10:04.535920 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67513c7-8916-4060-b677-b2b9bab772a0 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:10:04.546698 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67513c7-8916-4060-b677-b2b9bab772a0 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:10:04.551370 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d5ad15-bb52-41ca-afc7-19bb185dac48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:10:04.552634 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d5ad15-bb52-41ca-afc7-19bb185dac48 admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:10:04.553134 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d5ad15-bb52-41ca-afc7-19bb185dac48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:10:04.553415 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d5ad15-bb52-41ca-afc7-19bb185dac48 admin admin] PATH_INFO: `/v3/projects/ab05db7dfdcd4e048901a6afaedbd8f8/users/1068d851e06443aba8ee95e9a61fa26e/roles/5e8849303a75425b9eaa2681cc031af1` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:10:04.568047 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d5ad15-bb52-41ca-afc7-19bb185dac48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab05db7dfdcd4e048901a6afaedbd8f8, user_id=1068d851e06443aba8ee95e9a61fa26e, role_id=5e8849303a75425b9eaa2681cc031af1)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:10:04.570774 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d5ad15-bb52-41ca-afc7-19bb185dac48 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:10:04.586063 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1203/2342] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Oct 14 13:10:04 2022] PUT /identity/v3/projects/ab05db7dfdcd4e048901a6afaedbd8f8/users/1068d851e06443aba8ee95e9a61fa26e/roles/5e8849303a75425b9eaa2681cc031af1 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:10:04.596767 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a140a462-0a9b-409d-b9c0-9b9ef6af4873 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:10:04.597060 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a140a462-0a9b-409d-b9c0-9b9ef6af4873 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:10:04.597339 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a140a462-0a9b-409d-b9c0-9b9ef6af4873 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:10:04.602524 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d5ad15-bb52-41ca-afc7-19bb185dac48 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:10:04.604422 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-f9d5ad15-bb52-41ca-afc7-19bb185dac48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:10:04.629374 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-a140a462-0a9b-409d-b9c0-9b9ef6af4873 None None] MFA Rules not processed for user `1068d851e06443aba8ee95e9a61fa26e`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:10:04.630752 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-a140a462-0a9b-409d-b9c0-9b9ef6af4873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:10:04.672836 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d5ad15-bb52-41ca-afc7-19bb185dac48 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:10:04.677561 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f5c6b8-c4c1-479d-8e48-cbe8505033b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:10:04.678222 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f5c6b8-c4c1-479d-8e48-cbe8505033b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:10:04.678505 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f5c6b8-c4c1-479d-8e48-cbe8505033b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:10:04.678776 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f5c6b8-c4c1-479d-8e48-cbe8505033b1 admin admin] PATH_INFO: `/v3/projects/8e12c36b0e1047ec9c075a36ab65d17c` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:10:04.679920 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f5c6b8-c4c1-479d-8e48-cbe8505033b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e12c36b0e1047ec9c075a36ab65d17c)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:10:04.681830 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f5c6b8-c4c1-479d-8e48-cbe8505033b1 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:10:04.697565 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1140/2343] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:10:04 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:10:04.701862 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a140a462-0a9b-409d-b9c0-9b9ef6af4873 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:10:04.713313 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a140a462-0a9b-409d-b9c0-9b9ef6af4873 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:10:04.718703 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba97d4a-5f65-4ba8-a59f-371ac547712a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:10:04.719402 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba97d4a-5f65-4ba8-a59f-371ac547712a admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:10:04.719843 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba97d4a-5f65-4ba8-a59f-371ac547712a admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:10:04.720016 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba97d4a-5f65-4ba8-a59f-371ac547712a admin admin] PATH_INFO: `/v3/projects` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:10:04.720797 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba97d4a-5f65-4ba8-a59f-371ac547712a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:10:04.723005 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba97d4a-5f65-4ba8-a59f-371ac547712a admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:10:04.731774 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=89,keystone:DELETE=8,keystone:INSERT=3 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:10:04.733025 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-e2f5c6b8-c4c1-479d-8e48-cbe8505033b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e12c36b0e1047ec9c075a36ab65d17c', 'request_id': 'req-e2f5c6b8-c4c1-479d-8e48-cbe8505033b1'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:10:04.742753 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-e2f5c6b8-c4c1-479d-8e48-cbe8505033b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e12c36b0e1047ec9c075a36ab65d17c', 'request_id': 'req-e2f5c6b8-c4c1-479d-8e48-cbe8505033b1'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:10:04.747360 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:10:04.750343 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-e2f5c6b8-c4c1-479d-8e48-cbe8505033b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e12c36b0e1047ec9c075a36ab65d17c', 'request_id': 'req-e2f5c6b8-c4c1-479d-8e48-cbe8505033b1'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:10:04.755123 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1141/2344] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Oct 14 13:10:04 2022] POST /identity/v3/projects => generated 357 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 13:10:04.759758 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba97d4a-5f65-4ba8-a59f-371ac547712a admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:10:04.763728 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-e2f5c6b8-c4c1-479d-8e48-cbe8505033b1 admin admin] The token cache is being invalidate because project 8e12c36b0e1047ec9c075a36ab65d17c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:10:04.764006 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-e2f5c6b8-c4c1-479d-8e48-cbe8505033b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:10:04.764670 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-e2f5c6b8-c4c1-479d-8e48-cbe8505033b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:10:04.766204 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1204/2345] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Oct 14 13:10:04 2022] DELETE /identity/v3/projects/8e12c36b0e1047ec9c075a36ab65d17c => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:10:04.771164 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f5c6b8-c4c1-479d-8e48-cbe8505033b1 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:10:04.772938 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-e2f5c6b8-c4c1-479d-8e48-cbe8505033b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:10:04.825169 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba97d4a-5f65-4ba8-a59f-371ac547712a admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:10:04.829910 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714a999e-6530-4a1d-bda4-e573887a50a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:10:04.830571 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714a999e-6530-4a1d-bda4-e573887a50a5 admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:10:04.830855 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714a999e-6530-4a1d-bda4-e573887a50a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:10:04.831128 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714a999e-6530-4a1d-bda4-e573887a50a5 admin admin] PATH_INFO: `/v3/users` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:10:04.831751 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714a999e-6530-4a1d-bda4-e573887a50a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:10:04.834360 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714a999e-6530-4a1d-bda4-e573887a50a5 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:10:04.836847 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f5c6b8-c4c1-479d-8e48-cbe8505033b1 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:10:04.841682 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14425ee7-3bf1-4c91-82cb-530be5afff92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:10:04.842333 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14425ee7-3bf1-4c91-82cb-530be5afff92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:10:04.842608 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14425ee7-3bf1-4c91-82cb-530be5afff92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:10:04.842873 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14425ee7-3bf1-4c91-82cb-530be5afff92 admin admin] PATH_INFO: `/v3/users/2c2809da5fd042ac8587ee2d887e4db7` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:10:04.843991 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14425ee7-3bf1-4c91-82cb-530be5afff92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c2809da5fd042ac8587ee2d887e4db7)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:10:04.845882 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14425ee7-3bf1-4c91-82cb-530be5afff92 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:10:04.856453 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1142/2346] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Oct 14 13:10:04 2022] POST /identity/v3/users => generated 285 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 13:10:04.860332 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714a999e-6530-4a1d-bda4-e573887a50a5 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:10:04.861926 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-714a999e-6530-4a1d-bda4-e573887a50a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:10:04.873869 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714a999e-6530-4a1d-bda4-e573887a50a5 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:10:04.879125 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c843c1-1e26-4dc4-8970-fcdc44e9981e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:10:04.879714 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c843c1-1e26-4dc4-8970-fcdc44e9981e admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:10:04.879993 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c843c1-1e26-4dc4-8970-fcdc44e9981e admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:10:04.880282 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c843c1-1e26-4dc4-8970-fcdc44e9981e admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:10:04.880922 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c843c1-1e26-4dc4-8970-fcdc44e9981e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:10:04.882547 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c843c1-1e26-4dc4-8970-fcdc44e9981e admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:10:04.893920 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-14425ee7-3bf1-4c91-82cb-530be5afff92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c2809da5fd042ac8587ee2d887e4db7'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:10:04.895086 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1143/2347] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:10:04 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 14 13:10:04.899624 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c843c1-1e26-4dc4-8970-fcdc44e9981e admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:10:04.904385 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-14425ee7-3bf1-4c91-82cb-530be5afff92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c2809da5fd042ac8587ee2d887e4db7'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:10:04.905085 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-14425ee7-3bf1-4c91-82cb-530be5afff92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c2809da5fd042ac8587ee2d887e4db7'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:10:04.909710 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c843c1-1e26-4dc4-8970-fcdc44e9981e admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:10:04.913270 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-14425ee7-3bf1-4c91-82cb-530be5afff92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c2809da5fd042ac8587ee2d887e4db7'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:10:04.915932 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00487bda-44a7-4636-856e-16c5460a30a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:10:04.916683 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00487bda-44a7-4636-856e-16c5460a30a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:10:04.916976 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00487bda-44a7-4636-856e-16c5460a30a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:10:04.917252 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00487bda-44a7-4636-856e-16c5460a30a8 admin admin] PATH_INFO: `/v3/projects/6222f7d0036742138b20646a85b3d074/users/4e8915ec00f74fd0bb53fbecee46a547/roles/7f6e29e390bc41f7a9af17659a2e95d1` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:10:04.925392 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-14425ee7-3bf1-4c91-82cb-530be5afff92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c2809da5fd042ac8587ee2d887e4db7'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:10:04.931568 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1205/2348] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Oct 14 13:10:04 2022] DELETE /identity/v3/users/2c2809da5fd042ac8587ee2d887e4db7 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 13:10:04.932217 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00487bda-44a7-4636-856e-16c5460a30a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6222f7d0036742138b20646a85b3d074, user_id=4e8915ec00f74fd0bb53fbecee46a547, role_id=7f6e29e390bc41f7a9af17659a2e95d1)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:10:04.934918 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00487bda-44a7-4636-856e-16c5460a30a8 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:10:04.950808 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1144/2349] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Oct 14 13:10:04 2022] PUT /identity/v3/projects/6222f7d0036742138b20646a85b3d074/users/4e8915ec00f74fd0bb53fbecee46a547/roles/7f6e29e390bc41f7a9af17659a2e95d1 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 13:10:04.954892 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14425ee7-3bf1-4c91-82cb-530be5afff92 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:10:04.956362 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-14425ee7-3bf1-4c91-82cb-530be5afff92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:10:05.019882 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:10:05.025403 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14425ee7-3bf1-4c91-82cb-530be5afff92 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:10:05.089598 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373b1853-eb1a-4e58-ab1b-322b7cd812e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:10:05.090206 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373b1853-eb1a-4e58-ab1b-322b7cd812e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:10:05.090435 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373b1853-eb1a-4e58-ab1b-322b7cd812e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:10:05.090774 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373b1853-eb1a-4e58-ab1b-322b7cd812e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:10:05.091786 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373b1853-eb1a-4e58-ab1b-322b7cd812e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:10:05.093517 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373b1853-eb1a-4e58-ab1b-322b7cd812e9 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:10:05.104295 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1206/2350] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:10:04 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 14 13:10:05.108539 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00487bda-44a7-4636-856e-16c5460a30a8 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:10:05.118676 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00487bda-44a7-4636-856e-16c5460a30a8 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:10:05.123294 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dd39e3-d80d-4a70-a6e6-48b0eaa514c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:10:05.123935 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dd39e3-d80d-4a70-a6e6-48b0eaa514c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:10:05.124213 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dd39e3-d80d-4a70-a6e6-48b0eaa514c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:10:05.124480 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dd39e3-d80d-4a70-a6e6-48b0eaa514c5 admin admin] PATH_INFO: `/v3/projects/6222f7d0036742138b20646a85b3d074/users/4e8915ec00f74fd0bb53fbecee46a547/roles/7f6e29e390bc41f7a9af17659a2e95d1` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:10:05.126403 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dd39e3-d80d-4a70-a6e6-48b0eaa514c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6222f7d0036742138b20646a85b3d074, user_id=4e8915ec00f74fd0bb53fbecee46a547, role_id=7f6e29e390bc41f7a9af17659a2e95d1)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:10:05.129018 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dd39e3-d80d-4a70-a6e6-48b0eaa514c5 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:10:05.140173 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1145/2351] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Oct 14 13:10:05 2022] PUT /identity/v3/projects/6222f7d0036742138b20646a85b3d074/users/4e8915ec00f74fd0bb53fbecee46a547/roles/7f6e29e390bc41f7a9af17659a2e95d1 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:10:05.151951 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dc5155-7b51-4c61-8d88-2fc8b3511326 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:10:05.152337 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dc5155-7b51-4c61-8d88-2fc8b3511326 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:10:05.152675 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dc5155-7b51-4c61-8d88-2fc8b3511326 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:10:05.180356 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-d4dc5155-7b51-4c61-8d88-2fc8b3511326 None None] MFA Rules not processed for user `4e8915ec00f74fd0bb53fbecee46a547`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:10:05.181600 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-d4dc5155-7b51-4c61-8d88-2fc8b3511326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:10:05.211271 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dd39e3-d80d-4a70-a6e6-48b0eaa514c5 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:10:05.213184 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-79dd39e3-d80d-4a70-a6e6-48b0eaa514c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:10:05.277191 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1207/2352] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:10:05 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:10:05.289822 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dc5155-7b51-4c61-8d88-2fc8b3511326 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:10:05.291249 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-d4dc5155-7b51-4c61-8d88-2fc8b3511326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:10:05.298029 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dd39e3-d80d-4a70-a6e6-48b0eaa514c5 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:10:05.306070 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c36a447-4c6c-4c41-8ae0-ce3e4663df60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:10:05.306745 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c36a447-4c6c-4c41-8ae0-ce3e4663df60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:10:05.307027 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c36a447-4c6c-4c41-8ae0-ce3e4663df60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:10:05.307306 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c36a447-4c6c-4c41-8ae0-ce3e4663df60 admin admin] PATH_INFO: `/v3/projects/e2cd28c005184424860517a5a8e5f141` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:10:05.308452 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c36a447-4c6c-4c41-8ae0-ce3e4663df60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2cd28c005184424860517a5a8e5f141)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:10:05.310554 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c36a447-4c6c-4c41-8ae0-ce3e4663df60 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:10:05.363297 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dc5155-7b51-4c61-8d88-2fc8b3511326 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:10:05.372837 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:10:05.381016 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-1c36a447-4c6c-4c41-8ae0-ce3e4663df60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2cd28c005184424860517a5a8e5f141', 'request_id': 'req-1c36a447-4c6c-4c41-8ae0-ce3e4663df60'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:10:05.392382 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-1c36a447-4c6c-4c41-8ae0-ce3e4663df60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2cd28c005184424860517a5a8e5f141', 'request_id': 'req-1c36a447-4c6c-4c41-8ae0-ce3e4663df60'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:10:05.401974 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-1c36a447-4c6c-4c41-8ae0-ce3e4663df60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2cd28c005184424860517a5a8e5f141', 'request_id': 'req-1c36a447-4c6c-4c41-8ae0-ce3e4663df60'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:10:05.413952 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:10:05.417702 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-1c36a447-4c6c-4c41-8ae0-ce3e4663df60 admin admin] The token cache is being invalidate because project e2cd28c005184424860517a5a8e5f141 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:10:05.418102 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-1c36a447-4c6c-4c41-8ae0-ce3e4663df60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:10:05.419446 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-1c36a447-4c6c-4c41-8ae0-ce3e4663df60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:10:05.423751 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1146/2353] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Oct 14 13:10:05 2022] DELETE /identity/v3/projects/e2cd28c005184424860517a5a8e5f141 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 13:10:05.426954 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c7d229-a80c-4ed4-9731-415d268959cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c3c564b8c548e4beef1cbfba2ad343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:10:05.427582 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c7d229-a80c-4ed4-9731-415d268959cc service cinder] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:10:05.427954 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c7d229-a80c-4ed4-9731-415d268959cc service cinder] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:10:05.428290 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c36a447-4c6c-4c41-8ae0-ce3e4663df60 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:10:05.428398 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c7d229-a80c-4ed4-9731-415d268959cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:10:05.429865 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-1c36a447-4c6c-4c41-8ae0-ce3e4663df60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:10:05.430752 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-22c7d229-a80c-4ed4-9731-415d268959cc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:10:05.501309 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c36a447-4c6c-4c41-8ae0-ce3e4663df60 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:10:05.506670 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c7d229-a80c-4ed4-9731-415d268959cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:10:05.508154 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c7d229-a80c-4ed4-9731-415d268959cc service cinder] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:10:05.509155 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff5738c-e38c-4fd3-826a-a3db9eb2e1f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:10:05.510363 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff5738c-e38c-4fd3-826a-a3db9eb2e1f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:10:05.510644 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff5738c-e38c-4fd3-826a-a3db9eb2e1f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:10:05.510916 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff5738c-e38c-4fd3-826a-a3db9eb2e1f7 admin admin] PATH_INFO: `/v3/users/329e9c8b61924f64aa1b0d9b043268d5` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:10:05.512183 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff5738c-e38c-4fd3-826a-a3db9eb2e1f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=329e9c8b61924f64aa1b0d9b043268d5)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:10:05.514412 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff5738c-e38c-4fd3-826a-a3db9eb2e1f7 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:10:05.518110 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1208/2354] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:10:05 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 14 13:10:05.574390 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-8ff5738c-e38c-4fd3-826a-a3db9eb2e1f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '329e9c8b61924f64aa1b0d9b043268d5'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:10:05.582452 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-8ff5738c-e38c-4fd3-826a-a3db9eb2e1f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '329e9c8b61924f64aa1b0d9b043268d5'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:10:05.583737 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-8ff5738c-e38c-4fd3-826a-a3db9eb2e1f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '329e9c8b61924f64aa1b0d9b043268d5'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:10:05.592195 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-8ff5738c-e38c-4fd3-826a-a3db9eb2e1f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '329e9c8b61924f64aa1b0d9b043268d5'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:10:05.611566 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c7d229-a80c-4ed4-9731-415d268959cc service cinder] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:10:05.613025 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-22c7d229-a80c-4ed4-9731-415d268959cc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:10:05.615416 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-8ff5738c-e38c-4fd3-826a-a3db9eb2e1f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '329e9c8b61924f64aa1b0d9b043268d5'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:10:05.622255 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1147/2355] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Oct 14 13:10:05 2022] DELETE /identity/v3/users/329e9c8b61924f64aa1b0d9b043268d5 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:10:05.628275 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c7d229-a80c-4ed4-9731-415d268959cc service cinder] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:10:05.695868 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76911778-698d-4014-9771-2c4c9f214b25 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c3c564b8c548e4beef1cbfba2ad343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:10:05.696626 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76911778-698d-4014-9771-2c4c9f214b25 service cinder] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:10:05.697181 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76911778-698d-4014-9771-2c4c9f214b25 service cinder] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:10:05.697493 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76911778-698d-4014-9771-2c4c9f214b25 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:10:05.699748 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-76911778-698d-4014-9771-2c4c9f214b25 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:10:05.777648 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76911778-698d-4014-9771-2c4c9f214b25 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:10:05.779149 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76911778-698d-4014-9771-2c4c9f214b25 service cinder] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:10:05.789930 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1209/2356] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:10:05 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 14 13:10:05.966414 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff5738c-e38c-4fd3-826a-a3db9eb2e1f7 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:10:05.968154 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-8ff5738c-e38c-4fd3-826a-a3db9eb2e1f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:10:06.031807 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:10:06.047675 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff5738c-e38c-4fd3-826a-a3db9eb2e1f7 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:10:06.054316 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7e178c-22b7-4a5a-9220-4d19323bd78a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:10:06.054892 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7e178c-22b7-4a5a-9220-4d19323bd78a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:10:06.055178 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7e178c-22b7-4a5a-9220-4d19323bd78a admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:10:06.055455 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7e178c-22b7-4a5a-9220-4d19323bd78a admin admin] PATH_INFO: `/v3/projects/ce061cb3153c4bbea1e16124e9aa7abc` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:10:06.056632 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7e178c-22b7-4a5a-9220-4d19323bd78a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce061cb3153c4bbea1e16124e9aa7abc)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:10:06.058617 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7e178c-22b7-4a5a-9220-4d19323bd78a admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:10:06.119484 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-2a7e178c-22b7-4a5a-9220-4d19323bd78a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce061cb3153c4bbea1e16124e9aa7abc', 'request_id': 'req-2a7e178c-22b7-4a5a-9220-4d19323bd78a'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:10:06.126014 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-2a7e178c-22b7-4a5a-9220-4d19323bd78a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce061cb3153c4bbea1e16124e9aa7abc', 'request_id': 'req-2a7e178c-22b7-4a5a-9220-4d19323bd78a'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:10:06.134149 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-2a7e178c-22b7-4a5a-9220-4d19323bd78a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce061cb3153c4bbea1e16124e9aa7abc', 'request_id': 'req-2a7e178c-22b7-4a5a-9220-4d19323bd78a'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:10:06.147713 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-2a7e178c-22b7-4a5a-9220-4d19323bd78a admin admin] The token cache is being invalidate because project ce061cb3153c4bbea1e16124e9aa7abc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:10:06.148002 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-2a7e178c-22b7-4a5a-9220-4d19323bd78a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:10:06.148653 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-2a7e178c-22b7-4a5a-9220-4d19323bd78a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:10:06.150175 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1148/2357] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Oct 14 13:10:05 2022] DELETE /identity/v3/projects/ce061cb3153c4bbea1e16124e9aa7abc => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:10:06.156167 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f0ac0f-2d20-4179-8dd1-a9e71657842f None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:10:06.156691 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f0ac0f-2d20-4179-8dd1-a9e71657842f None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:10:06.156999 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f0ac0f-2d20-4179-8dd1-a9e71657842f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:10:06.189130 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-47f0ac0f-2d20-4179-8dd1-a9e71657842f None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:10:06.191018 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-47f0ac0f-2d20-4179-8dd1-a9e71657842f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:10:06.240961 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:10:06.260060 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1210/2358] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:10:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:10:06.268008 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870ba9ce-2c90-4655-ae2c-a3805cb81840 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:10:06.268323 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870ba9ce-2c90-4655-ae2c-a3805cb81840 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:10:06.268618 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870ba9ce-2c90-4655-ae2c-a3805cb81840 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:10:06.289778 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-870ba9ce-2c90-4655-ae2c-a3805cb81840 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:10:06.290973 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-870ba9ce-2c90-4655-ae2c-a3805cb81840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:10:06.299080 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1149/2359] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:10:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:10:06.303460 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f0ac0f-2d20-4179-8dd1-a9e71657842f None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:10:06.313165 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f0ac0f-2d20-4179-8dd1-a9e71657842f None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:10:06.318005 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b48610-b000-48f8-855b-81854757ee33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:10:06.318726 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b48610-b000-48f8-855b-81854757ee33 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:10:06.319010 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b48610-b000-48f8-855b-81854757ee33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:10:06.319284 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b48610-b000-48f8-855b-81854757ee33 admin admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:10:06.319932 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b48610-b000-48f8-855b-81854757ee33 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 13:10:06.320237 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b48610-b000-48f8-855b-81854757ee33 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:10:06.321881 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b48610-b000-48f8-855b-81854757ee33 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:10:06.333835 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1211/2360] 10.222.0.17 () {58 vars in 1153 bytes} [Fri Oct 14 13:10:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 13:10:06.338008 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870ba9ce-2c90-4655-ae2c-a3805cb81840 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:10:06.347404 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870ba9ce-2c90-4655-ae2c-a3805cb81840 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:10:06.352869 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac0db41-f4dd-428e-876a-aae20c324e77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:10:06.353457 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac0db41-f4dd-428e-876a-aae20c324e77 admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:10:06.353752 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac0db41-f4dd-428e-876a-aae20c324e77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:10:06.354007 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac0db41-f4dd-428e-876a-aae20c324e77 admin admin] PATH_INFO: `/v3/projects` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:10:06.354843 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac0db41-f4dd-428e-876a-aae20c324e77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:10:06.356744 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac0db41-f4dd-428e-876a-aae20c324e77 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:10:06.383616 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1150/2361] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Oct 14 13:10:06 2022] POST /identity/v3/projects => generated 371 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:10:06.387882 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b48610-b000-48f8-855b-81854757ee33 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:10:06.398980 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b48610-b000-48f8-855b-81854757ee33 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:10:06.457194 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf2d4b0-f111-4cee-9537-ca3e8af89f1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:10:06.457806 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf2d4b0-f111-4cee-9537-ca3e8af89f1b admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:10:06.458215 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf2d4b0-f111-4cee-9537-ca3e8af89f1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:10:06.459170 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf2d4b0-f111-4cee-9537-ca3e8af89f1b admin admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:10:06.459816 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf2d4b0-f111-4cee-9537-ca3e8af89f1b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:10:06.461767 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf2d4b0-f111-4cee-9537-ca3e8af89f1b admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:10:06.484801 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1212/2362] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Oct 14 13:10:06 2022] POST /identity/v3/users => generated 286 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 13:10:06.489265 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac0db41-f4dd-428e-876a-aae20c324e77 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:10:06.500547 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac0db41-f4dd-428e-876a-aae20c324e77 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:10:06.505785 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d257881-ba3d-4ace-810f-81f0e4e64a00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:10:06.506426 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d257881-ba3d-4ace-810f-81f0e4e64a00 admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:10:06.506707 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d257881-ba3d-4ace-810f-81f0e4e64a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:10:06.506980 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d257881-ba3d-4ace-810f-81f0e4e64a00 admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:10:06.507626 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d257881-ba3d-4ace-810f-81f0e4e64a00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:10:06.509228 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d257881-ba3d-4ace-810f-81f0e4e64a00 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:10:06.519749 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1151/2363] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:10:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:10:06.524665 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf2d4b0-f111-4cee-9537-ca3e8af89f1b admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:10:06.534817 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf2d4b0-f111-4cee-9537-ca3e8af89f1b admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:10:06.539977 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcc2e3d-665f-48f0-9cda-1b554b285480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:10:06.540582 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcc2e3d-665f-48f0-9cda-1b554b285480 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:10:06.540857 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcc2e3d-665f-48f0-9cda-1b554b285480 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:10:06.541127 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcc2e3d-665f-48f0-9cda-1b554b285480 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:10:06.541772 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcc2e3d-665f-48f0-9cda-1b554b285480 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:10:06.543402 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcc2e3d-665f-48f0-9cda-1b554b285480 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:10:06.554875 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1213/2364] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:10:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:10:06.559144 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d257881-ba3d-4ace-810f-81f0e4e64a00 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:10:06.570149 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d257881-ba3d-4ace-810f-81f0e4e64a00 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:10:06.574955 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f85c50-0e92-4b03-867c-eb6c9d6ede62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:10:06.575618 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f85c50-0e92-4b03-867c-eb6c9d6ede62 admin admin] REQUEST_METHOD: `PUT` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:10:06.575898 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f85c50-0e92-4b03-867c-eb6c9d6ede62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:10:06.576175 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f85c50-0e92-4b03-867c-eb6c9d6ede62 admin admin] PATH_INFO: `/v3/projects/857914771cd1486d837a9a46b1b7c527/users/beaf3b456bcc470e870e7add91b31a52/roles/5e8849303a75425b9eaa2681cc031af1` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:10:06.591767 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f85c50-0e92-4b03-867c-eb6c9d6ede62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=857914771cd1486d837a9a46b1b7c527, user_id=beaf3b456bcc470e870e7add91b31a52, role_id=5e8849303a75425b9eaa2681cc031af1)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:10:06.594653 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f85c50-0e92-4b03-867c-eb6c9d6ede62 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:10:06.608542 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1152/2365] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Oct 14 13:10:06 2022] PUT /identity/v3/projects/857914771cd1486d837a9a46b1b7c527/users/beaf3b456bcc470e870e7add91b31a52/roles/5e8849303a75425b9eaa2681cc031af1 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:10:06.616144 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb19e4a-867a-485e-aa16-a60f97996586 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:10:06.616497 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb19e4a-867a-485e-aa16-a60f97996586 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:10:06.617217 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb19e4a-867a-485e-aa16-a60f97996586 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:10:06.637674 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-5eb19e4a-867a-485e-aa16-a60f97996586 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:10:06.638906 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-5eb19e4a-867a-485e-aa16-a60f97996586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:10:06.695708 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1214/2366] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:10:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:10:06.705235 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f85c50-0e92-4b03-867c-eb6c9d6ede62 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:10:06.706938 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-28f85c50-0e92-4b03-867c-eb6c9d6ede62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:10:06.762489 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f85c50-0e92-4b03-867c-eb6c9d6ede62 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:10:06.766056 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f7d0a2-1899-498f-97b9-e29c23edfbd7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d483292f3a4794848fcacfba5b107e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:10:06.766681 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f7d0a2-1899-498f-97b9-e29c23edfbd7 service neutron] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:10:06.766961 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f7d0a2-1899-498f-97b9-e29c23edfbd7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:10:06.767230 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f7d0a2-1899-498f-97b9-e29c23edfbd7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:10:06.776573 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f7d0a2-1899-498f-97b9-e29c23edfbd7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:10:06.777987 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f7d0a2-1899-498f-97b9-e29c23edfbd7 service neutron] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:10:06.787233 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1153/2367] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:10:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:10:07.428476 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6371787e-cd61-4d34-9bda-e152a9e76510 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:10:07.429002 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6371787e-cd61-4d34-9bda-e152a9e76510 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:10:07.429214 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6371787e-cd61-4d34-9bda-e152a9e76510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:10:07.456957 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-6371787e-cd61-4d34-9bda-e152a9e76510 None None] MFA Rules not processed for user `beaf3b456bcc470e870e7add91b31a52`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:10:07.458296 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-6371787e-cd61-4d34-9bda-e152a9e76510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:10:07.499876 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:10:07.524839 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1215/2368] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:10:07 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:10:07.535878 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f7d0a2-1899-498f-97b9-e29c23edfbd7 service neutron] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:10:07.538072 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-e7f7d0a2-1899-498f-97b9-e29c23edfbd7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:10:07.561072 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:10:07.598977 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f7d0a2-1899-498f-97b9-e29c23edfbd7 service neutron] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:10:07.602989 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992d169b-c316-42af-be54-114376c2a003 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c3c564b8c548e4beef1cbfba2ad343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:10:07.603596 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992d169b-c316-42af-be54-114376c2a003 service cinder] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:10:07.603877 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992d169b-c316-42af-be54-114376c2a003 service cinder] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:10:07.604151 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992d169b-c316-42af-be54-114376c2a003 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:10:07.613143 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992d169b-c316-42af-be54-114376c2a003 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:10:07.615409 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992d169b-c316-42af-be54-114376c2a003 service cinder] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:10:07.624444 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1154/2369] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:10:07 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:10:08.998783 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e522157c-ac71-4c1c-878e-2279e2a899cb None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:10:08.999395 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e522157c-ac71-4c1c-878e-2279e2a899cb None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:10:08.999395 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e522157c-ac71-4c1c-878e-2279e2a899cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:10:09.018059 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-e522157c-ac71-4c1c-878e-2279e2a899cb None None] MFA Rules not processed for user `beaf3b456bcc470e870e7add91b31a52`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:10:09.019283 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-e522157c-ac71-4c1c-878e-2279e2a899cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:10:09.026533 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1216/2370] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:10:08 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:10:17.620353 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=17 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:10:19.013310 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=12 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:10:20.877262 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992d169b-c316-42af-be54-114376c2a003 service cinder] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:10:20.878831 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-992d169b-c316-42af-be54-114376c2a003 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:10:20.893630 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992d169b-c316-42af-be54-114376c2a003 service cinder] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:10:20.900035 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5907afc1-cd41-48ca-9c59-180810823d71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:10:20.900362 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5907afc1-cd41-48ca-9c59-180810823d71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:10:20.900696 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5907afc1-cd41-48ca-9c59-180810823d71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:10:20.900974 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5907afc1-cd41-48ca-9c59-180810823d71 admin admin] PATH_INFO: `/v3/users/1068d851e06443aba8ee95e9a61fa26e` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:10:20.902206 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5907afc1-cd41-48ca-9c59-180810823d71 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1068d851e06443aba8ee95e9a61fa26e)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:10:20.904149 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5907afc1-cd41-48ca-9c59-180810823d71 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:10:20.949503 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-5907afc1-cd41-48ca-9c59-180810823d71 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1068d851e06443aba8ee95e9a61fa26e'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:10:20.956357 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-5907afc1-cd41-48ca-9c59-180810823d71 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1068d851e06443aba8ee95e9a61fa26e'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:10:20.957007 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-5907afc1-cd41-48ca-9c59-180810823d71 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1068d851e06443aba8ee95e9a61fa26e'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:10:20.964844 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-5907afc1-cd41-48ca-9c59-180810823d71 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1068d851e06443aba8ee95e9a61fa26e'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:10:20.977109 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-5907afc1-cd41-48ca-9c59-180810823d71 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1068d851e06443aba8ee95e9a61fa26e'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:10:20.982961 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1155/2371] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Oct 14 13:10:20 2022] DELETE /identity/v3/users/1068d851e06443aba8ee95e9a61fa26e => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:10:20.988068 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d99f96f-7254-449f-aecb-3bb644ec94c0 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:10:20.988068 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d99f96f-7254-449f-aecb-3bb644ec94c0 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:10:20.988552 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d99f96f-7254-449f-aecb-3bb644ec94c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:10:21.007474 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-4d99f96f-7254-449f-aecb-3bb644ec94c0 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:10:21.008678 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-4d99f96f-7254-449f-aecb-3bb644ec94c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:10:21.068319 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1217/2372] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:10:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:10:21.078011 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5907afc1-cd41-48ca-9c59-180810823d71 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:10:21.079434 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-5907afc1-cd41-48ca-9c59-180810823d71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:10:21.136616 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5907afc1-cd41-48ca-9c59-180810823d71 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:10:21.140262 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29ca8f8-4dc5-4af0-81db-8aa353ec6d26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d483292f3a4794848fcacfba5b107e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:10:21.140865 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29ca8f8-4dc5-4af0-81db-8aa353ec6d26 service neutron] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:10:21.141147 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29ca8f8-4dc5-4af0-81db-8aa353ec6d26 service neutron] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:10:21.141420 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29ca8f8-4dc5-4af0-81db-8aa353ec6d26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:10:21.151686 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29ca8f8-4dc5-4af0-81db-8aa353ec6d26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:10:21.153116 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29ca8f8-4dc5-4af0-81db-8aa353ec6d26 service neutron] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:10:21.162549 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1156/2373] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:10:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:10:21.444881 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d99f96f-7254-449f-aecb-3bb644ec94c0 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:10:21.446373 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-4d99f96f-7254-449f-aecb-3bb644ec94c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:10:21.459309 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d99f96f-7254-449f-aecb-3bb644ec94c0 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:10:21.466067 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ea6072-2257-4b4c-9ed3-ce52aac0d9dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:10:21.466764 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ea6072-2257-4b4c-9ed3-ce52aac0d9dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:10:21.467019 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ea6072-2257-4b4c-9ed3-ce52aac0d9dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:10:21.467300 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ea6072-2257-4b4c-9ed3-ce52aac0d9dc admin admin] PATH_INFO: `/v3/projects/ab05db7dfdcd4e048901a6afaedbd8f8` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:10:21.468404 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ea6072-2257-4b4c-9ed3-ce52aac0d9dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab05db7dfdcd4e048901a6afaedbd8f8)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:10:21.478909 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ea6072-2257-4b4c-9ed3-ce52aac0d9dc admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:10:21.528621 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-47ea6072-2257-4b4c-9ed3-ce52aac0d9dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab05db7dfdcd4e048901a6afaedbd8f8', 'request_id': 'req-47ea6072-2257-4b4c-9ed3-ce52aac0d9dc'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:10:21.534460 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-47ea6072-2257-4b4c-9ed3-ce52aac0d9dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab05db7dfdcd4e048901a6afaedbd8f8', 'request_id': 'req-47ea6072-2257-4b4c-9ed3-ce52aac0d9dc'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:10:21.541838 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-47ea6072-2257-4b4c-9ed3-ce52aac0d9dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab05db7dfdcd4e048901a6afaedbd8f8', 'request_id': 'req-47ea6072-2257-4b4c-9ed3-ce52aac0d9dc'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:10:21.554707 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-47ea6072-2257-4b4c-9ed3-ce52aac0d9dc admin admin] The token cache is being invalidate because project ab05db7dfdcd4e048901a6afaedbd8f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:10:21.554998 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-47ea6072-2257-4b4c-9ed3-ce52aac0d9dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:10:21.555629 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-47ea6072-2257-4b4c-9ed3-ce52aac0d9dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:10:21.557119 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1218/2374] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Oct 14 13:10:21 2022] DELETE /identity/v3/projects/ab05db7dfdcd4e048901a6afaedbd8f8 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 13:10:21.561179 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29ca8f8-4dc5-4af0-81db-8aa353ec6d26 service neutron] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:10:21.571141 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29ca8f8-4dc5-4af0-81db-8aa353ec6d26 service neutron] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:10:21.629942 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375ce3a0-1dfa-4de7-bb78-bfbb1dec81a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:10:21.630616 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375ce3a0-1dfa-4de7-bb78-bfbb1dec81a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:10:21.630901 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375ce3a0-1dfa-4de7-bb78-bfbb1dec81a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:10:21.631175 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375ce3a0-1dfa-4de7-bb78-bfbb1dec81a1 admin admin] PATH_INFO: `/v3/users/4e8915ec00f74fd0bb53fbecee46a547` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:10:21.632844 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375ce3a0-1dfa-4de7-bb78-bfbb1dec81a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e8915ec00f74fd0bb53fbecee46a547)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:10:21.634333 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375ce3a0-1dfa-4de7-bb78-bfbb1dec81a1 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:10:21.651532 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:10:21.684419 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-375ce3a0-1dfa-4de7-bb78-bfbb1dec81a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e8915ec00f74fd0bb53fbecee46a547'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:10:21.691385 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-375ce3a0-1dfa-4de7-bb78-bfbb1dec81a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e8915ec00f74fd0bb53fbecee46a547'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:10:21.692042 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-375ce3a0-1dfa-4de7-bb78-bfbb1dec81a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e8915ec00f74fd0bb53fbecee46a547'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:10:21.700040 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-375ce3a0-1dfa-4de7-bb78-bfbb1dec81a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e8915ec00f74fd0bb53fbecee46a547'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:10:21.712535 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-375ce3a0-1dfa-4de7-bb78-bfbb1dec81a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e8915ec00f74fd0bb53fbecee46a547'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:10:21.718796 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1157/2375] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Oct 14 13:10:21 2022] DELETE /identity/v3/users/4e8915ec00f74fd0bb53fbecee46a547 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:10:22.006845 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ea6072-2257-4b4c-9ed3-ce52aac0d9dc admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:10:22.008321 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-47ea6072-2257-4b4c-9ed3-ce52aac0d9dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:10:22.022160 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ea6072-2257-4b4c-9ed3-ce52aac0d9dc admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:10:22.082462 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996ccadd-8701-4b69-8fa4-c40714021b18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:10:22.083887 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996ccadd-8701-4b69-8fa4-c40714021b18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:10:22.084236 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996ccadd-8701-4b69-8fa4-c40714021b18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:10:22.084581 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996ccadd-8701-4b69-8fa4-c40714021b18 admin admin] PATH_INFO: `/v3/projects/6222f7d0036742138b20646a85b3d074` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:10:22.089878 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996ccadd-8701-4b69-8fa4-c40714021b18 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6222f7d0036742138b20646a85b3d074)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:10:22.092272 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996ccadd-8701-4b69-8fa4-c40714021b18 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:10:22.126939 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:10:22.145267 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-996ccadd-8701-4b69-8fa4-c40714021b18 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6222f7d0036742138b20646a85b3d074', 'request_id': 'req-996ccadd-8701-4b69-8fa4-c40714021b18'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:10:22.152047 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-996ccadd-8701-4b69-8fa4-c40714021b18 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6222f7d0036742138b20646a85b3d074', 'request_id': 'req-996ccadd-8701-4b69-8fa4-c40714021b18'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:10:22.159048 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-996ccadd-8701-4b69-8fa4-c40714021b18 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6222f7d0036742138b20646a85b3d074', 'request_id': 'req-996ccadd-8701-4b69-8fa4-c40714021b18'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:10:22.172752 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-996ccadd-8701-4b69-8fa4-c40714021b18 admin admin] The token cache is being invalidate because project 6222f7d0036742138b20646a85b3d074 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:10:22.173042 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-996ccadd-8701-4b69-8fa4-c40714021b18 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:10:22.173698 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-996ccadd-8701-4b69-8fa4-c40714021b18 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:10:22.175202 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1219/2376] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Oct 14 13:10:22 2022] DELETE /identity/v3/projects/6222f7d0036742138b20646a85b3d074 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:10:22.180139 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f12f70d-ba6f-442a-bc55-02cd2c223698 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:10:22.180622 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f12f70d-ba6f-442a-bc55-02cd2c223698 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:10:22.180724 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f12f70d-ba6f-442a-bc55-02cd2c223698 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:10:22.200720 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-5f12f70d-ba6f-442a-bc55-02cd2c223698 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:10:22.201911 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-5f12f70d-ba6f-442a-bc55-02cd2c223698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:10:22.260931 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1158/2377] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:10:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:10:22.268680 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59aa714-5eb3-474a-ad63-bb9a94f88892 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:10:22.268960 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59aa714-5eb3-474a-ad63-bb9a94f88892 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:10:22.269233 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59aa714-5eb3-474a-ad63-bb9a94f88892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:10:22.289240 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-f59aa714-5eb3-474a-ad63-bb9a94f88892 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:10:22.290475 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-f59aa714-5eb3-474a-ad63-bb9a94f88892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:10:22.298295 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1220/2378] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:10:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:10:22.302627 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f12f70d-ba6f-442a-bc55-02cd2c223698 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:10:22.312386 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f12f70d-ba6f-442a-bc55-02cd2c223698 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:10:22.316889 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035852d9-43a5-458b-adad-15567f588739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:10:22.317995 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035852d9-43a5-458b-adad-15567f588739 admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:10:22.318312 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035852d9-43a5-458b-adad-15567f588739 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:10:22.318773 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035852d9-43a5-458b-adad-15567f588739 admin admin] PATH_INFO: `/v3/domains` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:10:22.319420 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035852d9-43a5-458b-adad-15567f588739 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 13:10:22.319728 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035852d9-43a5-458b-adad-15567f588739 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:10:22.321349 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035852d9-43a5-458b-adad-15567f588739 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:10:22.332662 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1159/2379] 10.222.0.17 () {58 vars in 1153 bytes} [Fri Oct 14 13:10:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 13:10:22.337649 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59aa714-5eb3-474a-ad63-bb9a94f88892 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:10:22.347095 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59aa714-5eb3-474a-ad63-bb9a94f88892 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:10:22.352666 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9399763-8974-4c2b-bff0-f5743a1a1186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:10:22.353251 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9399763-8974-4c2b-bff0-f5743a1a1186 admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:10:22.353531 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9399763-8974-4c2b-bff0-f5743a1a1186 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:10:22.353853 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9399763-8974-4c2b-bff0-f5743a1a1186 admin admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:10:22.354502 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9399763-8974-4c2b-bff0-f5743a1a1186 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:10:22.356491 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9399763-8974-4c2b-bff0-f5743a1a1186 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:10:22.384297 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1221/2380] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Oct 14 13:10:22 2022] POST /identity/v3/projects => generated 371 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:10:22.388440 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035852d9-43a5-458b-adad-15567f588739 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:10:22.399219 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035852d9-43a5-458b-adad-15567f588739 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:10:22.454243 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27878a12-4427-441c-af5e-e580153c234a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:10:22.454847 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27878a12-4427-441c-af5e-e580153c234a admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:10:22.455129 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27878a12-4427-441c-af5e-e580153c234a admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:10:22.455407 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27878a12-4427-441c-af5e-e580153c234a admin admin] PATH_INFO: `/v3/users` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:10:22.456036 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27878a12-4427-441c-af5e-e580153c234a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:10:22.458017 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27878a12-4427-441c-af5e-e580153c234a admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:10:22.479337 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1160/2381] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Oct 14 13:10:22 2022] POST /identity/v3/users => generated 286 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:10:22.483456 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9399763-8974-4c2b-bff0-f5743a1a1186 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:10:22.493605 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9399763-8974-4c2b-bff0-f5743a1a1186 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:10:22.498345 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c60aba-2cb5-4018-95b4-0a037e3cca68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:10:22.498940 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c60aba-2cb5-4018-95b4-0a037e3cca68 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:10:22.499221 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c60aba-2cb5-4018-95b4-0a037e3cca68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:10:22.499493 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c60aba-2cb5-4018-95b4-0a037e3cca68 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:10:22.500128 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c60aba-2cb5-4018-95b4-0a037e3cca68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:10:22.501739 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c60aba-2cb5-4018-95b4-0a037e3cca68 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:10:22.512031 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1222/2382] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:10:22 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 14 13:10:22.515778 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27878a12-4427-441c-af5e-e580153c234a admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:10:22.526764 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27878a12-4427-441c-af5e-e580153c234a admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:10:22.531410 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e185ab-ca0c-440f-b33d-d1d4de560ad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:10:22.532002 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e185ab-ca0c-440f-b33d-d1d4de560ad3 admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:10:22.532286 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e185ab-ca0c-440f-b33d-d1d4de560ad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:10:22.532563 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e185ab-ca0c-440f-b33d-d1d4de560ad3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:10:22.533204 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e185ab-ca0c-440f-b33d-d1d4de560ad3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:10:22.534844 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e185ab-ca0c-440f-b33d-d1d4de560ad3 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:10:22.540047 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:10:22.545924 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1161/2383] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:10:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:10:22.550387 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c60aba-2cb5-4018-95b4-0a037e3cca68 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:10:22.560945 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c60aba-2cb5-4018-95b4-0a037e3cca68 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:10:22.565642 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f111969c-f538-4430-8880-c5ceaf5b92f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:10:22.566325 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f111969c-f538-4430-8880-c5ceaf5b92f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:10:22.566606 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f111969c-f538-4430-8880-c5ceaf5b92f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:10:22.566884 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f111969c-f538-4430-8880-c5ceaf5b92f9 admin admin] PATH_INFO: `/v3/projects/0447243e3da1437592c71bb26105a8a7/users/711937a8d0ff4fdfa94fc15281216c7f/roles/5e8849303a75425b9eaa2681cc031af1` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:10:22.581687 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f111969c-f538-4430-8880-c5ceaf5b92f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0447243e3da1437592c71bb26105a8a7, user_id=711937a8d0ff4fdfa94fc15281216c7f, role_id=5e8849303a75425b9eaa2681cc031af1)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:10:22.584444 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f111969c-f538-4430-8880-c5ceaf5b92f9 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:10:22.597402 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1223/2384] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Oct 14 13:10:22 2022] PUT /identity/v3/projects/0447243e3da1437592c71bb26105a8a7/users/711937a8d0ff4fdfa94fc15281216c7f/roles/5e8849303a75425b9eaa2681cc031af1 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:10:22.602747 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715b7b4f-fa5b-43ca-9192-552ba40fddfb None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:10:22.603030 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715b7b4f-fa5b-43ca-9192-552ba40fddfb None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:10:22.603303 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715b7b4f-fa5b-43ca-9192-552ba40fddfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:10:22.622328 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-715b7b4f-fa5b-43ca-9192-552ba40fddfb None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:10:22.623523 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-715b7b4f-fa5b-43ca-9192-552ba40fddfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:10:22.686711 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1162/2385] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:10:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:10:22.696939 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f111969c-f538-4430-8880-c5ceaf5b92f9 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:10:22.698691 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-f111969c-f538-4430-8880-c5ceaf5b92f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:10:22.757185 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f111969c-f538-4430-8880-c5ceaf5b92f9 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:10:22.760809 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ac9bcd-adfc-46d9-9cc1-8247252db06a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d483292f3a4794848fcacfba5b107e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:10:22.761407 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ac9bcd-adfc-46d9-9cc1-8247252db06a service neutron] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:10:22.761684 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ac9bcd-adfc-46d9-9cc1-8247252db06a service neutron] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:10:22.761956 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ac9bcd-adfc-46d9-9cc1-8247252db06a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:10:22.771331 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ac9bcd-adfc-46d9-9cc1-8247252db06a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:10:22.772777 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ac9bcd-adfc-46d9-9cc1-8247252db06a service neutron] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:10:22.782970 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1224/2386] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:10:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:10:23.410953 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92580f2-7cf4-4986-b9e5-60f78531cc06 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:10:23.411548 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92580f2-7cf4-4986-b9e5-60f78531cc06 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:10:23.412073 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92580f2-7cf4-4986-b9e5-60f78531cc06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:10:23.441206 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-c92580f2-7cf4-4986-b9e5-60f78531cc06 None None] MFA Rules not processed for user `711937a8d0ff4fdfa94fc15281216c7f`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:10:23.443662 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-c92580f2-7cf4-4986-b9e5-60f78531cc06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:10:23.514895 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1163/2387] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:10:23 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:10:23.519360 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ac9bcd-adfc-46d9-9cc1-8247252db06a service neutron] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:10:23.530449 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ac9bcd-adfc-46d9-9cc1-8247252db06a service neutron] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:10:23.535374 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77c33fc-c838-467a-84e2-befa0bb35d21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:10:23.536046 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77c33fc-c838-467a-84e2-befa0bb35d21 admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:10:23.536428 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77c33fc-c838-467a-84e2-befa0bb35d21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:10:23.537223 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77c33fc-c838-467a-84e2-befa0bb35d21 admin admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:10:23.537868 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77c33fc-c838-467a-84e2-befa0bb35d21 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:10:23.539858 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77c33fc-c838-467a-84e2-befa0bb35d21 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:10:23.578320 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1225/2388] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Oct 14 13:10:23 2022] POST /identity/v3/projects => generated 371 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 13:10:23.580048 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92580f2-7cf4-4986-b9e5-60f78531cc06 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:10:23.592152 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92580f2-7cf4-4986-b9e5-60f78531cc06 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:10:23.659130 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2557b5a-2117-467c-8e63-843917dc3389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:10:23.659747 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2557b5a-2117-467c-8e63-843917dc3389 admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:10:23.660040 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2557b5a-2117-467c-8e63-843917dc3389 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:10:23.660316 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2557b5a-2117-467c-8e63-843917dc3389 admin admin] PATH_INFO: `/v3/users` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:10:23.660989 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2557b5a-2117-467c-8e63-843917dc3389 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:10:23.663512 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2557b5a-2117-467c-8e63-843917dc3389 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:10:23.684714 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1164/2389] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Oct 14 13:10:23 2022] POST /identity/v3/users => generated 292 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:10:23.688721 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77c33fc-c838-467a-84e2-befa0bb35d21 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:10:23.699350 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77c33fc-c838-467a-84e2-befa0bb35d21 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:10:23.703808 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7684a3dc-9ff5-4598-b539-1989fc8eb55e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:10:23.704409 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7684a3dc-9ff5-4598-b539-1989fc8eb55e admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:10:23.704683 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7684a3dc-9ff5-4598-b539-1989fc8eb55e admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:10:23.704954 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7684a3dc-9ff5-4598-b539-1989fc8eb55e admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:10:23.705591 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7684a3dc-9ff5-4598-b539-1989fc8eb55e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:10:23.707214 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7684a3dc-9ff5-4598-b539-1989fc8eb55e admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:10:23.718691 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1226/2390] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:10:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:10:23.723007 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2557b5a-2117-467c-8e63-843917dc3389 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:10:23.736625 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2557b5a-2117-467c-8e63-843917dc3389 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:10:23.742737 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb5277b-5b3c-4bfa-a822-da0a527132c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:10:23.743397 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb5277b-5b3c-4bfa-a822-da0a527132c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:10:23.743679 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb5277b-5b3c-4bfa-a822-da0a527132c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:10:23.743952 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb5277b-5b3c-4bfa-a822-da0a527132c0 admin admin] PATH_INFO: `/v3/projects/999940562f3d4e84b7f4113598b6f30e/users/cb0b8b50cd5c43c9be3d0cc4ecb639bc/roles/7f6e29e390bc41f7a9af17659a2e95d1` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:10:23.761364 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb5277b-5b3c-4bfa-a822-da0a527132c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=999940562f3d4e84b7f4113598b6f30e, user_id=cb0b8b50cd5c43c9be3d0cc4ecb639bc, role_id=7f6e29e390bc41f7a9af17659a2e95d1)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:10:23.763098 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb5277b-5b3c-4bfa-a822-da0a527132c0 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:10:23.766603 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:10:23.778629 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1165/2391] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Oct 14 13:10:23 2022] PUT /identity/v3/projects/999940562f3d4e84b7f4113598b6f30e/users/cb0b8b50cd5c43c9be3d0cc4ecb639bc/roles/7f6e29e390bc41f7a9af17659a2e95d1 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:10:23.782567 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7684a3dc-9ff5-4598-b539-1989fc8eb55e admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:10:23.794744 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7684a3dc-9ff5-4598-b539-1989fc8eb55e admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:10:23.812940 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:10:23.857834 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19df5287-def0-4463-a35a-fa32e74abe00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:10:23.858480 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19df5287-def0-4463-a35a-fa32e74abe00 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:10:23.858761 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19df5287-def0-4463-a35a-fa32e74abe00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:10:23.859034 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19df5287-def0-4463-a35a-fa32e74abe00 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:10:23.859672 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19df5287-def0-4463-a35a-fa32e74abe00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:10:23.861276 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19df5287-def0-4463-a35a-fa32e74abe00 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:10:23.871595 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1227/2392] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:10:23 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:10:23.875896 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb5277b-5b3c-4bfa-a822-da0a527132c0 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:10:23.887052 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb5277b-5b3c-4bfa-a822-da0a527132c0 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:10:23.892322 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9021f311-4301-403d-b0bf-7ae71197b5e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:10:23.893044 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9021f311-4301-403d-b0bf-7ae71197b5e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:10:23.893325 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9021f311-4301-403d-b0bf-7ae71197b5e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:10:23.893603 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9021f311-4301-403d-b0bf-7ae71197b5e5 admin admin] PATH_INFO: `/v3/projects/999940562f3d4e84b7f4113598b6f30e/users/cb0b8b50cd5c43c9be3d0cc4ecb639bc/roles/7f6e29e390bc41f7a9af17659a2e95d1` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:10:23.896791 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9021f311-4301-403d-b0bf-7ae71197b5e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=999940562f3d4e84b7f4113598b6f30e, user_id=cb0b8b50cd5c43c9be3d0cc4ecb639bc, role_id=7f6e29e390bc41f7a9af17659a2e95d1)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:10:23.899578 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9021f311-4301-403d-b0bf-7ae71197b5e5 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:10:23.910943 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1166/2393] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Oct 14 13:10:23 2022] PUT /identity/v3/projects/999940562f3d4e84b7f4113598b6f30e/users/cb0b8b50cd5c43c9be3d0cc4ecb639bc/roles/7f6e29e390bc41f7a9af17659a2e95d1 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:10:24.600188 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9f92c7-13c9-439d-8809-7652e3fab30c None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:10:24.600670 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9f92c7-13c9-439d-8809-7652e3fab30c None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:10:24.600998 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9f92c7-13c9-439d-8809-7652e3fab30c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:10:24.630088 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-4e9f92c7-13c9-439d-8809-7652e3fab30c None None] MFA Rules not processed for user `cb0b8b50cd5c43c9be3d0cc4ecb639bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:10:24.631536 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-4e9f92c7-13c9-439d-8809-7652e3fab30c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:10:24.703477 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1228/2394] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:10:24 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:10:24.715205 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c6d41f-66b9-473b-a820-d539b94cfba4 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:10:24.716325 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c6d41f-66b9-473b-a820-d539b94cfba4 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:10:24.716599 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c6d41f-66b9-473b-a820-d539b94cfba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:10:24.736818 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-29c6d41f-66b9-473b-a820-d539b94cfba4 None None] MFA Rules not processed for user `711937a8d0ff4fdfa94fc15281216c7f`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:10:24.738031 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-29c6d41f-66b9-473b-a820-d539b94cfba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:10:24.794899 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1167/2395] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:10:24 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:10:24.807211 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9f92c7-13c9-439d-8809-7652e3fab30c None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:10:24.808615 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-4e9f92c7-13c9-439d-8809-7652e3fab30c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:10:24.883611 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9f92c7-13c9-439d-8809-7652e3fab30c None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:10:24.889082 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3513801-a1ee-4ad4-b805-a149a193d4fd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '931f4e32c8764514b5efed31b0785be7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:10:24.889675 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3513801-a1ee-4ad4-b805-a149a193d4fd service nova] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:10:24.889954 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3513801-a1ee-4ad4-b805-a149a193d4fd service nova] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:10:24.890319 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3513801-a1ee-4ad4-b805-a149a193d4fd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:10:24.898619 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3513801-a1ee-4ad4-b805-a149a193d4fd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:10:24.900262 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3513801-a1ee-4ad4-b805-a149a193d4fd service nova] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:10:24.908868 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1229/2396] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:10:24 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:10:25.551416 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312c6f2f-4ed7-4fcc-ae53-9e7a25e95821 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:10:25.552331 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312c6f2f-4ed7-4fcc-ae53-9e7a25e95821 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:10:25.552691 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312c6f2f-4ed7-4fcc-ae53-9e7a25e95821 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:10:25.572759 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-312c6f2f-4ed7-4fcc-ae53-9e7a25e95821 None None] MFA Rules not processed for user `beaf3b456bcc470e870e7add91b31a52`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:10:25.573981 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-312c6f2f-4ed7-4fcc-ae53-9e7a25e95821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:10:25.629373 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1168/2397] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:10:25 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:10:34.904927 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=88 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:10:35.622592 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=57,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:10:40.245944 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3513801-a1ee-4ad4-b805-a149a193d4fd service nova] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:10:40.247431 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-f3513801-a1ee-4ad4-b805-a149a193d4fd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:10:40.305215 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3513801-a1ee-4ad4-b805-a149a193d4fd service nova] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:10:40.309041 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90722b68-bfd4-4c7f-9369-b20d7824615e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c3c564b8c548e4beef1cbfba2ad343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:10:40.309653 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90722b68-bfd4-4c7f-9369-b20d7824615e service cinder] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:10:40.309931 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90722b68-bfd4-4c7f-9369-b20d7824615e service cinder] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:10:40.310234 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90722b68-bfd4-4c7f-9369-b20d7824615e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:10:40.322624 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90722b68-bfd4-4c7f-9369-b20d7824615e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:10:40.324087 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90722b68-bfd4-4c7f-9369-b20d7824615e service cinder] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:10:40.335184 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1230/2398] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:10:40 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:10:46.129917 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efe0c1a-f828-45ac-a5e9-6ee2cf926d7d None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:10:46.130402 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efe0c1a-f828-45ac-a5e9-6ee2cf926d7d None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:10:46.130511 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efe0c1a-f828-45ac-a5e9-6ee2cf926d7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:10:46.161039 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-0efe0c1a-f828-45ac-a5e9-6ee2cf926d7d None None] MFA Rules not processed for user `b83a5a78f3e7486293907cb3012c0ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:10:46.162755 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-0efe0c1a-f828-45ac-a5e9-6ee2cf926d7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:10:46.217569 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1169/2399] 10.222.0.17 () {58 vars in 1009 bytes} [Fri Oct 14 13:10:46 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:10:46.263247 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90722b68-bfd4-4c7f-9369-b20d7824615e service cinder] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:10:46.264738 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-90722b68-bfd4-4c7f-9369-b20d7824615e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:10:46.334234 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90722b68-bfd4-4c7f-9369-b20d7824615e service cinder] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:10:46.339351 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f8f623-51d7-4395-872b-b9f00854bcba service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c9fc57b1ec4d00b9f392877f277284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:10:46.339956 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f8f623-51d7-4395-872b-b9f00854bcba service swift] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:10:46.340233 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f8f623-51d7-4395-872b-b9f00854bcba service swift] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:10:46.340757 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f8f623-51d7-4395-872b-b9f00854bcba service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:10:46.349108 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f8f623-51d7-4395-872b-b9f00854bcba service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:10:46.351590 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f8f623-51d7-4395-872b-b9f00854bcba service swift] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:10:46.359733 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1231/2400] 10.222.0.17 () {60 vars in 1384 bytes} [Fri Oct 14 13:10:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 14 13:10:56.210832 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=29 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:10:56.356396 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=58 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:11:02.195043 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efe0c1a-f828-45ac-a5e9-6ee2cf926d7d None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:11:02.266872 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efe0c1a-f828-45ac-a5e9-6ee2cf926d7d None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:11:02.272542 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026b809d-0884-47a2-a631-93703dbc31e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:11:02.273180 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026b809d-0884-47a2-a631-93703dbc31e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:11:02.273464 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026b809d-0884-47a2-a631-93703dbc31e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:11:02.273745 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026b809d-0884-47a2-a631-93703dbc31e2 admin admin] PATH_INFO: `/v3/users/711937a8d0ff4fdfa94fc15281216c7f` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:11:02.275111 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026b809d-0884-47a2-a631-93703dbc31e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=711937a8d0ff4fdfa94fc15281216c7f)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:11:02.277044 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026b809d-0884-47a2-a631-93703dbc31e2 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:11:02.323450 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-026b809d-0884-47a2-a631-93703dbc31e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '711937a8d0ff4fdfa94fc15281216c7f'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:11:02.330605 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-026b809d-0884-47a2-a631-93703dbc31e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '711937a8d0ff4fdfa94fc15281216c7f'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:11:02.331292 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-026b809d-0884-47a2-a631-93703dbc31e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '711937a8d0ff4fdfa94fc15281216c7f'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:11:02.338860 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-026b809d-0884-47a2-a631-93703dbc31e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '711937a8d0ff4fdfa94fc15281216c7f'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:11:02.352116 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-026b809d-0884-47a2-a631-93703dbc31e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '711937a8d0ff4fdfa94fc15281216c7f'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:11:02.357967 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1170/2401] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Oct 14 13:11:02 2022] DELETE /identity/v3/users/711937a8d0ff4fdfa94fc15281216c7f => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:11:02.530081 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f8f623-51d7-4395-872b-b9f00854bcba service swift] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:11:02.541798 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f8f623-51d7-4395-872b-b9f00854bcba service swift] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:11:02.599679 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f899b83-bd55-422d-8430-61d1f3f45016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:11:02.600300 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f899b83-bd55-422d-8430-61d1f3f45016 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:11:02.600575 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f899b83-bd55-422d-8430-61d1f3f45016 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:11:02.600845 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f899b83-bd55-422d-8430-61d1f3f45016 admin admin] PATH_INFO: `/v3/projects/0447243e3da1437592c71bb26105a8a7` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:11:02.601947 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f899b83-bd55-422d-8430-61d1f3f45016 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0447243e3da1437592c71bb26105a8a7)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:11:02.603884 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f899b83-bd55-422d-8430-61d1f3f45016 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:11:02.648950 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-0f899b83-bd55-422d-8430-61d1f3f45016 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0447243e3da1437592c71bb26105a8a7', 'request_id': 'req-0f899b83-bd55-422d-8430-61d1f3f45016'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:11:02.654365 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-0f899b83-bd55-422d-8430-61d1f3f45016 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0447243e3da1437592c71bb26105a8a7', 'request_id': 'req-0f899b83-bd55-422d-8430-61d1f3f45016'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:11:02.660376 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-0f899b83-bd55-422d-8430-61d1f3f45016 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0447243e3da1437592c71bb26105a8a7', 'request_id': 'req-0f899b83-bd55-422d-8430-61d1f3f45016'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:11:02.672774 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-0f899b83-bd55-422d-8430-61d1f3f45016 admin admin] The token cache is being invalidate because project 0447243e3da1437592c71bb26105a8a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:11:02.673063 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-0f899b83-bd55-422d-8430-61d1f3f45016 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:11:02.673688 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-0f899b83-bd55-422d-8430-61d1f3f45016 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:11:02.675219 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1232/2402] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Oct 14 13:11:02 2022] DELETE /identity/v3/projects/0447243e3da1437592c71bb26105a8a7 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:11:02.679447 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026b809d-0884-47a2-a631-93703dbc31e2 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:11:02.680913 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-026b809d-0884-47a2-a631-93703dbc31e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:11:02.694395 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026b809d-0884-47a2-a631-93703dbc31e2 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:11:02.751968 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe35729-78a4-41c1-8f26-d710686d0ab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:11:02.752769 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe35729-78a4-41c1-8f26-d710686d0ab7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:11:02.753128 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe35729-78a4-41c1-8f26-d710686d0ab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:11:02.753405 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe35729-78a4-41c1-8f26-d710686d0ab7 admin admin] PATH_INFO: `/v3/users/cb0b8b50cd5c43c9be3d0cc4ecb639bc` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:11:02.754577 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe35729-78a4-41c1-8f26-d710686d0ab7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb0b8b50cd5c43c9be3d0cc4ecb639bc)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:11:02.757534 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe35729-78a4-41c1-8f26-d710686d0ab7 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:11:02.780782 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:11:02.808562 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-5fe35729-78a4-41c1-8f26-d710686d0ab7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb0b8b50cd5c43c9be3d0cc4ecb639bc'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:11:02.815651 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-5fe35729-78a4-41c1-8f26-d710686d0ab7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb0b8b50cd5c43c9be3d0cc4ecb639bc'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:11:02.816321 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-5fe35729-78a4-41c1-8f26-d710686d0ab7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb0b8b50cd5c43c9be3d0cc4ecb639bc'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:11:02.824672 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-5fe35729-78a4-41c1-8f26-d710686d0ab7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb0b8b50cd5c43c9be3d0cc4ecb639bc'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:11:02.837954 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-5fe35729-78a4-41c1-8f26-d710686d0ab7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb0b8b50cd5c43c9be3d0cc4ecb639bc'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:11:02.844289 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1171/2403] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Oct 14 13:11:02 2022] DELETE /identity/v3/users/cb0b8b50cd5c43c9be3d0cc4ecb639bc => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 13:11:02.876493 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fc307c-9427-4076-9674-742a21a38a13 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:11:02.876777 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fc307c-9427-4076-9674-742a21a38a13 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:11:02.877051 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fc307c-9427-4076-9674-742a21a38a13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:11:02.898730 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-96fc307c-9427-4076-9674-742a21a38a13 None None] MFA Rules not processed for user `b83a5a78f3e7486293907cb3012c0ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:11:02.899965 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-96fc307c-9427-4076-9674-742a21a38a13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:11:02.955283 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1233/2404] 10.222.0.17 () {58 vars in 967 bytes} [Fri Oct 14 13:11:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:11:02.969218 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe35729-78a4-41c1-8f26-d710686d0ab7 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:11:02.970833 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-5fe35729-78a4-41c1-8f26-d710686d0ab7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:11:03.022512 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fc307c-9427-4076-9674-742a21a38a13 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:11:03.024094 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-96fc307c-9427-4076-9674-742a21a38a13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:11:03.046491 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe35729-78a4-41c1-8f26-d710686d0ab7 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:11:03.052468 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b3bded-5860-4c39-9cff-b2cfb094c95f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c9fc57b1ec4d00b9f392877f277284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:11:03.053121 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b3bded-5860-4c39-9cff-b2cfb094c95f service swift] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:11:03.053348 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b3bded-5860-4c39-9cff-b2cfb094c95f service swift] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:11:03.053621 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b3bded-5860-4c39-9cff-b2cfb094c95f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:11:03.062508 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b3bded-5860-4c39-9cff-b2cfb094c95f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:11:03.064339 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b3bded-5860-4c39-9cff-b2cfb094c95f service swift] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:11:03.073289 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1172/2405] 10.222.0.17 () {60 vars in 1384 bytes} [Fri Oct 14 13:11:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 14 13:11:03.073515 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:11:03.111273 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fc307c-9427-4076-9674-742a21a38a13 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:11:03.116425 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278b7896-aad2-43ce-ac41-9f23d62c593a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:11:03.117060 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278b7896-aad2-43ce-ac41-9f23d62c593a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:11:03.117338 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278b7896-aad2-43ce-ac41-9f23d62c593a admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:11:03.117606 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278b7896-aad2-43ce-ac41-9f23d62c593a admin admin] PATH_INFO: `/v3/projects/999940562f3d4e84b7f4113598b6f30e` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:11:03.118762 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278b7896-aad2-43ce-ac41-9f23d62c593a admin admin] RBAC: Authorizing `identity:delete_project(project_id=999940562f3d4e84b7f4113598b6f30e)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:11:03.120686 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278b7896-aad2-43ce-ac41-9f23d62c593a admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:11:03.172095 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-278b7896-aad2-43ce-ac41-9f23d62c593a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '999940562f3d4e84b7f4113598b6f30e', 'request_id': 'req-278b7896-aad2-43ce-ac41-9f23d62c593a'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:11:03.179230 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-278b7896-aad2-43ce-ac41-9f23d62c593a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '999940562f3d4e84b7f4113598b6f30e', 'request_id': 'req-278b7896-aad2-43ce-ac41-9f23d62c593a'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:11:03.185748 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-278b7896-aad2-43ce-ac41-9f23d62c593a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '999940562f3d4e84b7f4113598b6f30e', 'request_id': 'req-278b7896-aad2-43ce-ac41-9f23d62c593a'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:11:03.199695 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-278b7896-aad2-43ce-ac41-9f23d62c593a admin admin] The token cache is being invalidate because project 999940562f3d4e84b7f4113598b6f30e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:11:03.199977 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-278b7896-aad2-43ce-ac41-9f23d62c593a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:11:03.200635 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-278b7896-aad2-43ce-ac41-9f23d62c593a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:11:03.202149 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1234/2406] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Oct 14 13:11:03 2022] DELETE /identity/v3/projects/999940562f3d4e84b7f4113598b6f30e => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:11:03.206939 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d40866a-0c6a-409e-8a34-5f43a1d53d22 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:11:03.207377 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d40866a-0c6a-409e-8a34-5f43a1d53d22 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:11:03.207528 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d40866a-0c6a-409e-8a34-5f43a1d53d22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:11:03.230106 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-8d40866a-0c6a-409e-8a34-5f43a1d53d22 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:11:03.231379 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-8d40866a-0c6a-409e-8a34-5f43a1d53d22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:11:03.295353 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1173/2407] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:11:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:11:03.304020 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82534996-82df-4e93-a401-c6967367b089 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:11:03.304485 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82534996-82df-4e93-a401-c6967367b089 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:11:03.304592 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82534996-82df-4e93-a401-c6967367b089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:11:03.327083 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-82534996-82df-4e93-a401-c6967367b089 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:11:03.328431 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-82534996-82df-4e93-a401-c6967367b089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:11:03.336866 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1235/2408] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:11:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:11:03.341486 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d40866a-0c6a-409e-8a34-5f43a1d53d22 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:11:03.351879 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d40866a-0c6a-409e-8a34-5f43a1d53d22 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:11:03.357028 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39edec67-2ef5-4b16-a144-0a8f95b7e583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:11:03.357640 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39edec67-2ef5-4b16-a144-0a8f95b7e583 admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:11:03.357919 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39edec67-2ef5-4b16-a144-0a8f95b7e583 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:11:03.358221 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39edec67-2ef5-4b16-a144-0a8f95b7e583 admin admin] PATH_INFO: `/v3/domains` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:11:03.358888 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39edec67-2ef5-4b16-a144-0a8f95b7e583 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 13:11:03.359200 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39edec67-2ef5-4b16-a144-0a8f95b7e583 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:11:03.360808 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39edec67-2ef5-4b16-a144-0a8f95b7e583 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:11:03.374110 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1174/2409] 10.222.0.17 () {58 vars in 1153 bytes} [Fri Oct 14 13:11:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 13:11:03.378231 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82534996-82df-4e93-a401-c6967367b089 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:11:03.388386 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82534996-82df-4e93-a401-c6967367b089 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:11:03.393024 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf7c3bf-1475-401c-be1f-cadf92b76ee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:11:03.393616 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf7c3bf-1475-401c-be1f-cadf92b76ee5 admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:11:03.393892 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf7c3bf-1475-401c-be1f-cadf92b76ee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:11:03.394187 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf7c3bf-1475-401c-be1f-cadf92b76ee5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:11:03.394823 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf7c3bf-1475-401c-be1f-cadf92b76ee5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:11:03.396832 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf7c3bf-1475-401c-be1f-cadf92b76ee5 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:11:03.442793 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1236/2410] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Oct 14 13:11:03 2022] POST /identity/v3/projects => generated 379 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:11:03.444344 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39edec67-2ef5-4b16-a144-0a8f95b7e583 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:11:03.455274 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39edec67-2ef5-4b16-a144-0a8f95b7e583 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:11:03.474439 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:11:03.517395 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66b3b55-73ec-44cf-9162-653e3ec10c8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:11:03.518000 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66b3b55-73ec-44cf-9162-653e3ec10c8f admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:11:03.518317 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66b3b55-73ec-44cf-9162-653e3ec10c8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:11:03.518595 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66b3b55-73ec-44cf-9162-653e3ec10c8f admin admin] PATH_INFO: `/v3/users` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:11:03.519231 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66b3b55-73ec-44cf-9162-653e3ec10c8f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:11:03.521354 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66b3b55-73ec-44cf-9162-653e3ec10c8f admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:11:03.544339 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1175/2411] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Oct 14 13:11:03 2022] POST /identity/v3/users => generated 290 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:11:03.548527 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf7c3bf-1475-401c-be1f-cadf92b76ee5 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:11:03.560216 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf7c3bf-1475-401c-be1f-cadf92b76ee5 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:11:03.564958 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacedf4f-5339-494f-bb46-5b06c1374aa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:11:03.565552 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacedf4f-5339-494f-bb46-5b06c1374aa0 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:11:03.565829 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacedf4f-5339-494f-bb46-5b06c1374aa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:11:03.566154 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacedf4f-5339-494f-bb46-5b06c1374aa0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:11:03.566782 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacedf4f-5339-494f-bb46-5b06c1374aa0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:11:03.568490 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacedf4f-5339-494f-bb46-5b06c1374aa0 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:11:03.582002 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1237/2412] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:11:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:11:03.583461 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66b3b55-73ec-44cf-9162-653e3ec10c8f admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:11:03.593657 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66b3b55-73ec-44cf-9162-653e3ec10c8f admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:11:03.598289 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dd55aa-9d1a-4071-8278-a93c979e16fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:11:03.599388 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dd55aa-9d1a-4071-8278-a93c979e16fe admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:11:03.599659 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dd55aa-9d1a-4071-8278-a93c979e16fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:11:03.599927 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dd55aa-9d1a-4071-8278-a93c979e16fe admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:11:03.600560 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dd55aa-9d1a-4071-8278-a93c979e16fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:11:03.602157 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dd55aa-9d1a-4071-8278-a93c979e16fe admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:11:03.612250 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1176/2413] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:11:03 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:11:03.617148 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacedf4f-5339-494f-bb46-5b06c1374aa0 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:11:03.628488 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacedf4f-5339-494f-bb46-5b06c1374aa0 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:11:03.633244 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53604cef-c7e1-486c-bf87-44969aebc70d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:11:03.633884 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53604cef-c7e1-486c-bf87-44969aebc70d admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:11:03.634188 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53604cef-c7e1-486c-bf87-44969aebc70d admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:11:03.634465 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53604cef-c7e1-486c-bf87-44969aebc70d admin admin] PATH_INFO: `/v3/projects/9e429557b83e418a923e5e627ad310ad/users/c937830321294d1f9e82e7a134a42804/roles/5e8849303a75425b9eaa2681cc031af1` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:11:03.649031 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53604cef-c7e1-486c-bf87-44969aebc70d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e429557b83e418a923e5e627ad310ad, user_id=c937830321294d1f9e82e7a134a42804, role_id=5e8849303a75425b9eaa2681cc031af1)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:11:03.651701 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53604cef-c7e1-486c-bf87-44969aebc70d admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:11:03.664560 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1238/2414] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Oct 14 13:11:03 2022] PUT /identity/v3/projects/9e429557b83e418a923e5e627ad310ad/users/c937830321294d1f9e82e7a134a42804/roles/5e8849303a75425b9eaa2681cc031af1 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:11:03.676314 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ec7c3c-9d43-4cd1-b6e3-c7721396b671 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:11:03.676708 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ec7c3c-9d43-4cd1-b6e3-c7721396b671 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:11:03.677736 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ec7c3c-9d43-4cd1-b6e3-c7721396b671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:11:03.704855 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-23ec7c3c-9d43-4cd1-b6e3-c7721396b671 None None] MFA Rules not processed for user `c937830321294d1f9e82e7a134a42804`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:11:03.706071 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-23ec7c3c-9d43-4cd1-b6e3-c7721396b671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:11:03.770179 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1177/2415] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:11:03 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 13:11:03.781856 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53604cef-c7e1-486c-bf87-44969aebc70d admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:11:03.783677 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-53604cef-c7e1-486c-bf87-44969aebc70d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:11:03.841370 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53604cef-c7e1-486c-bf87-44969aebc70d admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:11:03.845071 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447a8a86-be98-4c7b-ab98-b0ff55c00ecb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c3c564b8c548e4beef1cbfba2ad343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:11:03.845666 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447a8a86-be98-4c7b-ab98-b0ff55c00ecb service cinder] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:11:03.845946 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447a8a86-be98-4c7b-ab98-b0ff55c00ecb service cinder] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:11:03.846253 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447a8a86-be98-4c7b-ab98-b0ff55c00ecb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:11:03.853077 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:11:03.855547 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447a8a86-be98-4c7b-ab98-b0ff55c00ecb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:11:03.857532 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447a8a86-be98-4c7b-ab98-b0ff55c00ecb service cinder] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:11:03.868388 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1239/2416] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:11:03 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:11:03.887486 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ec7c3c-9d43-4cd1-b6e3-c7721396b671 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:11:03.949916 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ec7c3c-9d43-4cd1-b6e3-c7721396b671 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:11:03.954719 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53672ca0-a02b-4a11-a0b2-c851101ffeb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:11:03.955392 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53672ca0-a02b-4a11-a0b2-c851101ffeb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:11:03.955675 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53672ca0-a02b-4a11-a0b2-c851101ffeb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:11:03.955955 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53672ca0-a02b-4a11-a0b2-c851101ffeb9 admin admin] PATH_INFO: `/v3/users/c937830321294d1f9e82e7a134a42804` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:11:03.957114 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53672ca0-a02b-4a11-a0b2-c851101ffeb9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c937830321294d1f9e82e7a134a42804)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:11:03.959598 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53672ca0-a02b-4a11-a0b2-c851101ffeb9 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:11:03.988393 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:11:04.008161 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-53672ca0-a02b-4a11-a0b2-c851101ffeb9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c937830321294d1f9e82e7a134a42804'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:11:04.014892 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-53672ca0-a02b-4a11-a0b2-c851101ffeb9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c937830321294d1f9e82e7a134a42804'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:11:04.015574 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-53672ca0-a02b-4a11-a0b2-c851101ffeb9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c937830321294d1f9e82e7a134a42804'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:11:04.023251 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-53672ca0-a02b-4a11-a0b2-c851101ffeb9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c937830321294d1f9e82e7a134a42804'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:11:04.035094 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-53672ca0-a02b-4a11-a0b2-c851101ffeb9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c937830321294d1f9e82e7a134a42804'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:11:04.041640 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1178/2417] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Oct 14 13:11:03 2022] DELETE /identity/v3/users/c937830321294d1f9e82e7a134a42804 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:11:04.046086 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfad2d7-47cf-454e-9825-15be00bd3b8e None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:11:04.046398 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfad2d7-47cf-454e-9825-15be00bd3b8e None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:11:04.046677 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfad2d7-47cf-454e-9825-15be00bd3b8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:11:04.065132 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-0cfad2d7-47cf-454e-9825-15be00bd3b8e None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:11:04.066371 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-0cfad2d7-47cf-454e-9825-15be00bd3b8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:11:04.127329 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1240/2418] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:11:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:11:04.137392 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53672ca0-a02b-4a11-a0b2-c851101ffeb9 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:11:04.138820 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-53672ca0-a02b-4a11-a0b2-c851101ffeb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:11:04.195820 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53672ca0-a02b-4a11-a0b2-c851101ffeb9 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:11:04.199527 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f23a97-accd-4071-b856-367b0fb00f3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d483292f3a4794848fcacfba5b107e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:11:04.200145 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f23a97-accd-4071-b856-367b0fb00f3e service neutron] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:11:04.200422 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f23a97-accd-4071-b856-367b0fb00f3e service neutron] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:11:04.200694 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f23a97-accd-4071-b856-367b0fb00f3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:11:04.210342 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f23a97-accd-4071-b856-367b0fb00f3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:11:04.211761 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f23a97-accd-4071-b856-367b0fb00f3e service neutron] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:11:04.221430 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1179/2419] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:11:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:11:04.496145 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfad2d7-47cf-454e-9825-15be00bd3b8e None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:11:04.497567 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-0cfad2d7-47cf-454e-9825-15be00bd3b8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:11:04.514648 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfad2d7-47cf-454e-9825-15be00bd3b8e None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:11:04.519862 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a20d3f8-00d2-4efb-acf2-e75123ca085e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:11:04.520549 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a20d3f8-00d2-4efb-acf2-e75123ca085e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:11:04.520833 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a20d3f8-00d2-4efb-acf2-e75123ca085e admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:11:04.521085 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a20d3f8-00d2-4efb-acf2-e75123ca085e admin admin] PATH_INFO: `/v3/projects/9e429557b83e418a923e5e627ad310ad` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:11:04.522545 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a20d3f8-00d2-4efb-acf2-e75123ca085e admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e429557b83e418a923e5e627ad310ad)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:11:04.524597 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a20d3f8-00d2-4efb-acf2-e75123ca085e admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:11:04.573973 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-3a20d3f8-00d2-4efb-acf2-e75123ca085e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e429557b83e418a923e5e627ad310ad', 'request_id': 'req-3a20d3f8-00d2-4efb-acf2-e75123ca085e'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:11:04.580039 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-3a20d3f8-00d2-4efb-acf2-e75123ca085e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e429557b83e418a923e5e627ad310ad', 'request_id': 'req-3a20d3f8-00d2-4efb-acf2-e75123ca085e'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:11:04.587279 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-3a20d3f8-00d2-4efb-acf2-e75123ca085e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e429557b83e418a923e5e627ad310ad', 'request_id': 'req-3a20d3f8-00d2-4efb-acf2-e75123ca085e'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:11:04.601784 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-3a20d3f8-00d2-4efb-acf2-e75123ca085e admin admin] The token cache is being invalidate because project 9e429557b83e418a923e5e627ad310ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:11:04.602075 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-3a20d3f8-00d2-4efb-acf2-e75123ca085e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:11:04.602744 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-3a20d3f8-00d2-4efb-acf2-e75123ca085e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:11:04.604235 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1241/2420] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Oct 14 13:11:04 2022] DELETE /identity/v3/projects/9e429557b83e418a923e5e627ad310ad => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:11:04.609217 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ede7ceb-8425-44bc-9b55-64764b429107 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:11:04.609448 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ede7ceb-8425-44bc-9b55-64764b429107 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:11:04.609757 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ede7ceb-8425-44bc-9b55-64764b429107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:11:04.630357 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-0ede7ceb-8425-44bc-9b55-64764b429107 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:11:04.632679 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-0ede7ceb-8425-44bc-9b55-64764b429107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:11:04.694435 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1180/2421] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:11:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:11:04.702274 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64fae7a-5acb-4902-9ea1-bfb85bc14fe7 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:11:04.702632 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64fae7a-5acb-4902-9ea1-bfb85bc14fe7 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:11:04.703104 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64fae7a-5acb-4902-9ea1-bfb85bc14fe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:11:04.726804 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-e64fae7a-5acb-4902-9ea1-bfb85bc14fe7 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:11:04.728203 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-e64fae7a-5acb-4902-9ea1-bfb85bc14fe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:11:04.737440 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1242/2422] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:11:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:11:04.741971 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ede7ceb-8425-44bc-9b55-64764b429107 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:11:04.752005 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ede7ceb-8425-44bc-9b55-64764b429107 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:11:04.757245 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29307398-5023-456d-9310-3266634033d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:11:04.757857 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29307398-5023-456d-9310-3266634033d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:11:04.758165 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29307398-5023-456d-9310-3266634033d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:11:04.758434 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29307398-5023-456d-9310-3266634033d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:11:04.759072 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29307398-5023-456d-9310-3266634033d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 13:11:04.759377 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29307398-5023-456d-9310-3266634033d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:11:04.761014 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29307398-5023-456d-9310-3266634033d9 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:11:04.773031 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1181/2423] 10.222.0.17 () {58 vars in 1153 bytes} [Fri Oct 14 13:11:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 13:11:04.777378 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64fae7a-5acb-4902-9ea1-bfb85bc14fe7 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:11:04.786649 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64fae7a-5acb-4902-9ea1-bfb85bc14fe7 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:11:04.792033 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f811b1e9-e1fa-4c0b-b781-b3c92f2a45ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:11:04.792638 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f811b1e9-e1fa-4c0b-b781-b3c92f2a45ed admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:11:04.792941 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f811b1e9-e1fa-4c0b-b781-b3c92f2a45ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:11:04.793197 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f811b1e9-e1fa-4c0b-b781-b3c92f2a45ed admin admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:11:04.793835 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f811b1e9-e1fa-4c0b-b781-b3c92f2a45ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:11:04.795773 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f811b1e9-e1fa-4c0b-b781-b3c92f2a45ed admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:11:04.828865 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1243/2424] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Oct 14 13:11:04 2022] POST /identity/v3/projects => generated 369 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:11:04.829963 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29307398-5023-456d-9310-3266634033d9 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:11:04.840560 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29307398-5023-456d-9310-3266634033d9 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:11:04.871621 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:11:04.901840 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd1443c-9f3e-4573-ba27-ff3615613653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:11:04.902464 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd1443c-9f3e-4573-ba27-ff3615613653 admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:11:04.902751 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd1443c-9f3e-4573-ba27-ff3615613653 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:11:04.903025 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd1443c-9f3e-4573-ba27-ff3615613653 admin admin] PATH_INFO: `/v3/users` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:11:04.903664 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd1443c-9f3e-4573-ba27-ff3615613653 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:11:04.905586 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd1443c-9f3e-4573-ba27-ff3615613653 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:11:04.930263 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1182/2425] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Oct 14 13:11:04 2022] POST /identity/v3/users => generated 285 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 13:11:04.931484 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f811b1e9-e1fa-4c0b-b781-b3c92f2a45ed admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:11:04.942326 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f811b1e9-e1fa-4c0b-b781-b3c92f2a45ed admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:11:04.948462 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7db514e-4651-4e59-9401-b23b4935932a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:11:04.949067 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7db514e-4651-4e59-9401-b23b4935932a admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:11:04.949340 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7db514e-4651-4e59-9401-b23b4935932a admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:11:04.949611 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7db514e-4651-4e59-9401-b23b4935932a admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:11:04.950288 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7db514e-4651-4e59-9401-b23b4935932a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:11:04.952186 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7db514e-4651-4e59-9401-b23b4935932a admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:11:04.967113 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1244/2426] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:11:04 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:11:04.971217 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd1443c-9f3e-4573-ba27-ff3615613653 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:11:04.984159 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd1443c-9f3e-4573-ba27-ff3615613653 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:11:04.989020 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4ebc84-cc32-4379-8f53-44506c2041d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:11:04.989631 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4ebc84-cc32-4379-8f53-44506c2041d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:11:04.989914 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4ebc84-cc32-4379-8f53-44506c2041d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:11:04.990269 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4ebc84-cc32-4379-8f53-44506c2041d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:11:04.990964 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4ebc84-cc32-4379-8f53-44506c2041d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:11:04.992744 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4ebc84-cc32-4379-8f53-44506c2041d4 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:11:05.007812 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1183/2427] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:11:04 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:11:05.008764 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7db514e-4651-4e59-9401-b23b4935932a admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:11:05.019551 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7db514e-4651-4e59-9401-b23b4935932a admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:11:05.027164 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3def6cf9-722b-478c-90d2-dd5c5a538459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:11:05.028478 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3def6cf9-722b-478c-90d2-dd5c5a538459 admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:11:05.029324 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3def6cf9-722b-478c-90d2-dd5c5a538459 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:11:05.030058 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3def6cf9-722b-478c-90d2-dd5c5a538459 admin admin] PATH_INFO: `/v3/projects/cb5143390fdb493284c1fd2da3b575c1/users/218a6229a5e64b4ba1b4738e14348f7b/roles/5e8849303a75425b9eaa2681cc031af1` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:11:05.034826 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4ebc84-cc32-4379-8f53-44506c2041d4 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:11:05.037617 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-fa4ebc84-cc32-4379-8f53-44506c2041d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:11:05.051424 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4ebc84-cc32-4379-8f53-44506c2041d4 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:11:05.054339 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3def6cf9-722b-478c-90d2-dd5c5a538459 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb5143390fdb493284c1fd2da3b575c1, user_id=218a6229a5e64b4ba1b4738e14348f7b, role_id=5e8849303a75425b9eaa2681cc031af1)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:11:05.057000 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3def6cf9-722b-478c-90d2-dd5c5a538459 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:11:05.057130 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9921db0-db4d-4388-880e-29b1b27890af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:11:05.057754 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9921db0-db4d-4388-880e-29b1b27890af admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:11:05.058033 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9921db0-db4d-4388-880e-29b1b27890af admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:11:05.058485 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9921db0-db4d-4388-880e-29b1b27890af admin admin] PATH_INFO: `/v3/users/beaf3b456bcc470e870e7add91b31a52` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:11:05.059605 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9921db0-db4d-4388-880e-29b1b27890af admin admin] RBAC: Authorizing `identity:delete_user(user_id=beaf3b456bcc470e870e7add91b31a52)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:11:05.062291 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9921db0-db4d-4388-880e-29b1b27890af admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:11:05.074242 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1245/2428] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Oct 14 13:11:05 2022] PUT /identity/v3/projects/cb5143390fdb493284c1fd2da3b575c1/users/218a6229a5e64b4ba1b4738e14348f7b/roles/5e8849303a75425b9eaa2681cc031af1 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 13:11:05.085231 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ba54a2-b1a1-4544-aa80-b03f70d9a82c None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:11:05.085719 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ba54a2-b1a1-4544-aa80-b03f70d9a82c None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:11:05.086000 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ba54a2-b1a1-4544-aa80-b03f70d9a82c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:11:05.116288 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-85ba54a2-b1a1-4544-aa80-b03f70d9a82c None None] MFA Rules not processed for user `218a6229a5e64b4ba1b4738e14348f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:11:05.117704 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-85ba54a2-b1a1-4544-aa80-b03f70d9a82c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:11:05.122398 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:11:05.122983 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-e9921db0-db4d-4388-880e-29b1b27890af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'beaf3b456bcc470e870e7add91b31a52'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:11:05.131137 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-e9921db0-db4d-4388-880e-29b1b27890af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'beaf3b456bcc470e870e7add91b31a52'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:11:05.132060 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-e9921db0-db4d-4388-880e-29b1b27890af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'beaf3b456bcc470e870e7add91b31a52'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:11:05.139431 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-e9921db0-db4d-4388-880e-29b1b27890af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'beaf3b456bcc470e870e7add91b31a52'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:11:05.153877 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-e9921db0-db4d-4388-880e-29b1b27890af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'beaf3b456bcc470e870e7add91b31a52'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:11:05.159942 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1184/2429] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Oct 14 13:11:05 2022] DELETE /identity/v3/users/beaf3b456bcc470e870e7add91b31a52 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:11:05.190525 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1246/2430] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:11:05 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 13:11:05.202735 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9921db0-db4d-4388-880e-29b1b27890af admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:11:05.204184 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-e9921db0-db4d-4388-880e-29b1b27890af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:11:05.266890 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9921db0-db4d-4388-880e-29b1b27890af admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:11:05.270605 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930ebe43-c8f3-4b67-9dc8-bc6181fbce17 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0de24488ed54df29d8da344d76651d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:11:05.271237 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930ebe43-c8f3-4b67-9dc8-bc6181fbce17 service glance] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:11:05.271534 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930ebe43-c8f3-4b67-9dc8-bc6181fbce17 service glance] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:11:05.271807 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930ebe43-c8f3-4b67-9dc8-bc6181fbce17 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:11:05.320293 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:11:05.342211 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ba54a2-b1a1-4544-aa80-b03f70d9a82c None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:11:05.343496 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930ebe43-c8f3-4b67-9dc8-bc6181fbce17 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:11:05.343630 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-85ba54a2-b1a1-4544-aa80-b03f70d9a82c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:11:05.345099 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930ebe43-c8f3-4b67-9dc8-bc6181fbce17 service glance] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:11:05.355194 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1185/2431] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:11:05 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:11:05.439121 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ba54a2-b1a1-4544-aa80-b03f70d9a82c None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:11:05.503651 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c2c8de-859a-4ee3-a068-9f7596289f0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:11:05.507216 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c2c8de-859a-4ee3-a068-9f7596289f0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:11:05.507506 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c2c8de-859a-4ee3-a068-9f7596289f0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:11:05.507790 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c2c8de-859a-4ee3-a068-9f7596289f0e admin admin] PATH_INFO: `/v3/projects/857914771cd1486d837a9a46b1b7c527` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:11:05.509964 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c2c8de-859a-4ee3-a068-9f7596289f0e admin admin] RBAC: Authorizing `identity:delete_project(project_id=857914771cd1486d837a9a46b1b7c527)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:11:05.512029 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c2c8de-859a-4ee3-a068-9f7596289f0e admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:11:05.576065 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-43c2c8de-859a-4ee3-a068-9f7596289f0e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '857914771cd1486d837a9a46b1b7c527', 'request_id': 'req-43c2c8de-859a-4ee3-a068-9f7596289f0e'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:11:05.580705 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:11:05.584165 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-43c2c8de-859a-4ee3-a068-9f7596289f0e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '857914771cd1486d837a9a46b1b7c527', 'request_id': 'req-43c2c8de-859a-4ee3-a068-9f7596289f0e'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:11:05.592173 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-43c2c8de-859a-4ee3-a068-9f7596289f0e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '857914771cd1486d837a9a46b1b7c527', 'request_id': 'req-43c2c8de-859a-4ee3-a068-9f7596289f0e'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:11:05.607373 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-43c2c8de-859a-4ee3-a068-9f7596289f0e admin admin] The token cache is being invalidate because project 857914771cd1486d837a9a46b1b7c527 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:11:05.607668 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-43c2c8de-859a-4ee3-a068-9f7596289f0e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:11:05.608337 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-43c2c8de-859a-4ee3-a068-9f7596289f0e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:11:05.610602 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1247/2432] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Oct 14 13:11:05 2022] DELETE /identity/v3/projects/857914771cd1486d837a9a46b1b7c527 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 13:11:05.617549 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b06a77-bb31-429c-8d5e-4972e4d898c1 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:11:05.617835 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b06a77-bb31-429c-8d5e-4972e4d898c1 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:11:05.618107 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b06a77-bb31-429c-8d5e-4972e4d898c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:11:05.640438 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-94b06a77-bb31-429c-8d5e-4972e4d898c1 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:11:05.642909 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-94b06a77-bb31-429c-8d5e-4972e4d898c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:11:05.718519 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1186/2433] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:11:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 13:11:05.730394 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a728d0da-eb16-47ff-bb62-616404c8dc8e None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:11:05.730679 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a728d0da-eb16-47ff-bb62-616404c8dc8e None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:11:05.731001 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a728d0da-eb16-47ff-bb62-616404c8dc8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:11:05.756362 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-a728d0da-eb16-47ff-bb62-616404c8dc8e None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:11:05.758093 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-a728d0da-eb16-47ff-bb62-616404c8dc8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:11:05.769119 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1248/2434] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:11:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:11:05.774986 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b06a77-bb31-429c-8d5e-4972e4d898c1 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:11:05.786614 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b06a77-bb31-429c-8d5e-4972e4d898c1 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:11:05.802952 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a836e2-236c-4f66-824a-3b3c378c6653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:11:05.803912 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a836e2-236c-4f66-824a-3b3c378c6653 admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:11:05.804207 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a836e2-236c-4f66-824a-3b3c378c6653 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:11:05.804488 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a836e2-236c-4f66-824a-3b3c378c6653 admin admin] PATH_INFO: `/v3/domains` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:11:05.805161 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a836e2-236c-4f66-824a-3b3c378c6653 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 13:11:05.805474 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a836e2-236c-4f66-824a-3b3c378c6653 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:11:05.807249 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a836e2-236c-4f66-824a-3b3c378c6653 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:11:05.822685 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1187/2435] 10.222.0.17 () {58 vars in 1153 bytes} [Fri Oct 14 13:11:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 13:11:05.827136 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a728d0da-eb16-47ff-bb62-616404c8dc8e None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:11:05.840789 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a728d0da-eb16-47ff-bb62-616404c8dc8e None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:11:05.846980 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125175a6-33f5-4a8c-8ac0-d296aeca57dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:11:05.848048 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125175a6-33f5-4a8c-8ac0-d296aeca57dc admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:11:05.848429 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125175a6-33f5-4a8c-8ac0-d296aeca57dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:11:05.848796 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125175a6-33f5-4a8c-8ac0-d296aeca57dc admin admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:11:05.849809 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125175a6-33f5-4a8c-8ac0-d296aeca57dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:11:05.852226 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125175a6-33f5-4a8c-8ac0-d296aeca57dc admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:11:05.890148 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1249/2436] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Oct 14 13:11:05 2022] POST /identity/v3/projects => generated 373 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:11:05.893834 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a836e2-236c-4f66-824a-3b3c378c6653 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:11:05.907079 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a836e2-236c-4f66-824a-3b3c378c6653 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:11:05.973396 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c194cd35-4e52-4b69-80f0-b8bc3c946ef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:11:05.974389 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c194cd35-4e52-4b69-80f0-b8bc3c946ef3 admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:11:05.974845 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c194cd35-4e52-4b69-80f0-b8bc3c946ef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:11:05.975294 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c194cd35-4e52-4b69-80f0-b8bc3c946ef3 admin admin] PATH_INFO: `/v3/users` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:11:05.977087 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c194cd35-4e52-4b69-80f0-b8bc3c946ef3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:11:05.979840 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c194cd35-4e52-4b69-80f0-b8bc3c946ef3 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:11:06.006318 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1188/2437] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Oct 14 13:11:05 2022] POST /identity/v3/users => generated 287 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 13:11:06.011886 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125175a6-33f5-4a8c-8ac0-d296aeca57dc admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:11:06.023425 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125175a6-33f5-4a8c-8ac0-d296aeca57dc admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:11:06.029331 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c2115b-01c4-4392-b3c5-f1c3da054510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:11:06.029942 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c2115b-01c4-4392-b3c5-f1c3da054510 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:11:06.030256 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c2115b-01c4-4392-b3c5-f1c3da054510 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:11:06.030529 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c2115b-01c4-4392-b3c5-f1c3da054510 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:11:06.032243 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c2115b-01c4-4392-b3c5-f1c3da054510 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:11:06.033938 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c2115b-01c4-4392-b3c5-f1c3da054510 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:11:06.045578 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1250/2438] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:11:06 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 14 13:11:06.051037 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c194cd35-4e52-4b69-80f0-b8bc3c946ef3 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:11:06.063343 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c194cd35-4e52-4b69-80f0-b8bc3c946ef3 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:11:06.069650 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79b58af-bba9-4af3-a35b-f98595e4226f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:11:06.070492 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79b58af-bba9-4af3-a35b-f98595e4226f admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:11:06.070783 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79b58af-bba9-4af3-a35b-f98595e4226f admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:11:06.071062 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79b58af-bba9-4af3-a35b-f98595e4226f admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:11:06.071719 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79b58af-bba9-4af3-a35b-f98595e4226f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:11:06.073740 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79b58af-bba9-4af3-a35b-f98595e4226f admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:11:06.088062 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1189/2439] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:11:06 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:11:06.090905 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c2115b-01c4-4392-b3c5-f1c3da054510 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:11:06.101457 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c2115b-01c4-4392-b3c5-f1c3da054510 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:11:06.107715 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea63b01b-474c-49f8-9317-1b3b08c67e6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:11:06.109416 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea63b01b-474c-49f8-9317-1b3b08c67e6e admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:11:06.109701 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea63b01b-474c-49f8-9317-1b3b08c67e6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:11:06.109975 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea63b01b-474c-49f8-9317-1b3b08c67e6e admin admin] PATH_INFO: `/v3/projects/25453b65ee2e44ddafe44350f9db173d/users/f7b395240cfc4be7aee73ba52d30753e/roles/5e8849303a75425b9eaa2681cc031af1` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:11:06.129938 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea63b01b-474c-49f8-9317-1b3b08c67e6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=25453b65ee2e44ddafe44350f9db173d, user_id=f7b395240cfc4be7aee73ba52d30753e, role_id=5e8849303a75425b9eaa2681cc031af1)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:11:06.133265 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea63b01b-474c-49f8-9317-1b3b08c67e6e admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:11:06.148139 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1251/2440] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Oct 14 13:11:06 2022] PUT /identity/v3/projects/25453b65ee2e44ddafe44350f9db173d/users/f7b395240cfc4be7aee73ba52d30753e/roles/5e8849303a75425b9eaa2681cc031af1 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:11:06.160222 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc7942f-db36-43dc-a842-c99a561a0b94 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:11:06.160683 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc7942f-db36-43dc-a842-c99a561a0b94 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:11:06.161128 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc7942f-db36-43dc-a842-c99a561a0b94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:11:06.203810 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-7cc7942f-db36-43dc-a842-c99a561a0b94 None None] MFA Rules not processed for user `f7b395240cfc4be7aee73ba52d30753e`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:11:06.203810 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-7cc7942f-db36-43dc-a842-c99a561a0b94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:11:06.237481 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:11:06.275869 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1190/2441] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:11:06 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:11:06.287583 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea63b01b-474c-49f8-9317-1b3b08c67e6e admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:11:06.289403 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-ea63b01b-474c-49f8-9317-1b3b08c67e6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:11:06.350091 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea63b01b-474c-49f8-9317-1b3b08c67e6e admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:11:06.353772 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45113c1a-b68c-4cdd-b4ab-80426326d6ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c3c564b8c548e4beef1cbfba2ad343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:11:06.354417 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45113c1a-b68c-4cdd-b4ab-80426326d6ed service cinder] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:11:06.354700 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45113c1a-b68c-4cdd-b4ab-80426326d6ed service cinder] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:11:06.354973 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45113c1a-b68c-4cdd-b4ab-80426326d6ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:11:06.364859 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45113c1a-b68c-4cdd-b4ab-80426326d6ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:11:06.367453 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45113c1a-b68c-4cdd-b4ab-80426326d6ed service cinder] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:11:06.377598 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1252/2442] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:11:06 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:11:16.272753 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=12 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:11:16.350570 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc7942f-db36-43dc-a842-c99a561a0b94 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:11:16.373294 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:DELETE=2,keystone:SELECT=58,keystone:INSERT=3 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:11:16.433681 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc7942f-db36-43dc-a842-c99a561a0b94 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:11:16.433681 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1798de-6754-4d85-a7b2-5bafdecb3d6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:11:16.433681 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1798de-6754-4d85-a7b2-5bafdecb3d6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:11:16.433681 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1798de-6754-4d85-a7b2-5bafdecb3d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:11:16.434409 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1798de-6754-4d85-a7b2-5bafdecb3d6d admin admin] PATH_INFO: `/v3/users/f7b395240cfc4be7aee73ba52d30753e` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:11:16.434409 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1798de-6754-4d85-a7b2-5bafdecb3d6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7b395240cfc4be7aee73ba52d30753e)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:11:16.436208 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1798de-6754-4d85-a7b2-5bafdecb3d6d admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:11:16.498370 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-ee1798de-6754-4d85-a7b2-5bafdecb3d6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7b395240cfc4be7aee73ba52d30753e'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:11:16.505911 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-ee1798de-6754-4d85-a7b2-5bafdecb3d6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7b395240cfc4be7aee73ba52d30753e'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:11:16.506665 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-ee1798de-6754-4d85-a7b2-5bafdecb3d6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7b395240cfc4be7aee73ba52d30753e'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:11:16.514917 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-ee1798de-6754-4d85-a7b2-5bafdecb3d6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7b395240cfc4be7aee73ba52d30753e'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:11:16.527504 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-ee1798de-6754-4d85-a7b2-5bafdecb3d6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7b395240cfc4be7aee73ba52d30753e'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:11:16.533605 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1191/2443] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Oct 14 13:11:16 2022] DELETE /identity/v3/users/f7b395240cfc4be7aee73ba52d30753e => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:11:16.538156 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70ad435-cb2d-4780-90c9-ab1fff4b5580 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:11:16.538444 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70ad435-cb2d-4780-90c9-ab1fff4b5580 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:11:16.538722 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70ad435-cb2d-4780-90c9-ab1fff4b5580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:11:16.558241 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-b70ad435-cb2d-4780-90c9-ab1fff4b5580 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:11:16.559460 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-b70ad435-cb2d-4780-90c9-ab1fff4b5580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:11:16.625240 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1253/2444] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:11:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:11:16.633140 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1798de-6754-4d85-a7b2-5bafdecb3d6d admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:11:16.635367 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-ee1798de-6754-4d85-a7b2-5bafdecb3d6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:11:16.677539 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70ad435-cb2d-4780-90c9-ab1fff4b5580 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:11:16.679395 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-b70ad435-cb2d-4780-90c9-ab1fff4b5580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:11:16.693831 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1798de-6754-4d85-a7b2-5bafdecb3d6d admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:11:16.698320 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5262e624-0fa4-4463-9cbc-85afa5218025 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d483292f3a4794848fcacfba5b107e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:11:16.698929 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5262e624-0fa4-4463-9cbc-85afa5218025 service neutron] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:11:16.699211 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5262e624-0fa4-4463-9cbc-85afa5218025 service neutron] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:11:16.699485 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5262e624-0fa4-4463-9cbc-85afa5218025 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:11:16.708732 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5262e624-0fa4-4463-9cbc-85afa5218025 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:11:16.710192 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5262e624-0fa4-4463-9cbc-85afa5218025 service neutron] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:11:16.720323 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1192/2445] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:11:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:11:16.740948 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70ad435-cb2d-4780-90c9-ab1fff4b5580 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:11:16.745801 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5660b0-acfd-4e45-9a86-debcad3604d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d483292f3a4794848fcacfba5b107e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:11:16.746681 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5660b0-acfd-4e45-9a86-debcad3604d5 service neutron] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:11:16.746961 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5660b0-acfd-4e45-9a86-debcad3604d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:11:16.747289 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5660b0-acfd-4e45-9a86-debcad3604d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:11:16.749076 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-ef5660b0-acfd-4e45-9a86-debcad3604d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:11:16.828745 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5660b0-acfd-4e45-9a86-debcad3604d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:11:16.830311 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5660b0-acfd-4e45-9a86-debcad3604d5 service neutron] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:11:16.842688 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1254/2446] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:11:16 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 14 13:11:17.002844 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5262e624-0fa4-4463-9cbc-85afa5218025 service neutron] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:11:17.004309 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-5262e624-0fa4-4463-9cbc-85afa5218025 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:11:17.017851 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5262e624-0fa4-4463-9cbc-85afa5218025 service neutron] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:11:17.022587 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcf2349-851b-4e90-b625-8043a6c30970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:11:17.023211 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcf2349-851b-4e90-b625-8043a6c30970 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:11:17.023495 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcf2349-851b-4e90-b625-8043a6c30970 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:11:17.023774 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcf2349-851b-4e90-b625-8043a6c30970 admin admin] PATH_INFO: `/v3/projects/25453b65ee2e44ddafe44350f9db173d` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:11:17.025754 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcf2349-851b-4e90-b625-8043a6c30970 admin admin] RBAC: Authorizing `identity:delete_project(project_id=25453b65ee2e44ddafe44350f9db173d)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:11:17.027732 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcf2349-851b-4e90-b625-8043a6c30970 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:11:17.044873 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:11:17.075226 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-7dcf2349-851b-4e90-b625-8043a6c30970 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25453b65ee2e44ddafe44350f9db173d', 'request_id': 'req-7dcf2349-851b-4e90-b625-8043a6c30970'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:11:17.080797 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-7dcf2349-851b-4e90-b625-8043a6c30970 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25453b65ee2e44ddafe44350f9db173d', 'request_id': 'req-7dcf2349-851b-4e90-b625-8043a6c30970'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:11:17.088010 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-7dcf2349-851b-4e90-b625-8043a6c30970 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25453b65ee2e44ddafe44350f9db173d', 'request_id': 'req-7dcf2349-851b-4e90-b625-8043a6c30970'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:11:17.101733 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-7dcf2349-851b-4e90-b625-8043a6c30970 admin admin] The token cache is being invalidate because project 25453b65ee2e44ddafe44350f9db173d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:11:17.102030 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-7dcf2349-851b-4e90-b625-8043a6c30970 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:11:17.103174 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-7dcf2349-851b-4e90-b625-8043a6c30970 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:11:17.104907 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1193/2447] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Oct 14 13:11:17 2022] DELETE /identity/v3/projects/25453b65ee2e44ddafe44350f9db173d => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:11:18.047723 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5660b0-acfd-4e45-9a86-debcad3604d5 service neutron] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:11:18.049095 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-ef5660b0-acfd-4e45-9a86-debcad3604d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:11:18.060523 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5660b0-acfd-4e45-9a86-debcad3604d5 service neutron] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:11:18.100643 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=100 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:11:18.110365 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8544b2be-2444-4591-ba7e-9ed614508351 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d483292f3a4794848fcacfba5b107e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:11:18.110975 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8544b2be-2444-4591-ba7e-9ed614508351 service neutron] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:11:18.111255 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8544b2be-2444-4591-ba7e-9ed614508351 service neutron] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:11:18.111530 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8544b2be-2444-4591-ba7e-9ed614508351 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:11:18.113262 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-8544b2be-2444-4591-ba7e-9ed614508351 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:11:18.181984 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8544b2be-2444-4591-ba7e-9ed614508351 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:11:18.183580 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8544b2be-2444-4591-ba7e-9ed614508351 service neutron] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:11:18.194305 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1255/2448] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:11:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:11:22.699056 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47606e6a-f51a-4210-9506-fae381aec31a None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:11:22.699530 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47606e6a-f51a-4210-9506-fae381aec31a None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:11:22.699738 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47606e6a-f51a-4210-9506-fae381aec31a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:11:22.720133 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-47606e6a-f51a-4210-9506-fae381aec31a None None] MFA Rules not processed for user `b7394b504d0d4338adc6c599cadda6d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:11:22.721341 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-47606e6a-f51a-4210-9506-fae381aec31a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:11:22.786370 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1194/2449] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:11:22 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:11:28.189387 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=35 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:11:32.772377 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=42,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:11:33.624277 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8544b2be-2444-4591-ba7e-9ed614508351 service neutron] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:11:33.625675 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-8544b2be-2444-4591-ba7e-9ed614508351 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:11:33.691040 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8544b2be-2444-4591-ba7e-9ed614508351 service neutron] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:11:33.695763 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d418c0-0a8d-4f84-98a5-f4d9bfa8770d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:11:33.696364 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d418c0-0a8d-4f84-98a5-f4d9bfa8770d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:11:33.696696 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d418c0-0a8d-4f84-98a5-f4d9bfa8770d admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:11:33.697032 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d418c0-0a8d-4f84-98a5-f4d9bfa8770d admin admin] PATH_INFO: `/v3/users/218a6229a5e64b4ba1b4738e14348f7b` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:11:33.698201 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d418c0-0a8d-4f84-98a5-f4d9bfa8770d admin admin] RBAC: Authorizing `identity:delete_user(user_id=218a6229a5e64b4ba1b4738e14348f7b)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:11:33.700124 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d418c0-0a8d-4f84-98a5-f4d9bfa8770d admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:11:33.749181 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-22d418c0-0a8d-4f84-98a5-f4d9bfa8770d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '218a6229a5e64b4ba1b4738e14348f7b'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:11:33.756495 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-22d418c0-0a8d-4f84-98a5-f4d9bfa8770d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '218a6229a5e64b4ba1b4738e14348f7b'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:11:33.757103 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-22d418c0-0a8d-4f84-98a5-f4d9bfa8770d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '218a6229a5e64b4ba1b4738e14348f7b'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:11:33.764052 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-22d418c0-0a8d-4f84-98a5-f4d9bfa8770d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '218a6229a5e64b4ba1b4738e14348f7b'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:11:33.776650 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-22d418c0-0a8d-4f84-98a5-f4d9bfa8770d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '218a6229a5e64b4ba1b4738e14348f7b'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:11:33.782643 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1256/2450] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Oct 14 13:11:33 2022] DELETE /identity/v3/users/218a6229a5e64b4ba1b4738e14348f7b => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:11:33.787144 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c860d9-6488-4377-b2d3-5f79bedf4d45 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:11:33.787641 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c860d9-6488-4377-b2d3-5f79bedf4d45 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:11:33.787815 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c860d9-6488-4377-b2d3-5f79bedf4d45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:11:33.807107 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-14c860d9-6488-4377-b2d3-5f79bedf4d45 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:11:33.808331 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-14c860d9-6488-4377-b2d3-5f79bedf4d45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:11:33.866189 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1195/2451] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:11:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:11:33.875866 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d418c0-0a8d-4f84-98a5-f4d9bfa8770d admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:11:33.877307 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-22d418c0-0a8d-4f84-98a5-f4d9bfa8770d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:11:33.933844 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d418c0-0a8d-4f84-98a5-f4d9bfa8770d admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:11:33.937428 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72181101-b059-456e-9b8b-e094c3a76f41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d483292f3a4794848fcacfba5b107e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:11:33.938028 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72181101-b059-456e-9b8b-e094c3a76f41 service neutron] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:11:33.938334 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72181101-b059-456e-9b8b-e094c3a76f41 service neutron] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:11:33.938605 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72181101-b059-456e-9b8b-e094c3a76f41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:11:33.948017 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72181101-b059-456e-9b8b-e094c3a76f41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:11:33.949454 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72181101-b059-456e-9b8b-e094c3a76f41 service neutron] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:11:33.958829 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1257/2452] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:11:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:11:34.230680 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c860d9-6488-4377-b2d3-5f79bedf4d45 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:11:34.232142 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-14c860d9-6488-4377-b2d3-5f79bedf4d45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:11:34.244676 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c860d9-6488-4377-b2d3-5f79bedf4d45 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:11:34.249894 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272f15f1-56a6-4069-a136-2264014c123f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:11:34.250797 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272f15f1-56a6-4069-a136-2264014c123f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:11:34.251148 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272f15f1-56a6-4069-a136-2264014c123f admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:11:34.251493 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272f15f1-56a6-4069-a136-2264014c123f admin admin] PATH_INFO: `/v3/projects/cb5143390fdb493284c1fd2da3b575c1` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:11:34.252704 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272f15f1-56a6-4069-a136-2264014c123f admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb5143390fdb493284c1fd2da3b575c1)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:11:34.254726 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272f15f1-56a6-4069-a136-2264014c123f admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:11:34.315978 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-272f15f1-56a6-4069-a136-2264014c123f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb5143390fdb493284c1fd2da3b575c1', 'request_id': 'req-272f15f1-56a6-4069-a136-2264014c123f'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:11:34.322703 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-272f15f1-56a6-4069-a136-2264014c123f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb5143390fdb493284c1fd2da3b575c1', 'request_id': 'req-272f15f1-56a6-4069-a136-2264014c123f'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:11:34.329211 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-272f15f1-56a6-4069-a136-2264014c123f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb5143390fdb493284c1fd2da3b575c1', 'request_id': 'req-272f15f1-56a6-4069-a136-2264014c123f'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:11:34.342777 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-272f15f1-56a6-4069-a136-2264014c123f admin admin] The token cache is being invalidate because project cb5143390fdb493284c1fd2da3b575c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:11:34.343074 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-272f15f1-56a6-4069-a136-2264014c123f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:11:34.343700 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-272f15f1-56a6-4069-a136-2264014c123f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:11:34.345217 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1196/2453] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Oct 14 13:11:34 2022] DELETE /identity/v3/projects/cb5143390fdb493284c1fd2da3b575c1 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:11:34.350210 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6699ab8-761f-4873-95a8-31460818bf5c None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:11:34.350502 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6699ab8-761f-4873-95a8-31460818bf5c None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:11:34.350806 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6699ab8-761f-4873-95a8-31460818bf5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:11:34.374353 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-d6699ab8-761f-4873-95a8-31460818bf5c None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:11:34.375568 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-d6699ab8-761f-4873-95a8-31460818bf5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:11:34.394985 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:11:34.441408 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1258/2454] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:11:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:11:34.451137 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bead4680-b309-430a-8fcc-7e936cf1730c None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:11:34.451446 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bead4680-b309-430a-8fcc-7e936cf1730c None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:11:34.451721 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bead4680-b309-430a-8fcc-7e936cf1730c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:11:34.472831 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-bead4680-b309-430a-8fcc-7e936cf1730c None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:11:34.474033 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-bead4680-b309-430a-8fcc-7e936cf1730c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:11:34.482690 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1197/2455] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:11:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:11:34.487830 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6699ab8-761f-4873-95a8-31460818bf5c None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:11:34.497656 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6699ab8-761f-4873-95a8-31460818bf5c None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:11:34.502536 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bde4b6-2cf5-4fad-be0f-b97997df9864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:11:34.503139 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bde4b6-2cf5-4fad-be0f-b97997df9864 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:11:34.503419 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bde4b6-2cf5-4fad-be0f-b97997df9864 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:11:34.503689 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bde4b6-2cf5-4fad-be0f-b97997df9864 admin admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:11:34.504328 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bde4b6-2cf5-4fad-be0f-b97997df9864 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 13:11:34.504633 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bde4b6-2cf5-4fad-be0f-b97997df9864 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:11:34.506310 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bde4b6-2cf5-4fad-be0f-b97997df9864 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:11:34.518618 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1259/2456] 10.222.0.17 () {58 vars in 1153 bytes} [Fri Oct 14 13:11:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 13:11:34.522860 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bead4680-b309-430a-8fcc-7e936cf1730c None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:11:34.532590 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bead4680-b309-430a-8fcc-7e936cf1730c None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:11:34.537221 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2030ddf-4470-4bf7-9bed-cb1b91fa003d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:11:34.537820 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2030ddf-4470-4bf7-9bed-cb1b91fa003d admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:11:34.538096 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2030ddf-4470-4bf7-9bed-cb1b91fa003d admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:11:34.538400 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2030ddf-4470-4bf7-9bed-cb1b91fa003d admin admin] PATH_INFO: `/v3/projects` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:11:34.539610 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2030ddf-4470-4bf7-9bed-cb1b91fa003d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:11:34.541500 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2030ddf-4470-4bf7-9bed-cb1b91fa003d admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:11:34.568821 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1198/2457] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Oct 14 13:11:34 2022] POST /identity/v3/projects => generated 369 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 13:11:34.573057 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bde4b6-2cf5-4fad-be0f-b97997df9864 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:11:34.583027 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bde4b6-2cf5-4fad-be0f-b97997df9864 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:11:34.641296 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dfe334-4fc5-4e09-9760-17a168acf767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:11:34.642026 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dfe334-4fc5-4e09-9760-17a168acf767 admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:11:34.642331 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dfe334-4fc5-4e09-9760-17a168acf767 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:11:34.642601 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dfe334-4fc5-4e09-9760-17a168acf767 admin admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:11:34.643234 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dfe334-4fc5-4e09-9760-17a168acf767 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:11:34.645140 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dfe334-4fc5-4e09-9760-17a168acf767 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:11:34.666012 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1260/2458] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Oct 14 13:11:34 2022] POST /identity/v3/users => generated 285 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 13:11:34.670021 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2030ddf-4470-4bf7-9bed-cb1b91fa003d admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:11:34.680810 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2030ddf-4470-4bf7-9bed-cb1b91fa003d admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:11:34.685394 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed21b8c-394c-4df7-bcc4-84c43be40314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:11:34.685986 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed21b8c-394c-4df7-bcc4-84c43be40314 admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:11:34.686301 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed21b8c-394c-4df7-bcc4-84c43be40314 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:11:34.686571 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed21b8c-394c-4df7-bcc4-84c43be40314 admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:11:34.687206 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed21b8c-394c-4df7-bcc4-84c43be40314 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:11:34.689030 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed21b8c-394c-4df7-bcc4-84c43be40314 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:11:34.702675 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1199/2459] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:11:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:11:34.703963 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dfe334-4fc5-4e09-9760-17a168acf767 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:11:34.714242 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dfe334-4fc5-4e09-9760-17a168acf767 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:11:34.719229 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596b8eaf-a5d7-4f33-9810-ff1373a18928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:11:34.719832 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596b8eaf-a5d7-4f33-9810-ff1373a18928 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:11:34.720116 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596b8eaf-a5d7-4f33-9810-ff1373a18928 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:11:34.720389 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596b8eaf-a5d7-4f33-9810-ff1373a18928 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:11:34.721029 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596b8eaf-a5d7-4f33-9810-ff1373a18928 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:11:34.722673 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596b8eaf-a5d7-4f33-9810-ff1373a18928 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:11:34.735055 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1261/2460] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:11:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:11:34.739822 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed21b8c-394c-4df7-bcc4-84c43be40314 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:11:34.750815 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed21b8c-394c-4df7-bcc4-84c43be40314 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:11:34.755521 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf06567-3d65-4c56-9140-b23445d729ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:11:34.756182 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf06567-3d65-4c56-9140-b23445d729ea admin admin] REQUEST_METHOD: `PUT` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:11:34.756452 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf06567-3d65-4c56-9140-b23445d729ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:11:34.756725 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf06567-3d65-4c56-9140-b23445d729ea admin admin] PATH_INFO: `/v3/projects/592a5d5152f0441dbb0c0d11c89120b5/users/d4b0243f98ff4f39a861e52b616ac7dd/roles/5e8849303a75425b9eaa2681cc031af1` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:11:34.772054 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf06567-3d65-4c56-9140-b23445d729ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=592a5d5152f0441dbb0c0d11c89120b5, user_id=d4b0243f98ff4f39a861e52b616ac7dd, role_id=5e8849303a75425b9eaa2681cc031af1)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:11:34.774807 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf06567-3d65-4c56-9140-b23445d729ea admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:11:34.790042 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1200/2461] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Oct 14 13:11:34 2022] PUT /identity/v3/projects/592a5d5152f0441dbb0c0d11c89120b5/users/d4b0243f98ff4f39a861e52b616ac7dd/roles/5e8849303a75425b9eaa2681cc031af1 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:11:34.800414 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5158cd-57f9-4010-a98c-fc1322b33bbc None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:11:34.800724 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5158cd-57f9-4010-a98c-fc1322b33bbc None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:11:34.800995 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5158cd-57f9-4010-a98c-fc1322b33bbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:11:34.829680 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-0d5158cd-57f9-4010-a98c-fc1322b33bbc None None] MFA Rules not processed for user `d4b0243f98ff4f39a861e52b616ac7dd`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:11:34.830922 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-0d5158cd-57f9-4010-a98c-fc1322b33bbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:11:34.897309 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1262/2462] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:11:34 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 13:11:34.909422 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf06567-3d65-4c56-9140-b23445d729ea admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:11:34.911166 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-3bf06567-3d65-4c56-9140-b23445d729ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:11:34.934108 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:11:34.972967 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf06567-3d65-4c56-9140-b23445d729ea admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:11:34.976720 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f568e8-4833-4023-82eb-f2d945e18058 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0de24488ed54df29d8da344d76651d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:11:34.977328 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f568e8-4833-4023-82eb-f2d945e18058 service glance] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:11:34.977604 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f568e8-4833-4023-82eb-f2d945e18058 service glance] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:11:34.977879 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f568e8-4833-4023-82eb-f2d945e18058 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:11:34.986774 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f568e8-4833-4023-82eb-f2d945e18058 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:11:34.988223 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f568e8-4833-4023-82eb-f2d945e18058 service glance] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:11:34.997238 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1201/2463] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:11:34 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:11:44.893990 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:11:44.993069 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=17 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:11:56.716706 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5158cd-57f9-4010-a98c-fc1322b33bbc None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:11:56.718144 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-0d5158cd-57f9-4010-a98c-fc1322b33bbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:11:56.774903 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5158cd-57f9-4010-a98c-fc1322b33bbc None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:11:56.778408 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30de044-adf4-4c75-aab9-4d4ebbb25240 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d483292f3a4794848fcacfba5b107e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:11:56.779521 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30de044-adf4-4c75-aab9-4d4ebbb25240 service neutron] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:11:56.779793 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30de044-adf4-4c75-aab9-4d4ebbb25240 service neutron] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:11:56.780065 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30de044-adf4-4c75-aab9-4d4ebbb25240 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:11:56.781742 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-a30de044-adf4-4c75-aab9-4d4ebbb25240 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:11:56.791100 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30de044-adf4-4c75-aab9-4d4ebbb25240 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:11:56.792493 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30de044-adf4-4c75-aab9-4d4ebbb25240 service neutron] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:11:56.801071 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1263/2464] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:11:56 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:11:58.673945 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f568e8-4833-4023-82eb-f2d945e18058 service glance] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:11:58.735958 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f568e8-4833-4023-82eb-f2d945e18058 service glance] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:11:58.740848 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd483bb2-b548-4f87-849d-0fae34eff7b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:11:58.741474 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd483bb2-b548-4f87-849d-0fae34eff7b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:11:58.741757 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd483bb2-b548-4f87-849d-0fae34eff7b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:11:58.742032 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd483bb2-b548-4f87-849d-0fae34eff7b2 admin admin] PATH_INFO: `/v3/users/d4b0243f98ff4f39a861e52b616ac7dd` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:11:58.743179 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd483bb2-b548-4f87-849d-0fae34eff7b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4b0243f98ff4f39a861e52b616ac7dd)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:11:58.745109 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd483bb2-b548-4f87-849d-0fae34eff7b2 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:11:58.791069 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-cd483bb2-b548-4f87-849d-0fae34eff7b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4b0243f98ff4f39a861e52b616ac7dd'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:11:58.797971 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-cd483bb2-b548-4f87-849d-0fae34eff7b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4b0243f98ff4f39a861e52b616ac7dd'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:11:58.798663 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-cd483bb2-b548-4f87-849d-0fae34eff7b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4b0243f98ff4f39a861e52b616ac7dd'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:11:58.806430 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-cd483bb2-b548-4f87-849d-0fae34eff7b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4b0243f98ff4f39a861e52b616ac7dd'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:11:58.818976 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-cd483bb2-b548-4f87-849d-0fae34eff7b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4b0243f98ff4f39a861e52b616ac7dd'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:11:58.824635 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1202/2465] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Oct 14 13:11:58 2022] DELETE /identity/v3/users/d4b0243f98ff4f39a861e52b616ac7dd => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:11:58.829897 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996002e0-b9c4-4fb2-9a85-4389a502ea3c None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:11:58.830425 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996002e0-b9c4-4fb2-9a85-4389a502ea3c None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:11:58.830526 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996002e0-b9c4-4fb2-9a85-4389a502ea3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:11:58.849489 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-996002e0-b9c4-4fb2-9a85-4389a502ea3c None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:11:58.850716 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-996002e0-b9c4-4fb2-9a85-4389a502ea3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:11:58.908773 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1264/2466] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:11:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:11:58.918739 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd483bb2-b548-4f87-849d-0fae34eff7b2 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:11:58.920403 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-cd483bb2-b548-4f87-849d-0fae34eff7b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:11:58.977049 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd483bb2-b548-4f87-849d-0fae34eff7b2 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:11:58.980635 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba19fda-b16e-43bf-99b2-a9958a0c30d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d483292f3a4794848fcacfba5b107e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:11:58.981229 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba19fda-b16e-43bf-99b2-a9958a0c30d1 service neutron] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:11:58.981579 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba19fda-b16e-43bf-99b2-a9958a0c30d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:11:58.981847 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba19fda-b16e-43bf-99b2-a9958a0c30d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:11:58.991751 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba19fda-b16e-43bf-99b2-a9958a0c30d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:11:58.993182 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba19fda-b16e-43bf-99b2-a9958a0c30d1 service neutron] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:11:59.003565 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1203/2467] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:11:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:11:59.265725 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996002e0-b9c4-4fb2-9a85-4389a502ea3c None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:11:59.267207 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-996002e0-b9c4-4fb2-9a85-4389a502ea3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:11:59.279181 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996002e0-b9c4-4fb2-9a85-4389a502ea3c None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:11:59.283849 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc8012c-616b-4e1b-abca-913e177f2e1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:11:59.284481 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc8012c-616b-4e1b-abca-913e177f2e1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:11:59.284768 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc8012c-616b-4e1b-abca-913e177f2e1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:11:59.285046 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc8012c-616b-4e1b-abca-913e177f2e1b admin admin] PATH_INFO: `/v3/projects/592a5d5152f0441dbb0c0d11c89120b5` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:11:59.286712 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc8012c-616b-4e1b-abca-913e177f2e1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=592a5d5152f0441dbb0c0d11c89120b5)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:11:59.288620 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc8012c-616b-4e1b-abca-913e177f2e1b admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:11:59.337782 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-efc8012c-616b-4e1b-abca-913e177f2e1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '592a5d5152f0441dbb0c0d11c89120b5', 'request_id': 'req-efc8012c-616b-4e1b-abca-913e177f2e1b'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:11:59.343918 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-efc8012c-616b-4e1b-abca-913e177f2e1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '592a5d5152f0441dbb0c0d11c89120b5', 'request_id': 'req-efc8012c-616b-4e1b-abca-913e177f2e1b'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:11:59.350296 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-efc8012c-616b-4e1b-abca-913e177f2e1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '592a5d5152f0441dbb0c0d11c89120b5', 'request_id': 'req-efc8012c-616b-4e1b-abca-913e177f2e1b'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:11:59.363179 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-efc8012c-616b-4e1b-abca-913e177f2e1b admin admin] The token cache is being invalidate because project 592a5d5152f0441dbb0c0d11c89120b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:11:59.363469 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-efc8012c-616b-4e1b-abca-913e177f2e1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:11:59.364103 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-efc8012c-616b-4e1b-abca-913e177f2e1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:11:59.365575 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1265/2468] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Oct 14 13:11:59 2022] DELETE /identity/v3/projects/592a5d5152f0441dbb0c0d11c89120b5 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:12:08.999290 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:12:09.360311 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=80,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:12:50.900678 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba19fda-b16e-43bf-99b2-a9958a0c30d1 service neutron] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:12:50.902213 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-2ba19fda-b16e-43bf-99b2-a9958a0c30d1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:12:50.974908 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba19fda-b16e-43bf-99b2-a9958a0c30d1 service neutron] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:12:51.040521 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ce3b72-10ee-49e8-b74d-77a8b1baea82 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '931f4e32c8764514b5efed31b0785be7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:12:51.041267 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ce3b72-10ee-49e8-b74d-77a8b1baea82 service nova] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:12:51.041549 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ce3b72-10ee-49e8-b74d-77a8b1baea82 service nova] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:12:51.041822 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ce3b72-10ee-49e8-b74d-77a8b1baea82 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:12:51.043566 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-e6ce3b72-10ee-49e8-b74d-77a8b1baea82 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:12:51.102172 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ce3b72-10ee-49e8-b74d-77a8b1baea82 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:12:51.103786 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ce3b72-10ee-49e8-b74d-77a8b1baea82 service nova] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:12:51.113485 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1204/2469] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:12:50 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:13:01.108533 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=84 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:13:05.349284 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc8012c-616b-4e1b-abca-913e177f2e1b admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:13:05.350895 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-efc8012c-616b-4e1b-abca-913e177f2e1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:13:05.373587 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc8012c-616b-4e1b-abca-913e177f2e1b admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:13:05.381006 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d961f3-6f8d-4957-b616-322334b6d028 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '931f4e32c8764514b5efed31b0785be7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:13:05.381940 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d961f3-6f8d-4957-b616-322334b6d028 service nova] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:13:05.382297 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d961f3-6f8d-4957-b616-322334b6d028 service nova] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:13:05.382577 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d961f3-6f8d-4957-b616-322334b6d028 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:13:05.384500 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-22d961f3-6f8d-4957-b616-322334b6d028 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:13:05.402224 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d961f3-6f8d-4957-b616-322334b6d028 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:13:05.404142 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d961f3-6f8d-4957-b616-322334b6d028 service nova] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:13:05.420056 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1266/2470] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:13:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 14 13:13:11.065536 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ce3b72-10ee-49e8-b74d-77a8b1baea82 service nova] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:13:11.067066 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-e6ce3b72-10ee-49e8-b74d-77a8b1baea82 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:13:11.124962 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ce3b72-10ee-49e8-b74d-77a8b1baea82 service nova] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:13:11.128870 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873e3036-00b0-498f-8ec8-afd746fd0af6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d483292f3a4794848fcacfba5b107e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:13:11.129469 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873e3036-00b0-498f-8ec8-afd746fd0af6 service neutron] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:13:11.129749 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873e3036-00b0-498f-8ec8-afd746fd0af6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:13:11.130022 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873e3036-00b0-498f-8ec8-afd746fd0af6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:13:11.131745 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-873e3036-00b0-498f-8ec8-afd746fd0af6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:13:11.194173 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873e3036-00b0-498f-8ec8-afd746fd0af6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:13:11.195625 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873e3036-00b0-498f-8ec8-afd746fd0af6 service neutron] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:13:11.205982 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1205/2471] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:13:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:13:14.277270 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d961f3-6f8d-4957-b616-322334b6d028 service nova] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:13:14.279525 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-22d961f3-6f8d-4957-b616-322334b6d028 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:13:14.361306 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873e3036-00b0-498f-8ec8-afd746fd0af6 service neutron] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:13:14.362848 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-873e3036-00b0-498f-8ec8-afd746fd0af6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:13:14.386544 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873e3036-00b0-498f-8ec8-afd746fd0af6 service neutron] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:13:14.389368 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d961f3-6f8d-4957-b616-322334b6d028 service nova] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:13:14.392941 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68140c3-0e73-4a0b-b0ad-f22b36b09528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:13:14.393780 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68140c3-0e73-4a0b-b0ad-f22b36b09528 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:13:14.394079 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68140c3-0e73-4a0b-b0ad-f22b36b09528 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:13:14.396255 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650c6449-0135-413c-b387-bc4ffbd3055c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a5e5c35ed8b4abc877ba8d8c490dacd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:13:14.396410 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68140c3-0e73-4a0b-b0ad-f22b36b09528 admin admin] PATH_INFO: `/v3/users/b7394b504d0d4338adc6c599cadda6d6` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:13:14.397211 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650c6449-0135-413c-b387-bc4ffbd3055c service placement] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:13:14.397576 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68140c3-0e73-4a0b-b0ad-f22b36b09528 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7394b504d0d4338adc6c599cadda6d6)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:13:14.397721 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650c6449-0135-413c-b387-bc4ffbd3055c service placement] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:13:14.397888 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650c6449-0135-413c-b387-bc4ffbd3055c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:13:14.399698 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68140c3-0e73-4a0b-b0ad-f22b36b09528 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:13:14.399908 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-650c6449-0135-413c-b387-bc4ffbd3055c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:13:14.412695 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650c6449-0135-413c-b387-bc4ffbd3055c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:13:14.414311 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650c6449-0135-413c-b387-bc4ffbd3055c service placement] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:13:14.424480 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1267/2472] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:13:14 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:13:14.452489 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-d68140c3-0e73-4a0b-b0ad-f22b36b09528 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7394b504d0d4338adc6c599cadda6d6'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:13:14.461063 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-d68140c3-0e73-4a0b-b0ad-f22b36b09528 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7394b504d0d4338adc6c599cadda6d6'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:13:14.461763 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-d68140c3-0e73-4a0b-b0ad-f22b36b09528 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7394b504d0d4338adc6c599cadda6d6'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:13:14.469496 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-d68140c3-0e73-4a0b-b0ad-f22b36b09528 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7394b504d0d4338adc6c599cadda6d6'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:13:14.481334 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-d68140c3-0e73-4a0b-b0ad-f22b36b09528 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7394b504d0d4338adc6c599cadda6d6'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:13:14.487242 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1206/2473] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Oct 14 13:13:14 2022] DELETE /identity/v3/users/b7394b504d0d4338adc6c599cadda6d6 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 13:13:14.663244 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650c6449-0135-413c-b387-bc4ffbd3055c service placement] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:13:14.675108 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650c6449-0135-413c-b387-bc4ffbd3055c service placement] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:13:14.737567 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba465e9-44a2-46b2-974b-365fe8d61933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:13:14.738227 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba465e9-44a2-46b2-974b-365fe8d61933 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:13:14.738509 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba465e9-44a2-46b2-974b-365fe8d61933 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:13:14.738782 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba465e9-44a2-46b2-974b-365fe8d61933 admin admin] PATH_INFO: `/v3/projects/818c2b08a84f4fad8bf281f00d65eb55` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:13:14.739906 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba465e9-44a2-46b2-974b-365fe8d61933 admin admin] RBAC: Authorizing `identity:delete_project(project_id=818c2b08a84f4fad8bf281f00d65eb55)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:13:14.741808 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba465e9-44a2-46b2-974b-365fe8d61933 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:13:14.787634 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-cba465e9-44a2-46b2-974b-365fe8d61933 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '818c2b08a84f4fad8bf281f00d65eb55', 'request_id': 'req-cba465e9-44a2-46b2-974b-365fe8d61933'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:13:14.793257 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-cba465e9-44a2-46b2-974b-365fe8d61933 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '818c2b08a84f4fad8bf281f00d65eb55', 'request_id': 'req-cba465e9-44a2-46b2-974b-365fe8d61933'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:13:14.800316 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-cba465e9-44a2-46b2-974b-365fe8d61933 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '818c2b08a84f4fad8bf281f00d65eb55', 'request_id': 'req-cba465e9-44a2-46b2-974b-365fe8d61933'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:13:14.812212 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-cba465e9-44a2-46b2-974b-365fe8d61933 admin admin] The token cache is being invalidate because project 818c2b08a84f4fad8bf281f00d65eb55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:13:14.812503 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-cba465e9-44a2-46b2-974b-365fe8d61933 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:13:14.813120 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-cba465e9-44a2-46b2-974b-365fe8d61933 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:13:14.815573 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1268/2474] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Oct 14 13:13:14 2022] DELETE /identity/v3/projects/818c2b08a84f4fad8bf281f00d65eb55 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:13:14.820403 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f420a58-3afc-47bf-b39b-4a932df1c32e None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:13:14.820691 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f420a58-3afc-47bf-b39b-4a932df1c32e None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:13:14.820965 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f420a58-3afc-47bf-b39b-4a932df1c32e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:13:14.840598 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-8f420a58-3afc-47bf-b39b-4a932df1c32e None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:13:14.841805 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-8f420a58-3afc-47bf-b39b-4a932df1c32e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:13:14.858794 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:13:14.902858 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1207/2475] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:13:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:13:14.911994 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af84f28-a6a5-4f56-b532-0b22c6b6a4da None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:13:14.912214 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af84f28-a6a5-4f56-b532-0b22c6b6a4da None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:13:14.912491 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af84f28-a6a5-4f56-b532-0b22c6b6a4da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:13:14.927739 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:13:14.933320 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-3af84f28-a6a5-4f56-b532-0b22c6b6a4da None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:13:14.935164 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-3af84f28-a6a5-4f56-b532-0b22c6b6a4da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:13:14.944618 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1269/2476] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:13:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:13:14.948770 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f420a58-3afc-47bf-b39b-4a932df1c32e None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:13:14.958758 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f420a58-3afc-47bf-b39b-4a932df1c32e None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:13:14.963620 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a512d22-5340-41b0-ba48-a4f3a3b9c070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:13:14.964243 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a512d22-5340-41b0-ba48-a4f3a3b9c070 admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:13:14.964528 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a512d22-5340-41b0-ba48-a4f3a3b9c070 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:13:14.964807 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a512d22-5340-41b0-ba48-a4f3a3b9c070 admin admin] PATH_INFO: `/v3/domains` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:13:14.965463 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a512d22-5340-41b0-ba48-a4f3a3b9c070 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 13:13:14.965771 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a512d22-5340-41b0-ba48-a4f3a3b9c070 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:13:14.967410 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a512d22-5340-41b0-ba48-a4f3a3b9c070 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:13:14.979283 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1208/2477] 10.222.0.17 () {58 vars in 1153 bytes} [Fri Oct 14 13:13:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 13:13:14.983393 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af84f28-a6a5-4f56-b532-0b22c6b6a4da None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:13:14.995539 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af84f28-a6a5-4f56-b532-0b22c6b6a4da None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:13:15.000271 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d22f23-05f0-447b-8da4-68f0c10951ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:13:15.000906 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d22f23-05f0-447b-8da4-68f0c10951ed admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:13:15.001365 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d22f23-05f0-447b-8da4-68f0c10951ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:13:15.001772 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d22f23-05f0-447b-8da4-68f0c10951ed admin admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:13:15.002432 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d22f23-05f0-447b-8da4-68f0c10951ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:13:15.004322 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d22f23-05f0-447b-8da4-68f0c10951ed admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:13:15.031774 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1270/2478] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Oct 14 13:13:14 2022] POST /identity/v3/projects => generated 387 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:13:15.036575 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a512d22-5340-41b0-ba48-a4f3a3b9c070 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:13:15.046414 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a512d22-5340-41b0-ba48-a4f3a3b9c070 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:13:15.102642 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cbe720-7654-4164-9b24-c83405090281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:13:15.103251 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cbe720-7654-4164-9b24-c83405090281 admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:13:15.103527 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cbe720-7654-4164-9b24-c83405090281 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:13:15.103797 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cbe720-7654-4164-9b24-c83405090281 admin admin] PATH_INFO: `/v3/users` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:13:15.104442 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cbe720-7654-4164-9b24-c83405090281 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:13:15.106400 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cbe720-7654-4164-9b24-c83405090281 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:13:15.127797 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1209/2479] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Oct 14 13:13:15 2022] POST /identity/v3/users => generated 294 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:13:15.131980 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d22f23-05f0-447b-8da4-68f0c10951ed admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:13:15.142544 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d22f23-05f0-447b-8da4-68f0c10951ed admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:13:15.147189 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffa70c0-9def-40b9-8d34-57479f8860eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:13:15.147779 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffa70c0-9def-40b9-8d34-57479f8860eb admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:13:15.148060 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffa70c0-9def-40b9-8d34-57479f8860eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:13:15.148336 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffa70c0-9def-40b9-8d34-57479f8860eb admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:13:15.149004 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffa70c0-9def-40b9-8d34-57479f8860eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:13:15.150647 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffa70c0-9def-40b9-8d34-57479f8860eb admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:13:15.160848 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1271/2480] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:13:15 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:13:15.164654 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cbe720-7654-4164-9b24-c83405090281 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:13:15.175051 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cbe720-7654-4164-9b24-c83405090281 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:13:15.179597 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d4e31e-8bc9-4d6d-a0bd-c99939bb5071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:13:15.180178 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d4e31e-8bc9-4d6d-a0bd-c99939bb5071 admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:13:15.180457 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d4e31e-8bc9-4d6d-a0bd-c99939bb5071 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:13:15.180730 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d4e31e-8bc9-4d6d-a0bd-c99939bb5071 admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:13:15.181360 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d4e31e-8bc9-4d6d-a0bd-c99939bb5071 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:13:15.182969 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d4e31e-8bc9-4d6d-a0bd-c99939bb5071 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:13:15.193277 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1210/2481] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:13:15 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:13:15.197392 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffa70c0-9def-40b9-8d34-57479f8860eb admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:13:15.207449 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffa70c0-9def-40b9-8d34-57479f8860eb admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:13:15.212092 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a4314a-8581-4098-b41d-a7ef4805582c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:13:15.212731 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a4314a-8581-4098-b41d-a7ef4805582c admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:13:15.213264 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a4314a-8581-4098-b41d-a7ef4805582c admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:13:15.213541 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a4314a-8581-4098-b41d-a7ef4805582c admin admin] PATH_INFO: `/v3/projects/11014f3ff399443fabc10f1431331b96/users/1ba83ba52cb74e3da9771ef49d31fe8e/roles/5e8849303a75425b9eaa2681cc031af1` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:13:15.228967 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a4314a-8581-4098-b41d-a7ef4805582c admin admin] RBAC: Authorizing `identity:create_grant(project_id=11014f3ff399443fabc10f1431331b96, user_id=1ba83ba52cb74e3da9771ef49d31fe8e, role_id=5e8849303a75425b9eaa2681cc031af1)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:13:15.231667 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a4314a-8581-4098-b41d-a7ef4805582c admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:13:15.245182 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1272/2482] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Oct 14 13:13:15 2022] PUT /identity/v3/projects/11014f3ff399443fabc10f1431331b96/users/1ba83ba52cb74e3da9771ef49d31fe8e/roles/5e8849303a75425b9eaa2681cc031af1 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:13:15.255655 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3342f08-7d49-48a2-9729-73b11d289ce0 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:13:15.255963 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3342f08-7d49-48a2-9729-73b11d289ce0 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:13:15.256220 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3342f08-7d49-48a2-9729-73b11d289ce0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:13:15.284578 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-b3342f08-7d49-48a2-9729-73b11d289ce0 None None] MFA Rules not processed for user `1ba83ba52cb74e3da9771ef49d31fe8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:13:15.285811 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-b3342f08-7d49-48a2-9729-73b11d289ce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:13:15.350173 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1211/2483] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:13:15 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:13:15.354639 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a4314a-8581-4098-b41d-a7ef4805582c admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:13:15.414600 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a4314a-8581-4098-b41d-a7ef4805582c admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:13:15.419355 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa556957-0720-4e2f-b7c4-521fa1aca5cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:13:15.419888 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa556957-0720-4e2f-b7c4-521fa1aca5cd admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:13:15.420161 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa556957-0720-4e2f-b7c4-521fa1aca5cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:13:15.420425 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa556957-0720-4e2f-b7c4-521fa1aca5cd admin admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:13:15.421033 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa556957-0720-4e2f-b7c4-521fa1aca5cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:13:15.423056 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa556957-0720-4e2f-b7c4-521fa1aca5cd admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:13:15.448064 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1273/2484] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Oct 14 13:13:15 2022] POST /identity/v3/projects => generated 385 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:13:15.452256 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3342f08-7d49-48a2-9729-73b11d289ce0 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:13:15.463905 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3342f08-7d49-48a2-9729-73b11d289ce0 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:13:15.476763 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:13:15.520946 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cdabb9-5f86-4b6f-bba8-4c5f47f12df8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:13:15.521548 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cdabb9-5f86-4b6f-bba8-4c5f47f12df8 admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:13:15.521831 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cdabb9-5f86-4b6f-bba8-4c5f47f12df8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:13:15.522107 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cdabb9-5f86-4b6f-bba8-4c5f47f12df8 admin admin] PATH_INFO: `/v3/users` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:13:15.522762 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cdabb9-5f86-4b6f-bba8-4c5f47f12df8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:13:15.524688 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cdabb9-5f86-4b6f-bba8-4c5f47f12df8 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:13:15.545938 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1212/2485] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Oct 14 13:13:15 2022] POST /identity/v3/users => generated 299 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:13:15.550136 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa556957-0720-4e2f-b7c4-521fa1aca5cd admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:13:15.560507 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa556957-0720-4e2f-b7c4-521fa1aca5cd admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:13:15.565189 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fd7d16-1a0e-47f8-9246-f2ec812e5401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:13:15.565778 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fd7d16-1a0e-47f8-9246-f2ec812e5401 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:13:15.566060 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fd7d16-1a0e-47f8-9246-f2ec812e5401 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:13:15.566366 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fd7d16-1a0e-47f8-9246-f2ec812e5401 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:13:15.567004 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fd7d16-1a0e-47f8-9246-f2ec812e5401 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:13:15.568607 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fd7d16-1a0e-47f8-9246-f2ec812e5401 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:13:15.579434 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1274/2486] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:13:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:13:15.583554 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cdabb9-5f86-4b6f-bba8-4c5f47f12df8 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:13:15.593686 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cdabb9-5f86-4b6f-bba8-4c5f47f12df8 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:13:15.599181 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962278e2-2908-437d-aa10-54f68efc25a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:13:15.599820 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962278e2-2908-437d-aa10-54f68efc25a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:13:15.600098 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962278e2-2908-437d-aa10-54f68efc25a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:13:15.600372 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962278e2-2908-437d-aa10-54f68efc25a1 admin admin] PATH_INFO: `/v3/projects/73781d82d7f64c4f8cf37e720b99e68b/users/4259f7762d6345728754a8908285d5d5/roles/7f6e29e390bc41f7a9af17659a2e95d1` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:13:15.616324 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962278e2-2908-437d-aa10-54f68efc25a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73781d82d7f64c4f8cf37e720b99e68b, user_id=4259f7762d6345728754a8908285d5d5, role_id=7f6e29e390bc41f7a9af17659a2e95d1)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:13:15.619009 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962278e2-2908-437d-aa10-54f68efc25a1 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:13:15.631520 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1213/2487] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Oct 14 13:13:15 2022] PUT /identity/v3/projects/73781d82d7f64c4f8cf37e720b99e68b/users/4259f7762d6345728754a8908285d5d5/roles/7f6e29e390bc41f7a9af17659a2e95d1 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:13:15.635470 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fd7d16-1a0e-47f8-9246-f2ec812e5401 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:13:15.645808 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fd7d16-1a0e-47f8-9246-f2ec812e5401 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:13:15.701280 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b41f1b6-3a3c-48b6-9638-d2517b3682a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:13:15.701894 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b41f1b6-3a3c-48b6-9638-d2517b3682a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:13:15.702195 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b41f1b6-3a3c-48b6-9638-d2517b3682a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:13:15.702467 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b41f1b6-3a3c-48b6-9638-d2517b3682a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:13:15.703095 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b41f1b6-3a3c-48b6-9638-d2517b3682a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:13:15.705447 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b41f1b6-3a3c-48b6-9638-d2517b3682a7 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:13:15.715375 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1275/2488] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:13:15 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:13:15.720052 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962278e2-2908-437d-aa10-54f68efc25a1 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:13:15.730429 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962278e2-2908-437d-aa10-54f68efc25a1 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:13:15.735085 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67efb7e-6970-4ac9-b35a-db8c18bc6f3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:13:15.735818 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67efb7e-6970-4ac9-b35a-db8c18bc6f3d admin admin] REQUEST_METHOD: `PUT` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:13:15.736100 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67efb7e-6970-4ac9-b35a-db8c18bc6f3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:13:15.736371 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67efb7e-6970-4ac9-b35a-db8c18bc6f3d admin admin] PATH_INFO: `/v3/projects/73781d82d7f64c4f8cf37e720b99e68b/users/4259f7762d6345728754a8908285d5d5/roles/7f6e29e390bc41f7a9af17659a2e95d1` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:13:15.738310 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67efb7e-6970-4ac9-b35a-db8c18bc6f3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=73781d82d7f64c4f8cf37e720b99e68b, user_id=4259f7762d6345728754a8908285d5d5, role_id=7f6e29e390bc41f7a9af17659a2e95d1)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:13:15.740917 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67efb7e-6970-4ac9-b35a-db8c18bc6f3d admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:13:15.753174 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1214/2489] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Oct 14 13:13:15 2022] PUT /identity/v3/projects/73781d82d7f64c4f8cf37e720b99e68b/users/4259f7762d6345728754a8908285d5d5/roles/7f6e29e390bc41f7a9af17659a2e95d1 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:13:15.763639 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95947bb4-e073-40e6-9725-631308f7fd7c None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:13:15.763953 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95947bb4-e073-40e6-9725-631308f7fd7c None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:13:15.764228 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95947bb4-e073-40e6-9725-631308f7fd7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:13:15.790162 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:13:15.793222 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-95947bb4-e073-40e6-9725-631308f7fd7c None None] MFA Rules not processed for user `4259f7762d6345728754a8908285d5d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:13:15.795072 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-95947bb4-e073-40e6-9725-631308f7fd7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:13:15.863770 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1276/2490] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:13:15 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:13:15.875458 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67efb7e-6970-4ac9-b35a-db8c18bc6f3d admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:13:15.877962 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-d67efb7e-6970-4ac9-b35a-db8c18bc6f3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:13:15.936186 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67efb7e-6970-4ac9-b35a-db8c18bc6f3d admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:13:15.939977 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea2bee9-dcb2-4fa9-86d0-a9694ddd86a3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c3c564b8c548e4beef1cbfba2ad343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:13:15.940568 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea2bee9-dcb2-4fa9-86d0-a9694ddd86a3 service cinder] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:13:15.940843 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea2bee9-dcb2-4fa9-86d0-a9694ddd86a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:13:15.941111 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea2bee9-dcb2-4fa9-86d0-a9694ddd86a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:13:15.949983 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea2bee9-dcb2-4fa9-86d0-a9694ddd86a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:13:15.951488 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea2bee9-dcb2-4fa9-86d0-a9694ddd86a3 service cinder] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:13:15.960778 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1215/2491] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:13:15 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:13:15.991119 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95947bb4-e073-40e6-9725-631308f7fd7c None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:13:16.054411 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95947bb4-e073-40e6-9725-631308f7fd7c None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:13:16.059105 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff584fc-b063-4472-882e-7d5ae0f6e14f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:13:16.059733 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff584fc-b063-4472-882e-7d5ae0f6e14f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:13:16.060017 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff584fc-b063-4472-882e-7d5ae0f6e14f admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:13:16.060293 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff584fc-b063-4472-882e-7d5ae0f6e14f admin admin] PATH_INFO: `/v3/users/1ba83ba52cb74e3da9771ef49d31fe8e` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:13:16.061424 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff584fc-b063-4472-882e-7d5ae0f6e14f admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ba83ba52cb74e3da9771ef49d31fe8e)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:13:16.063399 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff584fc-b063-4472-882e-7d5ae0f6e14f admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:13:16.111500 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-4ff584fc-b063-4472-882e-7d5ae0f6e14f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ba83ba52cb74e3da9771ef49d31fe8e'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:13:16.118369 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-4ff584fc-b063-4472-882e-7d5ae0f6e14f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ba83ba52cb74e3da9771ef49d31fe8e'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:13:16.119075 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-4ff584fc-b063-4472-882e-7d5ae0f6e14f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ba83ba52cb74e3da9771ef49d31fe8e'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:13:16.126268 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-4ff584fc-b063-4472-882e-7d5ae0f6e14f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ba83ba52cb74e3da9771ef49d31fe8e'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:13:16.137996 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-4ff584fc-b063-4472-882e-7d5ae0f6e14f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ba83ba52cb74e3da9771ef49d31fe8e'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:13:16.144467 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1277/2492] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Oct 14 13:13:15 2022] DELETE /identity/v3/users/1ba83ba52cb74e3da9771ef49d31fe8e => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:13:16.148974 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a037532-d2d3-4d55-92b3-0bceac32ed80 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:13:16.149277 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a037532-d2d3-4d55-92b3-0bceac32ed80 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:13:16.149578 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a037532-d2d3-4d55-92b3-0bceac32ed80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:13:16.168524 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-8a037532-d2d3-4d55-92b3-0bceac32ed80 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:13:16.169731 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-8a037532-d2d3-4d55-92b3-0bceac32ed80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:13:16.227356 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1216/2493] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:13:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:13:16.237074 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff584fc-b063-4472-882e-7d5ae0f6e14f admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:13:16.238536 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-4ff584fc-b063-4472-882e-7d5ae0f6e14f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:13:16.259431 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:13:16.299528 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff584fc-b063-4472-882e-7d5ae0f6e14f admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:13:16.303219 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3118f41f-e04a-4c73-950b-ac85df87c740 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d483292f3a4794848fcacfba5b107e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:13:16.303820 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3118f41f-e04a-4c73-950b-ac85df87c740 service neutron] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:13:16.304095 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3118f41f-e04a-4c73-950b-ac85df87c740 service neutron] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:13:16.304365 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3118f41f-e04a-4c73-950b-ac85df87c740 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:13:16.313410 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3118f41f-e04a-4c73-950b-ac85df87c740 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:13:16.315187 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3118f41f-e04a-4c73-950b-ac85df87c740 service neutron] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:13:16.324446 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1278/2494] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:13:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:13:16.590529 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a037532-d2d3-4d55-92b3-0bceac32ed80 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:13:16.592674 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-8a037532-d2d3-4d55-92b3-0bceac32ed80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:13:16.612613 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a037532-d2d3-4d55-92b3-0bceac32ed80 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:13:16.617355 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04806fb8-1fb4-4fa2-84cf-31ffdca3541a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:13:16.617986 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04806fb8-1fb4-4fa2-84cf-31ffdca3541a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:13:16.618280 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04806fb8-1fb4-4fa2-84cf-31ffdca3541a admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:13:16.618552 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04806fb8-1fb4-4fa2-84cf-31ffdca3541a admin admin] PATH_INFO: `/v3/projects/11014f3ff399443fabc10f1431331b96` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:13:16.619740 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04806fb8-1fb4-4fa2-84cf-31ffdca3541a admin admin] RBAC: Authorizing `identity:delete_project(project_id=11014f3ff399443fabc10f1431331b96)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:13:16.621643 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04806fb8-1fb4-4fa2-84cf-31ffdca3541a admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:13:16.629947 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:13:16.669755 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-04806fb8-1fb4-4fa2-84cf-31ffdca3541a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11014f3ff399443fabc10f1431331b96', 'request_id': 'req-04806fb8-1fb4-4fa2-84cf-31ffdca3541a'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:13:16.675993 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-04806fb8-1fb4-4fa2-84cf-31ffdca3541a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11014f3ff399443fabc10f1431331b96', 'request_id': 'req-04806fb8-1fb4-4fa2-84cf-31ffdca3541a'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:13:16.682756 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-04806fb8-1fb4-4fa2-84cf-31ffdca3541a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11014f3ff399443fabc10f1431331b96', 'request_id': 'req-04806fb8-1fb4-4fa2-84cf-31ffdca3541a'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:13:16.695044 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-04806fb8-1fb4-4fa2-84cf-31ffdca3541a admin admin] The token cache is being invalidate because project 11014f3ff399443fabc10f1431331b96 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:13:16.695335 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-04806fb8-1fb4-4fa2-84cf-31ffdca3541a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:13:16.695950 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-04806fb8-1fb4-4fa2-84cf-31ffdca3541a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:13:16.697439 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1217/2495] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Oct 14 13:13:16 2022] DELETE /identity/v3/projects/11014f3ff399443fabc10f1431331b96 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:13:16.701361 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3118f41f-e04a-4c73-950b-ac85df87c740 service neutron] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:13:16.711212 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3118f41f-e04a-4c73-950b-ac85df87c740 service neutron] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:13:16.768427 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e42ee9-31ab-485b-8229-11f75b9b2837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:13:16.768976 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e42ee9-31ab-485b-8229-11f75b9b2837 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:13:16.769257 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e42ee9-31ab-485b-8229-11f75b9b2837 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:13:16.769533 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e42ee9-31ab-485b-8229-11f75b9b2837 admin admin] PATH_INFO: `/v3/users/4259f7762d6345728754a8908285d5d5` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:13:16.770704 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e42ee9-31ab-485b-8229-11f75b9b2837 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4259f7762d6345728754a8908285d5d5)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:13:16.772633 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e42ee9-31ab-485b-8229-11f75b9b2837 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:13:16.817534 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-48e42ee9-31ab-485b-8229-11f75b9b2837 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4259f7762d6345728754a8908285d5d5'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:13:16.824234 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-48e42ee9-31ab-485b-8229-11f75b9b2837 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4259f7762d6345728754a8908285d5d5'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:13:16.824886 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-48e42ee9-31ab-485b-8229-11f75b9b2837 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4259f7762d6345728754a8908285d5d5'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:13:16.832497 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-48e42ee9-31ab-485b-8229-11f75b9b2837 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4259f7762d6345728754a8908285d5d5'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:13:16.845408 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-48e42ee9-31ab-485b-8229-11f75b9b2837 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4259f7762d6345728754a8908285d5d5'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:13:16.851273 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1279/2496] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Oct 14 13:13:16 2022] DELETE /identity/v3/users/4259f7762d6345728754a8908285d5d5 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:13:17.117843 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04806fb8-1fb4-4fa2-84cf-31ffdca3541a admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:13:17.119478 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-04806fb8-1fb4-4fa2-84cf-31ffdca3541a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:13:17.132690 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04806fb8-1fb4-4fa2-84cf-31ffdca3541a admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:13:17.189893 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee5d7df-9ebc-401c-8879-badc2d4be98e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:13:17.190563 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee5d7df-9ebc-401c-8879-badc2d4be98e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:13:17.190844 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee5d7df-9ebc-401c-8879-badc2d4be98e admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:13:17.191119 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee5d7df-9ebc-401c-8879-badc2d4be98e admin admin] PATH_INFO: `/v3/projects/73781d82d7f64c4f8cf37e720b99e68b` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:13:17.192221 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee5d7df-9ebc-401c-8879-badc2d4be98e admin admin] RBAC: Authorizing `identity:delete_project(project_id=73781d82d7f64c4f8cf37e720b99e68b)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:13:17.195228 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee5d7df-9ebc-401c-8879-badc2d4be98e admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:13:17.243591 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-6ee5d7df-9ebc-401c-8879-badc2d4be98e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73781d82d7f64c4f8cf37e720b99e68b', 'request_id': 'req-6ee5d7df-9ebc-401c-8879-badc2d4be98e'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:13:17.249428 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-6ee5d7df-9ebc-401c-8879-badc2d4be98e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73781d82d7f64c4f8cf37e720b99e68b', 'request_id': 'req-6ee5d7df-9ebc-401c-8879-badc2d4be98e'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:13:17.256272 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-6ee5d7df-9ebc-401c-8879-badc2d4be98e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73781d82d7f64c4f8cf37e720b99e68b', 'request_id': 'req-6ee5d7df-9ebc-401c-8879-badc2d4be98e'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:13:17.269666 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-6ee5d7df-9ebc-401c-8879-badc2d4be98e admin admin] The token cache is being invalidate because project 73781d82d7f64c4f8cf37e720b99e68b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81439) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:13:17.269961 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-6ee5d7df-9ebc-401c-8879-badc2d4be98e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:13:17.270641 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-6ee5d7df-9ebc-401c-8879-badc2d4be98e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:13:17.272151 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1218/2497] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Oct 14 13:13:17 2022] DELETE /identity/v3/projects/73781d82d7f64c4f8cf37e720b99e68b => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:13:17.277096 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cdcd83-bf17-4924-9f23-821cb850fb8e None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:13:17.277384 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cdcd83-bf17-4924-9f23-821cb850fb8e None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:13:17.277685 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cdcd83-bf17-4924-9f23-821cb850fb8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:13:17.303068 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-d0cdcd83-bf17-4924-9f23-821cb850fb8e None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:13:17.304279 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-d0cdcd83-bf17-4924-9f23-821cb850fb8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:13:17.340994 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:13:17.367494 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1280/2498] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:13:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:13:17.377171 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05877c00-27ac-47a0-924f-d0ab87e12e1e None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:13:17.377458 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05877c00-27ac-47a0-924f-d0ab87e12e1e None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:13:17.377733 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05877c00-27ac-47a0-924f-d0ab87e12e1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:13:17.399116 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-05877c00-27ac-47a0-924f-d0ab87e12e1e None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:13:17.400381 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-05877c00-27ac-47a0-924f-d0ab87e12e1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:13:17.408894 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1219/2499] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:13:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 13:13:17.413133 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cdcd83-bf17-4924-9f23-821cb850fb8e None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:13:17.422839 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cdcd83-bf17-4924-9f23-821cb850fb8e None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:13:17.427387 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79668b2b-7d8c-4f7c-b824-6be964813aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:13:17.427975 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79668b2b-7d8c-4f7c-b824-6be964813aab admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:13:17.428257 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79668b2b-7d8c-4f7c-b824-6be964813aab admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:13:17.428529 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79668b2b-7d8c-4f7c-b824-6be964813aab admin admin] PATH_INFO: `/v3/domains` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:13:17.429166 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79668b2b-7d8c-4f7c-b824-6be964813aab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81438) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 13:13:17.429470 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79668b2b-7d8c-4f7c-b824-6be964813aab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:13:17.431110 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79668b2b-7d8c-4f7c-b824-6be964813aab admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:13:17.445281 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1281/2500] 10.222.0.17 () {58 vars in 1153 bytes} [Fri Oct 14 13:13:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 13:13:17.448956 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05877c00-27ac-47a0-924f-d0ab87e12e1e None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:13:17.459265 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05877c00-27ac-47a0-924f-d0ab87e12e1e None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:13:17.464189 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02c9899-c544-452d-9c74-b0778d7c5007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:13:17.464776 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02c9899-c544-452d-9c74-b0778d7c5007 admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:13:17.465059 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02c9899-c544-452d-9c74-b0778d7c5007 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:13:17.465331 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02c9899-c544-452d-9c74-b0778d7c5007 admin admin] PATH_INFO: `/v3/projects` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:13:17.465967 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02c9899-c544-452d-9c74-b0778d7c5007 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:13:17.467878 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02c9899-c544-452d-9c74-b0778d7c5007 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:13:17.488592 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:13:17.497084 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1220/2501] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Oct 14 13:13:17 2022] POST /identity/v3/projects => generated 379 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:13:17.501639 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79668b2b-7d8c-4f7c-b824-6be964813aab admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:13:17.511876 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79668b2b-7d8c-4f7c-b824-6be964813aab admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:13:17.568389 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd2505a-4e27-44b2-b905-bca8d548fb21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:13:17.568892 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd2505a-4e27-44b2-b905-bca8d548fb21 admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:13:17.569169 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd2505a-4e27-44b2-b905-bca8d548fb21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:13:17.569438 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd2505a-4e27-44b2-b905-bca8d548fb21 admin admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:13:17.570062 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd2505a-4e27-44b2-b905-bca8d548fb21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:13:17.572002 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd2505a-4e27-44b2-b905-bca8d548fb21 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:13:17.592848 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1282/2502] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Oct 14 13:13:17 2022] POST /identity/v3/users => generated 290 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:13:17.597065 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02c9899-c544-452d-9c74-b0778d7c5007 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:13:17.607294 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02c9899-c544-452d-9c74-b0778d7c5007 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:13:17.612797 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0e9c9b-152d-446c-af43-95b6ad8bd6d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:13:17.613388 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0e9c9b-152d-446c-af43-95b6ad8bd6d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:13:17.613671 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0e9c9b-152d-446c-af43-95b6ad8bd6d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:13:17.613944 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0e9c9b-152d-446c-af43-95b6ad8bd6d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:13:17.614621 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0e9c9b-152d-446c-af43-95b6ad8bd6d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:13:17.616221 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0e9c9b-152d-446c-af43-95b6ad8bd6d7 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:13:17.627297 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1221/2503] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:13:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:13:17.630384 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd2505a-4e27-44b2-b905-bca8d548fb21 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:13:17.640040 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd2505a-4e27-44b2-b905-bca8d548fb21 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:13:17.644785 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4f06f3-b313-4397-9081-2e44d816ff20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:13:17.645368 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4f06f3-b313-4397-9081-2e44d816ff20 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:13:17.645647 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4f06f3-b313-4397-9081-2e44d816ff20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:13:17.645916 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4f06f3-b313-4397-9081-2e44d816ff20 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:13:17.646584 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4f06f3-b313-4397-9081-2e44d816ff20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:13:17.648175 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4f06f3-b313-4397-9081-2e44d816ff20 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:13:17.659319 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1283/2504] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:13:17 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 14 13:13:17.663955 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0e9c9b-152d-446c-af43-95b6ad8bd6d7 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:13:17.674700 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0e9c9b-152d-446c-af43-95b6ad8bd6d7 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:13:17.679292 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87497078-6e86-4f7e-816e-54538e1820a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:13:17.679939 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87497078-6e86-4f7e-816e-54538e1820a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:13:17.680225 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87497078-6e86-4f7e-816e-54538e1820a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:13:17.680502 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87497078-6e86-4f7e-816e-54538e1820a9 admin admin] PATH_INFO: `/v3/projects/54e54c69671644ffa5d9f2800865151e/users/16f7824f071f4ded8335c5ea07828caa/roles/5e8849303a75425b9eaa2681cc031af1` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:13:17.695484 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87497078-6e86-4f7e-816e-54538e1820a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54e54c69671644ffa5d9f2800865151e, user_id=16f7824f071f4ded8335c5ea07828caa, role_id=5e8849303a75425b9eaa2681cc031af1)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:13:17.698165 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87497078-6e86-4f7e-816e-54538e1820a9 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:13:17.711477 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1222/2505] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Oct 14 13:13:17 2022] PUT /identity/v3/projects/54e54c69671644ffa5d9f2800865151e/users/16f7824f071f4ded8335c5ea07828caa/roles/5e8849303a75425b9eaa2681cc031af1 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:13:17.722248 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5140d55-d488-45da-aa2c-6c8c941c8a42 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:13:17.722718 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5140d55-d488-45da-aa2c-6c8c941c8a42 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:13:17.722816 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5140d55-d488-45da-aa2c-6c8c941c8a42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:13:17.751769 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-d5140d55-d488-45da-aa2c-6c8c941c8a42 None None] MFA Rules not processed for user `16f7824f071f4ded8335c5ea07828caa`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:13:17.752995 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-d5140d55-d488-45da-aa2c-6c8c941c8a42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:13:17.819152 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1284/2506] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:13:17 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:13:17.823633 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87497078-6e86-4f7e-816e-54538e1820a9 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:13:17.885756 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87497078-6e86-4f7e-816e-54538e1820a9 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:13:17.890645 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e97c80-7a64-42cf-8318-a1e6c6cac6e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:13:17.891250 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e97c80-7a64-42cf-8318-a1e6c6cac6e0 admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:13:17.892001 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e97c80-7a64-42cf-8318-a1e6c6cac6e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:13:17.892284 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e97c80-7a64-42cf-8318-a1e6c6cac6e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:13:17.892913 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e97c80-7a64-42cf-8318-a1e6c6cac6e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:13:17.894895 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e97c80-7a64-42cf-8318-a1e6c6cac6e0 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:13:17.920852 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1223/2507] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Oct 14 13:13:17 2022] POST /identity/v3/projects => generated 381 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 13:13:17.925712 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5140d55-d488-45da-aa2c-6c8c941c8a42 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:13:17.936207 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5140d55-d488-45da-aa2c-6c8c941c8a42 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:13:17.967876 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:13:17.993627 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831f5d9f-82af-4b62-8ea7-38dc4fd8f91c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:13:17.994249 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831f5d9f-82af-4b62-8ea7-38dc4fd8f91c admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:13:17.994525 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831f5d9f-82af-4b62-8ea7-38dc4fd8f91c admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:13:17.994792 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831f5d9f-82af-4b62-8ea7-38dc4fd8f91c admin admin] PATH_INFO: `/v3/users` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:13:17.995404 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831f5d9f-82af-4b62-8ea7-38dc4fd8f91c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:13:17.997315 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831f5d9f-82af-4b62-8ea7-38dc4fd8f91c admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:13:18.016705 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1285/2508] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Oct 14 13:13:17 2022] POST /identity/v3/users => generated 297 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:13:18.020737 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e97c80-7a64-42cf-8318-a1e6c6cac6e0 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:13:18.030829 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e97c80-7a64-42cf-8318-a1e6c6cac6e0 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:13:18.036104 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33707b10-ae78-42c8-8d9d-a1853dc8d2e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:13:18.036812 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33707b10-ae78-42c8-8d9d-a1853dc8d2e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:13:18.036936 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33707b10-ae78-42c8-8d9d-a1853dc8d2e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:13:18.037210 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33707b10-ae78-42c8-8d9d-a1853dc8d2e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:13:18.037874 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33707b10-ae78-42c8-8d9d-a1853dc8d2e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:13:18.039491 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33707b10-ae78-42c8-8d9d-a1853dc8d2e4 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:13:18.050563 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1224/2509] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:13:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:13:18.054711 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831f5d9f-82af-4b62-8ea7-38dc4fd8f91c admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:13:18.064632 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831f5d9f-82af-4b62-8ea7-38dc4fd8f91c admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:13:18.069267 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5a219a-5694-4d57-b1f7-78bf94a896a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:13:18.069846 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5a219a-5694-4d57-b1f7-78bf94a896a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:13:18.070135 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5a219a-5694-4d57-b1f7-78bf94a896a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:13:18.070417 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5a219a-5694-4d57-b1f7-78bf94a896a8 admin admin] PATH_INFO: `/v3/projects/4f706c7b4c8b489eb4e5bb3542314f4e/users/ab206f6a6237428aaa0da905f1b6f586/roles/7f6e29e390bc41f7a9af17659a2e95d1` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:13:18.086613 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5a219a-5694-4d57-b1f7-78bf94a896a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f706c7b4c8b489eb4e5bb3542314f4e, user_id=ab206f6a6237428aaa0da905f1b6f586, role_id=7f6e29e390bc41f7a9af17659a2e95d1)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:13:18.089600 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5a219a-5694-4d57-b1f7-78bf94a896a8 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:13:18.103006 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1286/2510] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Oct 14 13:13:18 2022] PUT /identity/v3/projects/4f706c7b4c8b489eb4e5bb3542314f4e/users/ab206f6a6237428aaa0da905f1b6f586/roles/7f6e29e390bc41f7a9af17659a2e95d1 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:13:18.107007 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33707b10-ae78-42c8-8d9d-a1853dc8d2e4 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:13:18.118280 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33707b10-ae78-42c8-8d9d-a1853dc8d2e4 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:13:18.173745 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3242e6a4-6e2b-4146-ab42-b9acdd6c54ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:13:18.174379 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3242e6a4-6e2b-4146-ab42-b9acdd6c54ab admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:13:18.174662 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3242e6a4-6e2b-4146-ab42-b9acdd6c54ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:13:18.174933 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3242e6a4-6e2b-4146-ab42-b9acdd6c54ab admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:13:18.175571 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3242e6a4-6e2b-4146-ab42-b9acdd6c54ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:13:18.177172 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3242e6a4-6e2b-4146-ab42-b9acdd6c54ab admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:13:18.186755 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1225/2511] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:13:18 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:13:18.191568 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5a219a-5694-4d57-b1f7-78bf94a896a8 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:13:18.201724 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5a219a-5694-4d57-b1f7-78bf94a896a8 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:13:18.206559 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26da591e-00fa-4183-823c-0a16ce70adee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:13:18.207204 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26da591e-00fa-4183-823c-0a16ce70adee admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:13:18.207488 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26da591e-00fa-4183-823c-0a16ce70adee admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:13:18.207769 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26da591e-00fa-4183-823c-0a16ce70adee admin admin] PATH_INFO: `/v3/projects/4f706c7b4c8b489eb4e5bb3542314f4e/users/ab206f6a6237428aaa0da905f1b6f586/roles/7f6e29e390bc41f7a9af17659a2e95d1` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:13:18.209718 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26da591e-00fa-4183-823c-0a16ce70adee admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f706c7b4c8b489eb4e5bb3542314f4e, user_id=ab206f6a6237428aaa0da905f1b6f586, role_id=7f6e29e390bc41f7a9af17659a2e95d1)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:13:18.212450 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26da591e-00fa-4183-823c-0a16ce70adee admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:13:18.223453 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1287/2512] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Oct 14 13:13:18 2022] PUT /identity/v3/projects/4f706c7b4c8b489eb4e5bb3542314f4e/users/ab206f6a6237428aaa0da905f1b6f586/roles/7f6e29e390bc41f7a9af17659a2e95d1 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:13:18.233438 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9b2786-96d8-4e30-bd3f-24e51b33df43 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:13:18.233732 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9b2786-96d8-4e30-bd3f-24e51b33df43 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:13:18.234015 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9b2786-96d8-4e30-bd3f-24e51b33df43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:13:18.261816 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-5f9b2786-96d8-4e30-bd3f-24e51b33df43 None None] MFA Rules not processed for user `ab206f6a6237428aaa0da905f1b6f586`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:13:18.263125 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-5f9b2786-96d8-4e30-bd3f-24e51b33df43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:13:18.284158 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:13:18.334639 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1226/2513] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:13:18 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:13:18.346382 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26da591e-00fa-4183-823c-0a16ce70adee admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:13:18.348055 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-26da591e-00fa-4183-823c-0a16ce70adee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:13:18.405159 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26da591e-00fa-4183-823c-0a16ce70adee admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:13:18.409692 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd049e46-a60c-4a54-90d9-792229be5262 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c3c564b8c548e4beef1cbfba2ad343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:13:18.410312 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd049e46-a60c-4a54-90d9-792229be5262 service cinder] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:13:18.410637 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd049e46-a60c-4a54-90d9-792229be5262 service cinder] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:13:18.410911 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd049e46-a60c-4a54-90d9-792229be5262 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:13:18.419748 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd049e46-a60c-4a54-90d9-792229be5262 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:13:18.421173 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd049e46-a60c-4a54-90d9-792229be5262 service cinder] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:13:18.434448 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1288/2514] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:13:18 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:13:18.802940 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9b2786-96d8-4e30-bd3f-24e51b33df43 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:13:18.864300 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9b2786-96d8-4e30-bd3f-24e51b33df43 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:13:18.868748 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34e338a-3c76-4fb0-8bd1-304dbca99ded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:13:18.869372 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34e338a-3c76-4fb0-8bd1-304dbca99ded admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:13:18.869651 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34e338a-3c76-4fb0-8bd1-304dbca99ded admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:13:18.869920 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34e338a-3c76-4fb0-8bd1-304dbca99ded admin admin] PATH_INFO: `/v3/users/16f7824f071f4ded8335c5ea07828caa` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:13:18.871071 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34e338a-3c76-4fb0-8bd1-304dbca99ded admin admin] RBAC: Authorizing `identity:delete_user(user_id=16f7824f071f4ded8335c5ea07828caa)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:13:18.872976 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34e338a-3c76-4fb0-8bd1-304dbca99ded admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:13:18.919435 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-b34e338a-3c76-4fb0-8bd1-304dbca99ded admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16f7824f071f4ded8335c5ea07828caa'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:13:18.926567 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-b34e338a-3c76-4fb0-8bd1-304dbca99ded admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16f7824f071f4ded8335c5ea07828caa'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:13:18.927223 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-b34e338a-3c76-4fb0-8bd1-304dbca99ded admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16f7824f071f4ded8335c5ea07828caa'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:13:18.934227 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-b34e338a-3c76-4fb0-8bd1-304dbca99ded admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16f7824f071f4ded8335c5ea07828caa'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:13:18.946860 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-b34e338a-3c76-4fb0-8bd1-304dbca99ded admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16f7824f071f4ded8335c5ea07828caa'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:13:18.952593 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1227/2515] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Oct 14 13:13:18 2022] DELETE /identity/v3/users/16f7824f071f4ded8335c5ea07828caa => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:13:18.957686 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009c0c02-df57-4766-af52-a30ead68fcb3 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:13:18.958207 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009c0c02-df57-4766-af52-a30ead68fcb3 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:13:18.958329 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009c0c02-df57-4766-af52-a30ead68fcb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:13:18.977055 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-009c0c02-df57-4766-af52-a30ead68fcb3 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:13:18.978291 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-009c0c02-df57-4766-af52-a30ead68fcb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:13:19.036979 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1289/2516] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:13:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:13:19.046779 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34e338a-3c76-4fb0-8bd1-304dbca99ded admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:13:19.048827 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-b34e338a-3c76-4fb0-8bd1-304dbca99ded admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:13:19.090711 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:13:19.107401 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34e338a-3c76-4fb0-8bd1-304dbca99ded admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:13:19.111872 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e9c8e2-7d8a-46c2-aacd-703e67431584 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d483292f3a4794848fcacfba5b107e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:13:19.112471 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e9c8e2-7d8a-46c2-aacd-703e67431584 service neutron] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:13:19.112749 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e9c8e2-7d8a-46c2-aacd-703e67431584 service neutron] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:13:19.113019 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e9c8e2-7d8a-46c2-aacd-703e67431584 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:13:19.122694 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e9c8e2-7d8a-46c2-aacd-703e67431584 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:13:19.124084 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e9c8e2-7d8a-46c2-aacd-703e67431584 service neutron] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:13:19.134012 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1228/2517] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:13:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:13:19.405556 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009c0c02-df57-4766-af52-a30ead68fcb3 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:13:19.407139 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-009c0c02-df57-4766-af52-a30ead68fcb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:13:19.420539 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009c0c02-df57-4766-af52-a30ead68fcb3 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:13:19.426008 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225ec003-3c64-4c4f-857a-94d2bcd1490b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:13:19.426633 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225ec003-3c64-4c4f-857a-94d2bcd1490b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:13:19.426840 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225ec003-3c64-4c4f-857a-94d2bcd1490b admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:13:19.427109 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225ec003-3c64-4c4f-857a-94d2bcd1490b admin admin] PATH_INFO: `/v3/projects/54e54c69671644ffa5d9f2800865151e` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:13:19.428246 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225ec003-3c64-4c4f-857a-94d2bcd1490b admin admin] RBAC: Authorizing `identity:delete_project(project_id=54e54c69671644ffa5d9f2800865151e)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:13:19.430204 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225ec003-3c64-4c4f-857a-94d2bcd1490b admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:13:19.460960 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:13:19.479077 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-225ec003-3c64-4c4f-857a-94d2bcd1490b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54e54c69671644ffa5d9f2800865151e', 'request_id': 'req-225ec003-3c64-4c4f-857a-94d2bcd1490b'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:13:19.484509 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-225ec003-3c64-4c4f-857a-94d2bcd1490b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54e54c69671644ffa5d9f2800865151e', 'request_id': 'req-225ec003-3c64-4c4f-857a-94d2bcd1490b'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:13:19.491842 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-225ec003-3c64-4c4f-857a-94d2bcd1490b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54e54c69671644ffa5d9f2800865151e', 'request_id': 'req-225ec003-3c64-4c4f-857a-94d2bcd1490b'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:13:19.504074 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-225ec003-3c64-4c4f-857a-94d2bcd1490b admin admin] The token cache is being invalidate because project 54e54c69671644ffa5d9f2800865151e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:13:19.504457 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-225ec003-3c64-4c4f-857a-94d2bcd1490b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:13:19.505070 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-225ec003-3c64-4c4f-857a-94d2bcd1490b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:13:19.506594 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1290/2518] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Oct 14 13:13:19 2022] DELETE /identity/v3/projects/54e54c69671644ffa5d9f2800865151e => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:13:19.510660 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e9c8e2-7d8a-46c2-aacd-703e67431584 service neutron] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:13:19.520632 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e9c8e2-7d8a-46c2-aacd-703e67431584 service neutron] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:13:19.575129 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab3b38e-7255-4bf7-b241-2d0a790a4d80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:13:19.575748 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab3b38e-7255-4bf7-b241-2d0a790a4d80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:13:19.576025 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab3b38e-7255-4bf7-b241-2d0a790a4d80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:13:19.576295 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab3b38e-7255-4bf7-b241-2d0a790a4d80 admin admin] PATH_INFO: `/v3/users/ab206f6a6237428aaa0da905f1b6f586` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:13:19.577426 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab3b38e-7255-4bf7-b241-2d0a790a4d80 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab206f6a6237428aaa0da905f1b6f586)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:13:19.579481 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab3b38e-7255-4bf7-b241-2d0a790a4d80 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:13:19.625261 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-9ab3b38e-7255-4bf7-b241-2d0a790a4d80 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab206f6a6237428aaa0da905f1b6f586'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:13:19.632023 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-9ab3b38e-7255-4bf7-b241-2d0a790a4d80 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab206f6a6237428aaa0da905f1b6f586'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:13:19.632676 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-9ab3b38e-7255-4bf7-b241-2d0a790a4d80 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab206f6a6237428aaa0da905f1b6f586'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:13:19.639156 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-9ab3b38e-7255-4bf7-b241-2d0a790a4d80 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab206f6a6237428aaa0da905f1b6f586'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:13:19.650860 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-9ab3b38e-7255-4bf7-b241-2d0a790a4d80 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab206f6a6237428aaa0da905f1b6f586'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:13:19.656480 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1229/2519] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Oct 14 13:13:19 2022] DELETE /identity/v3/users/ab206f6a6237428aaa0da905f1b6f586 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:13:19.924559 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225ec003-3c64-4c4f-857a-94d2bcd1490b admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:13:19.926242 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-225ec003-3c64-4c4f-857a-94d2bcd1490b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:13:19.940014 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225ec003-3c64-4c4f-857a-94d2bcd1490b admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:13:19.996676 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59aa6268-f6f5-4dc5-9fb3-95149774059e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:13:19.997299 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aa6268-f6f5-4dc5-9fb3-95149774059e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:13:19.997567 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aa6268-f6f5-4dc5-9fb3-95149774059e admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:13:19.997837 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aa6268-f6f5-4dc5-9fb3-95149774059e admin admin] PATH_INFO: `/v3/projects/4f706c7b4c8b489eb4e5bb3542314f4e` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:13:19.998978 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59aa6268-f6f5-4dc5-9fb3-95149774059e admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f706c7b4c8b489eb4e5bb3542314f4e)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:13:20.001156 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59aa6268-f6f5-4dc5-9fb3-95149774059e admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:13:20.048434 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-59aa6268-f6f5-4dc5-9fb3-95149774059e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f706c7b4c8b489eb4e5bb3542314f4e', 'request_id': 'req-59aa6268-f6f5-4dc5-9fb3-95149774059e'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:13:20.053699 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-59aa6268-f6f5-4dc5-9fb3-95149774059e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f706c7b4c8b489eb4e5bb3542314f4e', 'request_id': 'req-59aa6268-f6f5-4dc5-9fb3-95149774059e'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:13:20.059760 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-59aa6268-f6f5-4dc5-9fb3-95149774059e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f706c7b4c8b489eb4e5bb3542314f4e', 'request_id': 'req-59aa6268-f6f5-4dc5-9fb3-95149774059e'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:13:20.072534 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-59aa6268-f6f5-4dc5-9fb3-95149774059e admin admin] The token cache is being invalidate because project 4f706c7b4c8b489eb4e5bb3542314f4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:13:20.072818 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-59aa6268-f6f5-4dc5-9fb3-95149774059e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:13:20.073431 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-59aa6268-f6f5-4dc5-9fb3-95149774059e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:13:20.075071 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1291/2520] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Oct 14 13:13:19 2022] DELETE /identity/v3/projects/4f706c7b4c8b489eb4e5bb3542314f4e => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:13:20.080369 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984a3c5d-cf48-4dbc-af48-5b3d96e8175b None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:13:20.080860 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984a3c5d-cf48-4dbc-af48-5b3d96e8175b None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:13:20.080967 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984a3c5d-cf48-4dbc-af48-5b3d96e8175b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:13:20.101509 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-984a3c5d-cf48-4dbc-af48-5b3d96e8175b None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:13:20.102738 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-984a3c5d-cf48-4dbc-af48-5b3d96e8175b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:13:20.152515 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:13:20.161843 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1230/2521] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:13:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 13:13:20.169512 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0fa62f-eb13-484b-ba19-5b7aea7b656b None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:13:20.169725 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0fa62f-eb13-484b-ba19-5b7aea7b656b None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:13:20.169999 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0fa62f-eb13-484b-ba19-5b7aea7b656b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:13:20.190418 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-ea0fa62f-eb13-484b-ba19-5b7aea7b656b None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:13:20.191602 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-ea0fa62f-eb13-484b-ba19-5b7aea7b656b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:13:20.199200 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1292/2522] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:13:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:13:20.203426 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984a3c5d-cf48-4dbc-af48-5b3d96e8175b None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:13:20.213510 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984a3c5d-cf48-4dbc-af48-5b3d96e8175b None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:13:20.218099 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9776bdf-0f75-41b7-b648-db2f40c46a2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:13:20.218717 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9776bdf-0f75-41b7-b648-db2f40c46a2d admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:13:20.219010 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9776bdf-0f75-41b7-b648-db2f40c46a2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:13:20.219758 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9776bdf-0f75-41b7-b648-db2f40c46a2d admin admin] PATH_INFO: `/v3/domains` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:13:20.220587 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9776bdf-0f75-41b7-b648-db2f40c46a2d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 13:13:20.220899 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9776bdf-0f75-41b7-b648-db2f40c46a2d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:13:20.222561 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9776bdf-0f75-41b7-b648-db2f40c46a2d admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:13:20.233883 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1231/2523] 10.222.0.17 () {58 vars in 1153 bytes} [Fri Oct 14 13:13:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 13:13:20.238905 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0fa62f-eb13-484b-ba19-5b7aea7b656b None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:13:20.247975 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0fa62f-eb13-484b-ba19-5b7aea7b656b None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:13:20.252666 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6cab3a-d136-45c6-ac55-7e77ad0e708e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:13:20.253246 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6cab3a-d136-45c6-ac55-7e77ad0e708e admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:13:20.253523 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6cab3a-d136-45c6-ac55-7e77ad0e708e admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:13:20.253794 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6cab3a-d136-45c6-ac55-7e77ad0e708e admin admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:13:20.254453 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6cab3a-d136-45c6-ac55-7e77ad0e708e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:13:20.256332 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6cab3a-d136-45c6-ac55-7e77ad0e708e admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:13:20.283159 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1293/2524] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Oct 14 13:13:20 2022] POST /identity/v3/projects => generated 373 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:13:20.287279 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9776bdf-0f75-41b7-b648-db2f40c46a2d admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:13:20.297276 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9776bdf-0f75-41b7-b648-db2f40c46a2d admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:13:20.354202 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f94e75-11bb-4df4-b98d-e5a9cd8f0e63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:13:20.354806 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f94e75-11bb-4df4-b98d-e5a9cd8f0e63 admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:13:20.355089 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f94e75-11bb-4df4-b98d-e5a9cd8f0e63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:13:20.355366 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f94e75-11bb-4df4-b98d-e5a9cd8f0e63 admin admin] PATH_INFO: `/v3/users` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:13:20.355994 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f94e75-11bb-4df4-b98d-e5a9cd8f0e63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:13:20.357918 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f94e75-11bb-4df4-b98d-e5a9cd8f0e63 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:13:20.379126 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1232/2525] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Oct 14 13:13:20 2022] POST /identity/v3/users => generated 287 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:13:20.383207 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6cab3a-d136-45c6-ac55-7e77ad0e708e admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:13:20.393684 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6cab3a-d136-45c6-ac55-7e77ad0e708e admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:13:20.398339 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a956a81e-05f1-4a9c-9f18-269b7139b609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:13:20.398933 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a956a81e-05f1-4a9c-9f18-269b7139b609 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:13:20.399213 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a956a81e-05f1-4a9c-9f18-269b7139b609 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:13:20.399485 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a956a81e-05f1-4a9c-9f18-269b7139b609 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:13:20.400129 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a956a81e-05f1-4a9c-9f18-269b7139b609 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:13:20.401714 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a956a81e-05f1-4a9c-9f18-269b7139b609 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:13:20.412193 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1294/2526] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:13:20 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:13:20.415909 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f94e75-11bb-4df4-b98d-e5a9cd8f0e63 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:13:20.428722 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f94e75-11bb-4df4-b98d-e5a9cd8f0e63 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:13:20.433848 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff90951-b6a4-4699-b7aa-deabb43ee130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:13:20.434476 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff90951-b6a4-4699-b7aa-deabb43ee130 admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:13:20.434757 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff90951-b6a4-4699-b7aa-deabb43ee130 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:13:20.435025 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff90951-b6a4-4699-b7aa-deabb43ee130 admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:13:20.435663 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff90951-b6a4-4699-b7aa-deabb43ee130 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:13:20.437251 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff90951-b6a4-4699-b7aa-deabb43ee130 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:13:20.448993 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1233/2527] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:13:20 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:13:20.453151 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a956a81e-05f1-4a9c-9f18-269b7139b609 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:13:20.460033 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:13:20.464093 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a956a81e-05f1-4a9c-9f18-269b7139b609 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:13:20.471139 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19252362-b8db-4677-a106-4a0836446cce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:13:20.471865 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19252362-b8db-4677-a106-4a0836446cce admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:13:20.472369 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19252362-b8db-4677-a106-4a0836446cce admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:13:20.472653 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19252362-b8db-4677-a106-4a0836446cce admin admin] PATH_INFO: `/v3/projects/8938bb7f6bbc4f44854a4b8aad413ac6/users/16b77d4fa143408498e25bb9fd05a128/roles/5e8849303a75425b9eaa2681cc031af1` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:13:20.487882 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19252362-b8db-4677-a106-4a0836446cce admin admin] RBAC: Authorizing `identity:create_grant(project_id=8938bb7f6bbc4f44854a4b8aad413ac6, user_id=16b77d4fa143408498e25bb9fd05a128, role_id=5e8849303a75425b9eaa2681cc031af1)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:13:20.490583 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19252362-b8db-4677-a106-4a0836446cce admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:13:20.503106 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1295/2528] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Oct 14 13:13:20 2022] PUT /identity/v3/projects/8938bb7f6bbc4f44854a4b8aad413ac6/users/16b77d4fa143408498e25bb9fd05a128/roles/5e8849303a75425b9eaa2681cc031af1 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:13:20.513427 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed0a4e1-5f02-49a9-9478-f99893db96fc None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:13:20.513713 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed0a4e1-5f02-49a9-9478-f99893db96fc None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:13:20.513985 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed0a4e1-5f02-49a9-9478-f99893db96fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:13:20.541453 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-0ed0a4e1-5f02-49a9-9478-f99893db96fc None None] MFA Rules not processed for user `16b77d4fa143408498e25bb9fd05a128`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:13:20.542682 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-0ed0a4e1-5f02-49a9-9478-f99893db96fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:13:20.604757 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1234/2529] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:13:20 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:13:20.615896 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19252362-b8db-4677-a106-4a0836446cce admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:13:20.617583 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-19252362-b8db-4677-a106-4a0836446cce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:13:20.674871 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19252362-b8db-4677-a106-4a0836446cce admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:13:20.678502 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf23d44-0c17-4227-b662-cf1ae160180e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c3c564b8c548e4beef1cbfba2ad343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:13:20.679170 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf23d44-0c17-4227-b662-cf1ae160180e service cinder] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:13:20.679394 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf23d44-0c17-4227-b662-cf1ae160180e service cinder] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:13:20.679662 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf23d44-0c17-4227-b662-cf1ae160180e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:13:20.688141 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf23d44-0c17-4227-b662-cf1ae160180e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:13:20.689828 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf23d44-0c17-4227-b662-cf1ae160180e service cinder] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:13:20.698634 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1296/2530] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:13:20 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:13:20.722480 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed0a4e1-5f02-49a9-9478-f99893db96fc None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:13:20.778325 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:13:20.785471 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed0a4e1-5f02-49a9-9478-f99893db96fc None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:13:20.790153 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9480f1-dbf4-4fe0-aa47-d7cc5bc49f48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:13:20.790775 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9480f1-dbf4-4fe0-aa47-d7cc5bc49f48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:13:20.791049 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9480f1-dbf4-4fe0-aa47-d7cc5bc49f48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:13:20.791319 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9480f1-dbf4-4fe0-aa47-d7cc5bc49f48 admin admin] PATH_INFO: `/v3/users/16b77d4fa143408498e25bb9fd05a128` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:13:20.792436 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9480f1-dbf4-4fe0-aa47-d7cc5bc49f48 admin admin] RBAC: Authorizing `identity:delete_user(user_id=16b77d4fa143408498e25bb9fd05a128)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:13:20.794375 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9480f1-dbf4-4fe0-aa47-d7cc5bc49f48 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:13:20.839270 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-5a9480f1-dbf4-4fe0-aa47-d7cc5bc49f48 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16b77d4fa143408498e25bb9fd05a128'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:13:20.846731 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-5a9480f1-dbf4-4fe0-aa47-d7cc5bc49f48 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16b77d4fa143408498e25bb9fd05a128'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:13:20.847432 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-5a9480f1-dbf4-4fe0-aa47-d7cc5bc49f48 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16b77d4fa143408498e25bb9fd05a128'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:13:20.854714 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-5a9480f1-dbf4-4fe0-aa47-d7cc5bc49f48 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16b77d4fa143408498e25bb9fd05a128'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:13:20.866570 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-5a9480f1-dbf4-4fe0-aa47-d7cc5bc49f48 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16b77d4fa143408498e25bb9fd05a128'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:13:20.872412 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1235/2531] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Oct 14 13:13:20 2022] DELETE /identity/v3/users/16b77d4fa143408498e25bb9fd05a128 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:13:20.876973 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbc66a1-46dd-4f33-a87d-492ad0a3657b None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:13:20.877261 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbc66a1-46dd-4f33-a87d-492ad0a3657b None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:13:20.877543 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbc66a1-46dd-4f33-a87d-492ad0a3657b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:13:20.897612 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-acbc66a1-46dd-4f33-a87d-492ad0a3657b None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:13:20.898857 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-acbc66a1-46dd-4f33-a87d-492ad0a3657b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:13:20.956862 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1297/2532] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:13:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:13:20.966606 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9480f1-dbf4-4fe0-aa47-d7cc5bc49f48 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:13:20.967988 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-5a9480f1-dbf4-4fe0-aa47-d7cc5bc49f48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:13:21.026348 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9480f1-dbf4-4fe0-aa47-d7cc5bc49f48 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:13:21.029993 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b04ae33-a403-4b7f-8b69-b183d8078492 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d483292f3a4794848fcacfba5b107e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:13:21.030619 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b04ae33-a403-4b7f-8b69-b183d8078492 service neutron] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:13:21.030894 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b04ae33-a403-4b7f-8b69-b183d8078492 service neutron] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:13:21.031161 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b04ae33-a403-4b7f-8b69-b183d8078492 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:13:21.040713 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b04ae33-a403-4b7f-8b69-b183d8078492 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:13:21.042160 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b04ae33-a403-4b7f-8b69-b183d8078492 service neutron] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:13:21.052049 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1236/2533] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:13:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 14 13:13:21.323648 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbc66a1-46dd-4f33-a87d-492ad0a3657b None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:13:21.326310 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-acbc66a1-46dd-4f33-a87d-492ad0a3657b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:13:21.354241 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbc66a1-46dd-4f33-a87d-492ad0a3657b None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:13:21.359589 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9426bad7-c94f-4352-a218-825448a47d6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:13:21.360220 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9426bad7-c94f-4352-a218-825448a47d6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:13:21.360708 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9426bad7-c94f-4352-a218-825448a47d6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:13:21.361124 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9426bad7-c94f-4352-a218-825448a47d6f admin admin] PATH_INFO: `/v3/projects/8938bb7f6bbc4f44854a4b8aad413ac6` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:13:21.362315 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9426bad7-c94f-4352-a218-825448a47d6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=8938bb7f6bbc4f44854a4b8aad413ac6)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:13:21.364233 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9426bad7-c94f-4352-a218-825448a47d6f admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:13:21.411505 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-9426bad7-c94f-4352-a218-825448a47d6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8938bb7f6bbc4f44854a4b8aad413ac6', 'request_id': 'req-9426bad7-c94f-4352-a218-825448a47d6f'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:13:21.417179 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-9426bad7-c94f-4352-a218-825448a47d6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8938bb7f6bbc4f44854a4b8aad413ac6', 'request_id': 'req-9426bad7-c94f-4352-a218-825448a47d6f'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:13:21.423505 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-9426bad7-c94f-4352-a218-825448a47d6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8938bb7f6bbc4f44854a4b8aad413ac6', 'request_id': 'req-9426bad7-c94f-4352-a218-825448a47d6f'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:13:21.435276 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-9426bad7-c94f-4352-a218-825448a47d6f admin admin] The token cache is being invalidate because project 8938bb7f6bbc4f44854a4b8aad413ac6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:13:21.435565 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-9426bad7-c94f-4352-a218-825448a47d6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:13:21.436246 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-9426bad7-c94f-4352-a218-825448a47d6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:13:21.437762 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1298/2534] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Oct 14 13:13:21 2022] DELETE /identity/v3/projects/8938bb7f6bbc4f44854a4b8aad413ac6 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:13:21.442986 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9ae0e9-fa7e-4118-b1b3-a0b35a30cb6b None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:13:21.443450 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9ae0e9-fa7e-4118-b1b3-a0b35a30cb6b None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:13:21.443567 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9ae0e9-fa7e-4118-b1b3-a0b35a30cb6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:13:21.463620 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-1a9ae0e9-fa7e-4118-b1b3-a0b35a30cb6b None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:13:21.464827 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-1a9ae0e9-fa7e-4118-b1b3-a0b35a30cb6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:13:21.522052 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1237/2535] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:13:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:13:21.530797 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507f1795-c5df-4a40-bdcd-1b94d8d16e3b None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:13:21.531084 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507f1795-c5df-4a40-bdcd-1b94d8d16e3b None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:13:21.531387 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507f1795-c5df-4a40-bdcd-1b94d8d16e3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:13:21.546740 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:13:21.553148 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-507f1795-c5df-4a40-bdcd-1b94d8d16e3b None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:13:21.554894 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-507f1795-c5df-4a40-bdcd-1b94d8d16e3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:13:21.564213 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1299/2536] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:13:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:13:21.568379 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9ae0e9-fa7e-4118-b1b3-a0b35a30cb6b None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:13:21.577966 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9ae0e9-fa7e-4118-b1b3-a0b35a30cb6b None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:13:21.582622 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61a1b62-95d5-4e83-809b-0ae14f5adcbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:13:21.583213 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61a1b62-95d5-4e83-809b-0ae14f5adcbb admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:13:21.583496 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61a1b62-95d5-4e83-809b-0ae14f5adcbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:13:21.583771 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61a1b62-95d5-4e83-809b-0ae14f5adcbb admin admin] PATH_INFO: `/v3/domains` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:13:21.584415 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61a1b62-95d5-4e83-809b-0ae14f5adcbb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 13:13:21.584721 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61a1b62-95d5-4e83-809b-0ae14f5adcbb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:13:21.586337 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61a1b62-95d5-4e83-809b-0ae14f5adcbb admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:13:21.597778 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1238/2537] 10.222.0.17 () {58 vars in 1153 bytes} [Fri Oct 14 13:13:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 13:13:21.601981 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507f1795-c5df-4a40-bdcd-1b94d8d16e3b None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:13:21.611773 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507f1795-c5df-4a40-bdcd-1b94d8d16e3b None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:13:21.616531 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d31d72b-cc80-40e9-9c87-fbcfb1526ee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:13:21.617120 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d31d72b-cc80-40e9-9c87-fbcfb1526ee4 admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:13:21.617400 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d31d72b-cc80-40e9-9c87-fbcfb1526ee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:13:21.617672 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d31d72b-cc80-40e9-9c87-fbcfb1526ee4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:13:21.618354 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d31d72b-cc80-40e9-9c87-fbcfb1526ee4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:13:21.620234 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d31d72b-cc80-40e9-9c87-fbcfb1526ee4 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:13:21.647709 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1300/2538] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Oct 14 13:13:21 2022] POST /identity/v3/projects => generated 381 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:13:21.651977 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61a1b62-95d5-4e83-809b-0ae14f5adcbb admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:13:21.658565 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:13:21.662599 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61a1b62-95d5-4e83-809b-0ae14f5adcbb admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:13:21.721082 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559a386b-5408-4d4f-9aef-a1966cab4215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:13:21.721690 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559a386b-5408-4d4f-9aef-a1966cab4215 admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:13:21.721972 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559a386b-5408-4d4f-9aef-a1966cab4215 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:13:21.722351 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559a386b-5408-4d4f-9aef-a1966cab4215 admin admin] PATH_INFO: `/v3/users` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:13:21.722999 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559a386b-5408-4d4f-9aef-a1966cab4215 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:13:21.724922 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559a386b-5408-4d4f-9aef-a1966cab4215 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:13:21.746392 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1239/2539] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Oct 14 13:13:21 2022] POST /identity/v3/users => generated 291 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:13:21.750711 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d31d72b-cc80-40e9-9c87-fbcfb1526ee4 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:13:21.761373 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d31d72b-cc80-40e9-9c87-fbcfb1526ee4 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:13:21.766022 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30983b9-d49b-4c91-826b-4d08f02e255d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:13:21.766684 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30983b9-d49b-4c91-826b-4d08f02e255d admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:13:21.766964 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30983b9-d49b-4c91-826b-4d08f02e255d admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:13:21.767241 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30983b9-d49b-4c91-826b-4d08f02e255d admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:13:21.767882 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30983b9-d49b-4c91-826b-4d08f02e255d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:13:21.769478 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30983b9-d49b-4c91-826b-4d08f02e255d admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:13:21.779303 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1301/2540] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:13:21 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:13:21.784024 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559a386b-5408-4d4f-9aef-a1966cab4215 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:13:21.793748 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559a386b-5408-4d4f-9aef-a1966cab4215 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:13:21.799143 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a035baa-3b8f-451c-8033-83b672eef1e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:13:21.799725 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a035baa-3b8f-451c-8033-83b672eef1e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:13:21.800001 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a035baa-3b8f-451c-8033-83b672eef1e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:13:21.800273 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a035baa-3b8f-451c-8033-83b672eef1e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:13:21.800900 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a035baa-3b8f-451c-8033-83b672eef1e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:13:21.802543 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a035baa-3b8f-451c-8033-83b672eef1e4 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:13:21.813082 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1240/2541] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:13:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:13:21.817385 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30983b9-d49b-4c91-826b-4d08f02e255d admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:13:21.827467 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30983b9-d49b-4c91-826b-4d08f02e255d admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:13:21.832337 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6768ce-09ae-46aa-bf9a-40f473f5b1a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:13:21.832980 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6768ce-09ae-46aa-bf9a-40f473f5b1a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:13:21.833257 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6768ce-09ae-46aa-bf9a-40f473f5b1a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:13:21.833531 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6768ce-09ae-46aa-bf9a-40f473f5b1a1 admin admin] PATH_INFO: `/v3/projects/5cf4e5ac43604d44b47bdf49b6bccea8/users/1a3035f711f7481ebef079d85f3450f3/roles/5e8849303a75425b9eaa2681cc031af1` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:13:21.848637 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6768ce-09ae-46aa-bf9a-40f473f5b1a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5cf4e5ac43604d44b47bdf49b6bccea8, user_id=1a3035f711f7481ebef079d85f3450f3, role_id=5e8849303a75425b9eaa2681cc031af1)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:13:21.851319 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6768ce-09ae-46aa-bf9a-40f473f5b1a1 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:13:21.864758 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1302/2542] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Oct 14 13:13:21 2022] PUT /identity/v3/projects/5cf4e5ac43604d44b47bdf49b6bccea8/users/1a3035f711f7481ebef079d85f3450f3/roles/5e8849303a75425b9eaa2681cc031af1 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:13:21.869642 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c779567-14ec-4295-935f-d411a76ed391 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:13:21.869929 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c779567-14ec-4295-935f-d411a76ed391 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:13:21.870235 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c779567-14ec-4295-935f-d411a76ed391 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:13:21.888701 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-2c779567-14ec-4295-935f-d411a76ed391 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:13:21.889891 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-2c779567-14ec-4295-935f-d411a76ed391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:13:21.948253 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1241/2543] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:13:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:13:21.958103 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6768ce-09ae-46aa-bf9a-40f473f5b1a1 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:13:21.959829 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-0a6768ce-09ae-46aa-bf9a-40f473f5b1a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:13:22.017414 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6768ce-09ae-46aa-bf9a-40f473f5b1a1 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:13:22.021025 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10cbc0a-5ea4-4900-a5fd-6464b0cf7f2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d483292f3a4794848fcacfba5b107e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:13:22.021617 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10cbc0a-5ea4-4900-a5fd-6464b0cf7f2b service neutron] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:13:22.021891 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10cbc0a-5ea4-4900-a5fd-6464b0cf7f2b service neutron] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:13:22.022191 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10cbc0a-5ea4-4900-a5fd-6464b0cf7f2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:13:22.030967 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10cbc0a-5ea4-4900-a5fd-6464b0cf7f2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:13:22.033271 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10cbc0a-5ea4-4900-a5fd-6464b0cf7f2b service neutron] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:13:22.042841 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1303/2544] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:13:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:13:22.718373 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6d39f1-6436-47ba-b15e-68b172f1644b None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:13:22.718922 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6d39f1-6436-47ba-b15e-68b172f1644b None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:13:22.718922 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6d39f1-6436-47ba-b15e-68b172f1644b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:13:22.747974 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-8f6d39f1-6436-47ba-b15e-68b172f1644b None None] MFA Rules not processed for user `1a3035f711f7481ebef079d85f3450f3`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:13:22.749337 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-8f6d39f1-6436-47ba-b15e-68b172f1644b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:13:22.819844 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1242/2545] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:13:22 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:13:22.831202 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10cbc0a-5ea4-4900-a5fd-6464b0cf7f2b service neutron] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:13:22.832600 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-e10cbc0a-5ea4-4900-a5fd-6464b0cf7f2b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:13:22.890523 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10cbc0a-5ea4-4900-a5fd-6464b0cf7f2b service neutron] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:13:22.895172 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e052f34a-abd6-45fd-8502-304d9e71c866 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c3c564b8c548e4beef1cbfba2ad343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:13:22.895769 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e052f34a-abd6-45fd-8502-304d9e71c866 service cinder] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:13:22.896047 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e052f34a-abd6-45fd-8502-304d9e71c866 service cinder] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:13:22.896318 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e052f34a-abd6-45fd-8502-304d9e71c866 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:13:22.904396 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e052f34a-abd6-45fd-8502-304d9e71c866 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:13:22.905829 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e052f34a-abd6-45fd-8502-304d9e71c866 service cinder] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:13:22.915621 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1304/2546] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:13:22 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:13:24.275823 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21225f7b-6a97-4191-8711-a68402950aae None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:13:24.276340 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21225f7b-6a97-4191-8711-a68402950aae None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:13:24.276340 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21225f7b-6a97-4191-8711-a68402950aae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:13:24.295386 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-21225f7b-6a97-4191-8711-a68402950aae None None] MFA Rules not processed for user `1a3035f711f7481ebef079d85f3450f3`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:13:24.296503 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-21225f7b-6a97-4191-8711-a68402950aae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:13:24.303927 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1243/2547] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:13:24 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:13:24.548889 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e052f34a-abd6-45fd-8502-304d9e71c866 service cinder] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:13:24.550341 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-e052f34a-abd6-45fd-8502-304d9e71c866 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:13:24.562310 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e052f34a-abd6-45fd-8502-304d9e71c866 service cinder] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:13:24.566461 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ed3afa-9372-4997-811e-f04bf38625e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d483292f3a4794848fcacfba5b107e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:13:24.567045 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ed3afa-9372-4997-811e-f04bf38625e0 service neutron] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:13:24.567318 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ed3afa-9372-4997-811e-f04bf38625e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:13:24.567584 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ed3afa-9372-4997-811e-f04bf38625e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:13:24.569244 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-76ed3afa-9372-4997-811e-f04bf38625e0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:13:24.579025 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ed3afa-9372-4997-811e-f04bf38625e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:13:24.580538 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ed3afa-9372-4997-811e-f04bf38625e0 service neutron] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:13:24.588568 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1305/2548] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:13:24 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:13:24.910869 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21225f7b-6a97-4191-8711-a68402950aae None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:13:24.912290 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-21225f7b-6a97-4191-8711-a68402950aae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:13:24.923349 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:13:24.990594 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21225f7b-6a97-4191-8711-a68402950aae None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:13:24.995600 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2611de-c64b-4e7d-a13e-98cbd940afd7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a5e5c35ed8b4abc877ba8d8c490dacd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:13:24.996207 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2611de-c64b-4e7d-a13e-98cbd940afd7 service placement] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:13:24.996490 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2611de-c64b-4e7d-a13e-98cbd940afd7 service placement] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:13:24.996764 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2611de-c64b-4e7d-a13e-98cbd940afd7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:13:24.998504 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-9d2611de-c64b-4e7d-a13e-98cbd940afd7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:13:25.010265 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2611de-c64b-4e7d-a13e-98cbd940afd7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:13:25.011848 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2611de-c64b-4e7d-a13e-98cbd940afd7 service placement] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:13:25.021924 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1244/2549] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:13:24 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:13:34.110278 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ed3afa-9372-4997-811e-f04bf38625e0 service neutron] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:13:34.112001 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-76ed3afa-9372-4997-811e-f04bf38625e0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:13:34.154052 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:13:34.198547 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ed3afa-9372-4997-811e-f04bf38625e0 service neutron] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:13:34.204040 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bbcdd4-cdfd-4c58-9d39-6010efa3c930 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '931f4e32c8764514b5efed31b0785be7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:13:34.205176 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bbcdd4-cdfd-4c58-9d39-6010efa3c930 service nova] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:13:34.205457 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bbcdd4-cdfd-4c58-9d39-6010efa3c930 service nova] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:13:34.205726 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bbcdd4-cdfd-4c58-9d39-6010efa3c930 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:13:34.207469 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-c5bbcdd4-cdfd-4c58-9d39-6010efa3c930 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:13:34.220515 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bbcdd4-cdfd-4c58-9d39-6010efa3c930 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:13:34.221828 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bbcdd4-cdfd-4c58-9d39-6010efa3c930 service nova] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:13:34.232620 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1306/2550] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:13:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:13:35.017619 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=29 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:13:44.227979 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=18 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:13:55.840196 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a13019-6cfe-45b4-938b-233d3934bedd None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:13:55.840745 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a13019-6cfe-45b4-938b-233d3934bedd None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:13:55.840745 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a13019-6cfe-45b4-938b-233d3934bedd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:13:55.860689 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-07a13019-6cfe-45b4-938b-233d3934bedd None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:13:55.861984 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-07a13019-6cfe-45b4-938b-233d3934bedd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:13:55.869821 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1245/2551] 10.222.0.33 () {58 vars in 1016 bytes} [Fri Oct 14 13:13:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:13:55.885888 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bbcdd4-cdfd-4c58-9d39-6010efa3c930 service nova] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:13:55.897886 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bbcdd4-cdfd-4c58-9d39-6010efa3c930 service nova] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:13:55.903319 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abe985a-355c-4e54-a604-8d536f6b72ef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '931f4e32c8764514b5efed31b0785be7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:13:55.903951 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abe985a-355c-4e54-a604-8d536f6b72ef service nova] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:13:55.904230 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abe985a-355c-4e54-a604-8d536f6b72ef service nova] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:13:55.904530 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abe985a-355c-4e54-a604-8d536f6b72ef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:13:55.913284 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abe985a-355c-4e54-a604-8d536f6b72ef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:13:55.914916 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abe985a-355c-4e54-a604-8d536f6b72ef service nova] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:13:55.924218 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1307/2552] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:13:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:13:58.911556 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2956e1dd-d2c3-4ce8-8ec6-e460b5693217 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:13:58.912150 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2956e1dd-d2c3-4ce8-8ec6-e460b5693217 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:13:58.912150 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2956e1dd-d2c3-4ce8-8ec6-e460b5693217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:13:58.932244 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-2956e1dd-d2c3-4ce8-8ec6-e460b5693217 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:13:58.933442 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-2956e1dd-d2c3-4ce8-8ec6-e460b5693217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:13:58.942238 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1246/2553] 10.222.0.33 () {58 vars in 1016 bytes} [Fri Oct 14 13:13:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 13:13:58.967633 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abe985a-355c-4e54-a604-8d536f6b72ef service nova] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:13:58.969136 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-1abe985a-355c-4e54-a604-8d536f6b72ef service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:13:58.984640 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abe985a-355c-4e54-a604-8d536f6b72ef service nova] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:13:58.991264 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935f9276-1007-4787-a2c3-49d8c1681c21 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '931f4e32c8764514b5efed31b0785be7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:13:58.991852 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935f9276-1007-4787-a2c3-49d8c1681c21 service nova] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:13:58.992126 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935f9276-1007-4787-a2c3-49d8c1681c21 service nova] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:13:58.992395 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935f9276-1007-4787-a2c3-49d8c1681c21 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:13:59.000428 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935f9276-1007-4787-a2c3-49d8c1681c21 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:13:59.001978 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935f9276-1007-4787-a2c3-49d8c1681c21 service nova] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:13:59.011947 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1308/2554] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:13:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:14:02.168904 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c29f719-538d-4a7e-a7e3-8a496075e6b8 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:14:02.169398 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c29f719-538d-4a7e-a7e3-8a496075e6b8 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:14:02.169398 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c29f719-538d-4a7e-a7e3-8a496075e6b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:14:02.188460 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-4c29f719-538d-4a7e-a7e3-8a496075e6b8 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:14:02.190160 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-4c29f719-538d-4a7e-a7e3-8a496075e6b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:14:02.198068 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1247/2555] 10.222.0.33 () {58 vars in 1016 bytes} [Fri Oct 14 13:14:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:14:02.213327 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935f9276-1007-4787-a2c3-49d8c1681c21 service nova] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:14:02.224991 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935f9276-1007-4787-a2c3-49d8c1681c21 service nova] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:14:02.230782 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edae027f-be31-4674-92be-ad69cfab8dc3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '931f4e32c8764514b5efed31b0785be7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:14:02.231392 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edae027f-be31-4674-92be-ad69cfab8dc3 service nova] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:14:02.231704 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edae027f-be31-4674-92be-ad69cfab8dc3 service nova] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:14:02.232014 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edae027f-be31-4674-92be-ad69cfab8dc3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:14:02.240752 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edae027f-be31-4674-92be-ad69cfab8dc3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:14:02.242357 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edae027f-be31-4674-92be-ad69cfab8dc3 service nova] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:14:02.251720 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1309/2556] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:14:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:14:05.272150 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b83681-d981-4399-8982-85eb3ee5a8e7 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:14:05.272668 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b83681-d981-4399-8982-85eb3ee5a8e7 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:14:05.272775 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b83681-d981-4399-8982-85eb3ee5a8e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:14:05.292526 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-60b83681-d981-4399-8982-85eb3ee5a8e7 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:14:05.293717 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-60b83681-d981-4399-8982-85eb3ee5a8e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:14:05.302113 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1248/2557] 10.222.0.33 () {58 vars in 1016 bytes} [Fri Oct 14 13:14:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:14:05.317242 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edae027f-be31-4674-92be-ad69cfab8dc3 service nova] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:14:05.328592 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edae027f-be31-4674-92be-ad69cfab8dc3 service nova] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:14:05.334909 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47b7fff-a887-416c-91d1-ca13227e8938 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '931f4e32c8764514b5efed31b0785be7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:14:05.335501 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47b7fff-a887-416c-91d1-ca13227e8938 service nova] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:14:05.335779 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47b7fff-a887-416c-91d1-ca13227e8938 service nova] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:14:05.336056 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47b7fff-a887-416c-91d1-ca13227e8938 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:14:05.344447 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47b7fff-a887-416c-91d1-ca13227e8938 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:14:05.346030 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47b7fff-a887-416c-91d1-ca13227e8938 service nova] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:14:05.355541 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1310/2558] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:14:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:14:08.418686 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2fdb7b-1261-4973-a1fc-11203f773384 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:14:08.419279 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2fdb7b-1261-4973-a1fc-11203f773384 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:14:08.419279 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2fdb7b-1261-4973-a1fc-11203f773384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:14:08.438627 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-8a2fdb7b-1261-4973-a1fc-11203f773384 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:14:08.439809 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-8a2fdb7b-1261-4973-a1fc-11203f773384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:14:08.448262 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1249/2559] 10.222.0.33 () {58 vars in 1016 bytes} [Fri Oct 14 13:14:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:14:08.465560 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47b7fff-a887-416c-91d1-ca13227e8938 service nova] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:14:08.476751 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47b7fff-a887-416c-91d1-ca13227e8938 service nova] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:14:08.482281 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e5e06b-c683-48e1-89d7-c534d8e6eea8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '931f4e32c8764514b5efed31b0785be7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:14:08.482859 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e5e06b-c683-48e1-89d7-c534d8e6eea8 service nova] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:14:08.483134 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e5e06b-c683-48e1-89d7-c534d8e6eea8 service nova] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:14:08.483404 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e5e06b-c683-48e1-89d7-c534d8e6eea8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:14:08.491936 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e5e06b-c683-48e1-89d7-c534d8e6eea8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:14:08.493494 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e5e06b-c683-48e1-89d7-c534d8e6eea8 service nova] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:14:08.502669 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1311/2560] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:14:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:14:11.568515 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301125db-4d50-4959-a83b-011c162e79c2 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:14:11.569030 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301125db-4d50-4959-a83b-011c162e79c2 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:14:11.569133 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301125db-4d50-4959-a83b-011c162e79c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:14:11.588877 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-301125db-4d50-4959-a83b-011c162e79c2 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:14:11.590073 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-301125db-4d50-4959-a83b-011c162e79c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:14:11.598323 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1250/2561] 10.222.0.33 () {58 vars in 1016 bytes} [Fri Oct 14 13:14:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:14:11.614258 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e5e06b-c683-48e1-89d7-c534d8e6eea8 service nova] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:14:11.625437 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e5e06b-c683-48e1-89d7-c534d8e6eea8 service nova] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:14:11.631618 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0742df-9e4d-4da0-9c0f-ed547740cf50 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '931f4e32c8764514b5efed31b0785be7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:14:11.632202 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0742df-9e4d-4da0-9c0f-ed547740cf50 service nova] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:14:11.632481 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0742df-9e4d-4da0-9c0f-ed547740cf50 service nova] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:14:11.632751 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0742df-9e4d-4da0-9c0f-ed547740cf50 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:14:11.640738 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0742df-9e4d-4da0-9c0f-ed547740cf50 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:14:11.642338 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0742df-9e4d-4da0-9c0f-ed547740cf50 service nova] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:14:11.651485 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1312/2562] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:14:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:14:21.583782 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=18 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:14:21.647420 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=36 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:14:21.690227 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301125db-4d50-4959-a83b-011c162e79c2 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:14:21.691741 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-301125db-4d50-4959-a83b-011c162e79c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:14:21.706795 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301125db-4d50-4959-a83b-011c162e79c2 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:14:21.711665 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa7ee5e-b08e-4d7d-b6a3-64660004bbf4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a5e5c35ed8b4abc877ba8d8c490dacd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:14:21.712535 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa7ee5e-b08e-4d7d-b6a3-64660004bbf4 service placement] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:14:21.712811 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa7ee5e-b08e-4d7d-b6a3-64660004bbf4 service placement] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:14:21.713080 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa7ee5e-b08e-4d7d-b6a3-64660004bbf4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:14:21.714862 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-4aa7ee5e-b08e-4d7d-b6a3-64660004bbf4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:14:21.727129 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa7ee5e-b08e-4d7d-b6a3-64660004bbf4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:14:21.728706 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa7ee5e-b08e-4d7d-b6a3-64660004bbf4 service placement] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:14:21.738671 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1251/2563] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:14:21 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:14:26.750695 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101f7dc5-713c-4bef-9659-db054230c90b None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:14:26.751244 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101f7dc5-713c-4bef-9659-db054230c90b None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:14:26.751417 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101f7dc5-713c-4bef-9659-db054230c90b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:14:26.770154 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-101f7dc5-713c-4bef-9659-db054230c90b None None] MFA Rules not processed for user `1a3035f711f7481ebef079d85f3450f3`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:14:26.771345 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-101f7dc5-713c-4bef-9659-db054230c90b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:14:26.778221 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1313/2564] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:14:26 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:14:31.734168 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=6 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:14:36.765302 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=3 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:14:45.089238 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eded6543-2ae1-4ed9-bf4d-801ca8ec81dc None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:14:45.089799 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eded6543-2ae1-4ed9-bf4d-801ca8ec81dc None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:14:45.089919 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eded6543-2ae1-4ed9-bf4d-801ca8ec81dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:14:45.109605 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-eded6543-2ae1-4ed9-bf4d-801ca8ec81dc None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:14:45.111434 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-eded6543-2ae1-4ed9-bf4d-801ca8ec81dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:14:45.121073 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1252/2565] 10.222.0.33 () {58 vars in 1016 bytes} [Fri Oct 14 13:14:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:14:45.134512 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101f7dc5-713c-4bef-9659-db054230c90b None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:14:45.147813 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101f7dc5-713c-4bef-9659-db054230c90b None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:14:45.153374 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c9bf1f-ae34-4351-94dd-b86209e75b3f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '931f4e32c8764514b5efed31b0785be7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:14:45.153955 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c9bf1f-ae34-4351-94dd-b86209e75b3f service nova] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:14:45.154278 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c9bf1f-ae34-4351-94dd-b86209e75b3f service nova] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:14:45.154552 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c9bf1f-ae34-4351-94dd-b86209e75b3f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:14:45.163299 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c9bf1f-ae34-4351-94dd-b86209e75b3f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:14:45.164879 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c9bf1f-ae34-4351-94dd-b86209e75b3f service nova] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:14:45.174317 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1314/2566] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:14:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:14:48.353587 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedbf8d9-fe62-437e-9717-db7f66aa299b None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:14:48.354159 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedbf8d9-fe62-437e-9717-db7f66aa299b None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:14:48.354159 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedbf8d9-fe62-437e-9717-db7f66aa299b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:14:48.374011 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-bedbf8d9-fe62-437e-9717-db7f66aa299b None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:14:48.375255 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-bedbf8d9-fe62-437e-9717-db7f66aa299b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:14:48.384657 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1253/2567] 10.222.0.33 () {58 vars in 1016 bytes} [Fri Oct 14 13:14:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:14:48.399197 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c9bf1f-ae34-4351-94dd-b86209e75b3f service nova] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:14:48.410906 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c9bf1f-ae34-4351-94dd-b86209e75b3f service nova] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:14:48.416438 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310a2629-c42e-46e5-8553-cc0bff501c02 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '931f4e32c8764514b5efed31b0785be7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:14:48.417029 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310a2629-c42e-46e5-8553-cc0bff501c02 service nova] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:14:48.417311 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310a2629-c42e-46e5-8553-cc0bff501c02 service nova] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:14:48.417588 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310a2629-c42e-46e5-8553-cc0bff501c02 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:14:48.425955 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310a2629-c42e-46e5-8553-cc0bff501c02 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:14:48.427573 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310a2629-c42e-46e5-8553-cc0bff501c02 service nova] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:14:48.436805 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1315/2568] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:14:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 14 13:14:51.442431 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537af79e-f91c-4991-8360-9278258c74f8 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:14:51.442934 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537af79e-f91c-4991-8360-9278258c74f8 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:14:51.443053 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537af79e-f91c-4991-8360-9278258c74f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:14:51.461981 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-537af79e-f91c-4991-8360-9278258c74f8 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:14:51.463204 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-537af79e-f91c-4991-8360-9278258c74f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:14:51.470855 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1254/2569] 10.222.0.33 () {58 vars in 1016 bytes} [Fri Oct 14 13:14:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:14:51.485026 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310a2629-c42e-46e5-8553-cc0bff501c02 service nova] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:14:51.496774 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310a2629-c42e-46e5-8553-cc0bff501c02 service nova] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:14:51.502236 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511789fa-b445-47d7-98eb-b75e04902d94 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '931f4e32c8764514b5efed31b0785be7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:14:51.502823 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511789fa-b445-47d7-98eb-b75e04902d94 service nova] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:14:51.503119 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511789fa-b445-47d7-98eb-b75e04902d94 service nova] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:14:51.503434 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511789fa-b445-47d7-98eb-b75e04902d94 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:14:51.511471 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511789fa-b445-47d7-98eb-b75e04902d94 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:14:51.513152 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511789fa-b445-47d7-98eb-b75e04902d94 service nova] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:14:51.522725 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1316/2570] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:14:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:14:54.603777 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eae1f64-828e-4649-a1f2-514b38f50221 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:14:54.604262 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eae1f64-828e-4649-a1f2-514b38f50221 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:14:54.604376 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eae1f64-828e-4649-a1f2-514b38f50221 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:14:54.624254 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-2eae1f64-828e-4649-a1f2-514b38f50221 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:14:54.625457 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-2eae1f64-828e-4649-a1f2-514b38f50221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:14:54.633914 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1255/2571] 10.222.0.33 () {58 vars in 1016 bytes} [Fri Oct 14 13:14:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:14:54.648999 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511789fa-b445-47d7-98eb-b75e04902d94 service nova] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:14:54.660323 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511789fa-b445-47d7-98eb-b75e04902d94 service nova] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:14:54.665681 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5180494d-2019-44aa-8f18-ad5bc3029c0f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '931f4e32c8764514b5efed31b0785be7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:14:54.666296 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5180494d-2019-44aa-8f18-ad5bc3029c0f service nova] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:14:54.666573 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5180494d-2019-44aa-8f18-ad5bc3029c0f service nova] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:14:54.666856 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5180494d-2019-44aa-8f18-ad5bc3029c0f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:14:54.675467 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5180494d-2019-44aa-8f18-ad5bc3029c0f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:14:54.677027 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5180494d-2019-44aa-8f18-ad5bc3029c0f service nova] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:14:54.686135 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1317/2572] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:14:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:14:59.829588 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9412fd0-e130-44b7-a626-e28d854596d0 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:14:59.830063 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9412fd0-e130-44b7-a626-e28d854596d0 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:14:59.830198 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9412fd0-e130-44b7-a626-e28d854596d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:14:59.849428 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-b9412fd0-e130-44b7-a626-e28d854596d0 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:14:59.850657 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-b9412fd0-e130-44b7-a626-e28d854596d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:14:59.858397 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1256/2573] 10.222.0.33 () {58 vars in 1016 bytes} [Fri Oct 14 13:14:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:14:59.874793 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5180494d-2019-44aa-8f18-ad5bc3029c0f service nova] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:14:59.886348 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5180494d-2019-44aa-8f18-ad5bc3029c0f service nova] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:14:59.891672 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9745b5de-ac64-4dcd-ac88-0914f825bc18 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '931f4e32c8764514b5efed31b0785be7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:14:59.892252 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9745b5de-ac64-4dcd-ac88-0914f825bc18 service nova] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:14:59.892526 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9745b5de-ac64-4dcd-ac88-0914f825bc18 service nova] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:14:59.892793 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9745b5de-ac64-4dcd-ac88-0914f825bc18 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:14:59.901074 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9745b5de-ac64-4dcd-ac88-0914f825bc18 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:14:59.902694 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9745b5de-ac64-4dcd-ac88-0914f825bc18 service nova] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:14:59.911941 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1318/2574] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:14:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 14 13:15:09.844640 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=15 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:15:09.907672 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=30 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:15:27.882395 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9412fd0-e130-44b7-a626-e28d854596d0 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:15:27.892382 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9412fd0-e130-44b7-a626-e28d854596d0 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:15:27.897916 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09602eb-b03e-496c-bfb6-bd4c62fb6147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:15:27.898576 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09602eb-b03e-496c-bfb6-bd4c62fb6147 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:15:27.898922 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09602eb-b03e-496c-bfb6-bd4c62fb6147 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:15:27.899113 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09602eb-b03e-496c-bfb6-bd4c62fb6147 admin admin] PATH_INFO: `/v3/users/1a3035f711f7481ebef079d85f3450f3` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:15:27.900720 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09602eb-b03e-496c-bfb6-bd4c62fb6147 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a3035f711f7481ebef079d85f3450f3)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:15:27.902921 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09602eb-b03e-496c-bfb6-bd4c62fb6147 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:15:27.950136 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-a09602eb-b03e-496c-bfb6-bd4c62fb6147 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a3035f711f7481ebef079d85f3450f3'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:15:27.956842 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-a09602eb-b03e-496c-bfb6-bd4c62fb6147 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a3035f711f7481ebef079d85f3450f3'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:15:27.957520 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-a09602eb-b03e-496c-bfb6-bd4c62fb6147 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a3035f711f7481ebef079d85f3450f3'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:15:27.964825 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-a09602eb-b03e-496c-bfb6-bd4c62fb6147 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a3035f711f7481ebef079d85f3450f3'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:15:27.977327 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-a09602eb-b03e-496c-bfb6-bd4c62fb6147 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a3035f711f7481ebef079d85f3450f3'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:15:27.983337 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1257/2575] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Oct 14 13:15:27 2022] DELETE /identity/v3/users/1a3035f711f7481ebef079d85f3450f3 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:15:28.155020 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9745b5de-ac64-4dcd-ac88-0914f825bc18 service nova] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:15:28.165764 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9745b5de-ac64-4dcd-ac88-0914f825bc18 service nova] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:15:28.230379 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805b4d59-1d1e-4b58-b4a9-77c32d0d3b2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:15:28.230936 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805b4d59-1d1e-4b58-b4a9-77c32d0d3b2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:15:28.231216 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805b4d59-1d1e-4b58-b4a9-77c32d0d3b2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:15:28.231491 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805b4d59-1d1e-4b58-b4a9-77c32d0d3b2f admin admin] PATH_INFO: `/v3/projects/5cf4e5ac43604d44b47bdf49b6bccea8` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:15:28.232604 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805b4d59-1d1e-4b58-b4a9-77c32d0d3b2f admin admin] RBAC: Authorizing `identity:delete_project(project_id=5cf4e5ac43604d44b47bdf49b6bccea8)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:15:28.234555 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805b4d59-1d1e-4b58-b4a9-77c32d0d3b2f admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:15:28.281285 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-805b4d59-1d1e-4b58-b4a9-77c32d0d3b2f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5cf4e5ac43604d44b47bdf49b6bccea8', 'request_id': 'req-805b4d59-1d1e-4b58-b4a9-77c32d0d3b2f'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:15:28.286712 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-805b4d59-1d1e-4b58-b4a9-77c32d0d3b2f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5cf4e5ac43604d44b47bdf49b6bccea8', 'request_id': 'req-805b4d59-1d1e-4b58-b4a9-77c32d0d3b2f'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:15:28.293938 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-805b4d59-1d1e-4b58-b4a9-77c32d0d3b2f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5cf4e5ac43604d44b47bdf49b6bccea8', 'request_id': 'req-805b4d59-1d1e-4b58-b4a9-77c32d0d3b2f'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:15:28.306112 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-805b4d59-1d1e-4b58-b4a9-77c32d0d3b2f admin admin] The token cache is being invalidate because project 5cf4e5ac43604d44b47bdf49b6bccea8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:15:28.306451 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-805b4d59-1d1e-4b58-b4a9-77c32d0d3b2f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:15:28.307060 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-805b4d59-1d1e-4b58-b4a9-77c32d0d3b2f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:15:28.308524 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1319/2576] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Oct 14 13:15:28 2022] DELETE /identity/v3/projects/5cf4e5ac43604d44b47bdf49b6bccea8 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:15:28.313431 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075d3420-f6bc-4fd3-9893-d4ca8faa2a5a None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:15:28.313720 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075d3420-f6bc-4fd3-9893-d4ca8faa2a5a None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:15:28.313999 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075d3420-f6bc-4fd3-9893-d4ca8faa2a5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:15:28.333825 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-075d3420-f6bc-4fd3-9893-d4ca8faa2a5a None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:15:28.336346 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-075d3420-f6bc-4fd3-9893-d4ca8faa2a5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:15:28.394646 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1258/2577] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:15:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:15:28.403114 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8507a0b3-91ed-493d-8a3b-d4a398decc45 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:15:28.403395 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8507a0b3-91ed-493d-8a3b-d4a398decc45 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:15:28.403669 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8507a0b3-91ed-493d-8a3b-d4a398decc45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:15:28.424049 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-8507a0b3-91ed-493d-8a3b-d4a398decc45 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:15:28.425257 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-8507a0b3-91ed-493d-8a3b-d4a398decc45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:15:28.433142 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1320/2578] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:15:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:15:28.437266 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075d3420-f6bc-4fd3-9893-d4ca8faa2a5a None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:15:28.447323 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075d3420-f6bc-4fd3-9893-d4ca8faa2a5a None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:15:28.451842 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c8e2cb-2e32-4fdd-8cf9-38eaf0fdc380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:15:28.452423 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c8e2cb-2e32-4fdd-8cf9-38eaf0fdc380 admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:15:28.452702 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c8e2cb-2e32-4fdd-8cf9-38eaf0fdc380 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:15:28.452973 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c8e2cb-2e32-4fdd-8cf9-38eaf0fdc380 admin admin] PATH_INFO: `/v3/domains` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:15:28.453609 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c8e2cb-2e32-4fdd-8cf9-38eaf0fdc380 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 13:15:28.453908 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c8e2cb-2e32-4fdd-8cf9-38eaf0fdc380 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:15:28.455553 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c8e2cb-2e32-4fdd-8cf9-38eaf0fdc380 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:15:28.467774 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1259/2579] 10.222.0.17 () {58 vars in 1153 bytes} [Fri Oct 14 13:15:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 13:15:28.472124 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8507a0b3-91ed-493d-8a3b-d4a398decc45 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:15:28.482019 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8507a0b3-91ed-493d-8a3b-d4a398decc45 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:15:28.486599 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b76c26-7f56-4b9d-853f-8ddcde3d06a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:15:28.487304 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b76c26-7f56-4b9d-853f-8ddcde3d06a4 admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:15:28.487579 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b76c26-7f56-4b9d-853f-8ddcde3d06a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:15:28.487849 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b76c26-7f56-4b9d-853f-8ddcde3d06a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:15:28.488469 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b76c26-7f56-4b9d-853f-8ddcde3d06a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:15:28.490533 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b76c26-7f56-4b9d-853f-8ddcde3d06a4 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:15:28.516659 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1321/2580] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Oct 14 13:15:28 2022] POST /identity/v3/projects => generated 399 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:15:28.520784 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c8e2cb-2e32-4fdd-8cf9-38eaf0fdc380 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:15:28.531184 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c8e2cb-2e32-4fdd-8cf9-38eaf0fdc380 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:15:28.586981 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bef837-c8d8-437e-9472-a86318f35ce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:15:28.587576 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bef837-c8d8-437e-9472-a86318f35ce8 admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:15:28.587853 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bef837-c8d8-437e-9472-a86318f35ce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:15:28.588120 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bef837-c8d8-437e-9472-a86318f35ce8 admin admin] PATH_INFO: `/v3/users` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:15:28.588745 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bef837-c8d8-437e-9472-a86318f35ce8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:15:28.590661 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bef837-c8d8-437e-9472-a86318f35ce8 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:15:28.598450 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:15:28.613686 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1260/2581] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Oct 14 13:15:28 2022] POST /identity/v3/users => generated 300 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 13:15:28.617782 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b76c26-7f56-4b9d-853f-8ddcde3d06a4 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:15:28.628022 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b76c26-7f56-4b9d-853f-8ddcde3d06a4 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:15:28.633463 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9389ca14-ff89-4cf1-ab6b-880bb47aea9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:15:28.634052 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9389ca14-ff89-4cf1-ab6b-880bb47aea9f admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:15:28.634360 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9389ca14-ff89-4cf1-ab6b-880bb47aea9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:15:28.634630 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9389ca14-ff89-4cf1-ab6b-880bb47aea9f admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:15:28.635282 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9389ca14-ff89-4cf1-ab6b-880bb47aea9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:15:28.636867 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9389ca14-ff89-4cf1-ab6b-880bb47aea9f admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:15:28.646673 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1322/2582] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:15:28 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:15:28.651173 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bef837-c8d8-437e-9472-a86318f35ce8 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:15:28.661217 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bef837-c8d8-437e-9472-a86318f35ce8 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:15:28.666575 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b01954-b498-4a5a-995e-b4d35668ece7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:15:28.667181 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b01954-b498-4a5a-995e-b4d35668ece7 admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:15:28.667464 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b01954-b498-4a5a-995e-b4d35668ece7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:15:28.667743 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b01954-b498-4a5a-995e-b4d35668ece7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:15:28.668391 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b01954-b498-4a5a-995e-b4d35668ece7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:15:28.669993 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b01954-b498-4a5a-995e-b4d35668ece7 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:15:28.681313 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1261/2583] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:15:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:15:28.685162 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9389ca14-ff89-4cf1-ab6b-880bb47aea9f admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:15:28.696146 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9389ca14-ff89-4cf1-ab6b-880bb47aea9f admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:15:28.700777 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39da24b7-e954-4d10-9d42-7b3b21158d52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:15:28.701420 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39da24b7-e954-4d10-9d42-7b3b21158d52 admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:15:28.701702 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39da24b7-e954-4d10-9d42-7b3b21158d52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:15:28.701978 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39da24b7-e954-4d10-9d42-7b3b21158d52 admin admin] PATH_INFO: `/v3/projects/046af3567a56461ea6c888b89aac4932/users/d70d83aafe054040848e3e32bd3ad895/roles/5e8849303a75425b9eaa2681cc031af1` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:15:28.717403 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39da24b7-e954-4d10-9d42-7b3b21158d52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=046af3567a56461ea6c888b89aac4932, user_id=d70d83aafe054040848e3e32bd3ad895, role_id=5e8849303a75425b9eaa2681cc031af1)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:15:28.720130 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39da24b7-e954-4d10-9d42-7b3b21158d52 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:15:28.733565 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1323/2584] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Oct 14 13:15:28 2022] PUT /identity/v3/projects/046af3567a56461ea6c888b89aac4932/users/d70d83aafe054040848e3e32bd3ad895/roles/5e8849303a75425b9eaa2681cc031af1 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:15:28.743667 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ed8109-cb86-4e47-ae88-f4c25c4370f5 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:15:28.743950 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ed8109-cb86-4e47-ae88-f4c25c4370f5 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:15:28.744222 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ed8109-cb86-4e47-ae88-f4c25c4370f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:15:28.773950 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-10ed8109-cb86-4e47-ae88-f4c25c4370f5 None None] MFA Rules not processed for user `d70d83aafe054040848e3e32bd3ad895`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:15:28.775241 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-10ed8109-cb86-4e47-ae88-f4c25c4370f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:15:28.839942 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1262/2585] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:15:28 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 13:15:28.851313 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39da24b7-e954-4d10-9d42-7b3b21158d52 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:15:28.852985 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-39da24b7-e954-4d10-9d42-7b3b21158d52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:15:28.883768 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:15:28.911794 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39da24b7-e954-4d10-9d42-7b3b21158d52 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:15:28.915915 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7d1c61-8d83-4362-8fdf-4da7e626b061 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c3c564b8c548e4beef1cbfba2ad343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:15:28.916517 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7d1c61-8d83-4362-8fdf-4da7e626b061 service cinder] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:15:28.916796 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7d1c61-8d83-4362-8fdf-4da7e626b061 service cinder] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:15:28.917067 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7d1c61-8d83-4362-8fdf-4da7e626b061 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:15:28.925437 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7d1c61-8d83-4362-8fdf-4da7e626b061 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:15:28.926937 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7d1c61-8d83-4362-8fdf-4da7e626b061 service cinder] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:15:28.936621 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1324/2586] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:15:28 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:15:33.934373 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ed8109-cb86-4e47-ae88-f4c25c4370f5 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:15:33.995515 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ed8109-cb86-4e47-ae88-f4c25c4370f5 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:15:34.000241 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2481bc26-be0e-4ac9-80b1-65f649f4ce63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:15:34.000873 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2481bc26-be0e-4ac9-80b1-65f649f4ce63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:15:34.001158 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2481bc26-be0e-4ac9-80b1-65f649f4ce63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:15:34.001465 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2481bc26-be0e-4ac9-80b1-65f649f4ce63 admin admin] PATH_INFO: `/v3/users/d70d83aafe054040848e3e32bd3ad895` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:15:34.002619 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2481bc26-be0e-4ac9-80b1-65f649f4ce63 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d70d83aafe054040848e3e32bd3ad895)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:15:34.004553 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2481bc26-be0e-4ac9-80b1-65f649f4ce63 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:15:34.050321 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-2481bc26-be0e-4ac9-80b1-65f649f4ce63 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd70d83aafe054040848e3e32bd3ad895'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:15:34.057734 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-2481bc26-be0e-4ac9-80b1-65f649f4ce63 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd70d83aafe054040848e3e32bd3ad895'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:15:34.058413 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-2481bc26-be0e-4ac9-80b1-65f649f4ce63 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd70d83aafe054040848e3e32bd3ad895'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:15:34.065622 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-2481bc26-be0e-4ac9-80b1-65f649f4ce63 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd70d83aafe054040848e3e32bd3ad895'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:15:34.070967 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:INSERT=4,keystone:SELECT=87,keystone:DELETE=9 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:15:34.078988 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-2481bc26-be0e-4ac9-80b1-65f649f4ce63 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd70d83aafe054040848e3e32bd3ad895'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:15:34.085125 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1263/2587] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Oct 14 13:15:33 2022] DELETE /identity/v3/users/d70d83aafe054040848e3e32bd3ad895 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:15:34.089704 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb18c38-b3f6-44c5-8e4c-f27a3fd2e2d0 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:15:34.090176 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb18c38-b3f6-44c5-8e4c-f27a3fd2e2d0 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:15:34.090297 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb18c38-b3f6-44c5-8e4c-f27a3fd2e2d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:15:34.110803 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-8cb18c38-b3f6-44c5-8e4c-f27a3fd2e2d0 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:15:34.112013 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-8cb18c38-b3f6-44c5-8e4c-f27a3fd2e2d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:15:34.170753 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1325/2588] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:15:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:15:34.181339 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2481bc26-be0e-4ac9-80b1-65f649f4ce63 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:15:34.182766 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-2481bc26-be0e-4ac9-80b1-65f649f4ce63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:15:34.239293 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2481bc26-be0e-4ac9-80b1-65f649f4ce63 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:15:34.242941 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60961567-7bf9-4c4d-aaf0-2be6c9cdc7b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d483292f3a4794848fcacfba5b107e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:15:34.243536 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60961567-7bf9-4c4d-aaf0-2be6c9cdc7b1 service neutron] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:15:34.243815 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60961567-7bf9-4c4d-aaf0-2be6c9cdc7b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:15:34.244084 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60961567-7bf9-4c4d-aaf0-2be6c9cdc7b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:15:34.252841 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60961567-7bf9-4c4d-aaf0-2be6c9cdc7b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:15:34.254306 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60961567-7bf9-4c4d-aaf0-2be6c9cdc7b1 service neutron] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:15:34.263408 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1264/2589] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:15:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:15:34.524333 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb18c38-b3f6-44c5-8e4c-f27a3fd2e2d0 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:15:34.525812 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-8cb18c38-b3f6-44c5-8e4c-f27a3fd2e2d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:15:34.541703 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb18c38-b3f6-44c5-8e4c-f27a3fd2e2d0 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:15:34.546662 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ca0891-0baf-4bba-965f-dad8877569b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:15:34.547292 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ca0891-0baf-4bba-965f-dad8877569b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:15:34.547604 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ca0891-0baf-4bba-965f-dad8877569b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:15:34.547832 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ca0891-0baf-4bba-965f-dad8877569b0 admin admin] PATH_INFO: `/v3/projects/046af3567a56461ea6c888b89aac4932` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:15:34.549003 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ca0891-0baf-4bba-965f-dad8877569b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=046af3567a56461ea6c888b89aac4932)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:15:34.551057 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ca0891-0baf-4bba-965f-dad8877569b0 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:15:34.598512 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-e2ca0891-0baf-4bba-965f-dad8877569b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '046af3567a56461ea6c888b89aac4932', 'request_id': 'req-e2ca0891-0baf-4bba-965f-dad8877569b0'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:15:34.604275 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-e2ca0891-0baf-4bba-965f-dad8877569b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '046af3567a56461ea6c888b89aac4932', 'request_id': 'req-e2ca0891-0baf-4bba-965f-dad8877569b0'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:15:34.610504 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-e2ca0891-0baf-4bba-965f-dad8877569b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '046af3567a56461ea6c888b89aac4932', 'request_id': 'req-e2ca0891-0baf-4bba-965f-dad8877569b0'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:15:34.622695 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-e2ca0891-0baf-4bba-965f-dad8877569b0 admin admin] The token cache is being invalidate because project 046af3567a56461ea6c888b89aac4932 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:15:34.622983 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-e2ca0891-0baf-4bba-965f-dad8877569b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:15:34.623602 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-e2ca0891-0baf-4bba-965f-dad8877569b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:15:34.625104 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1326/2590] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Oct 14 13:15:34 2022] DELETE /identity/v3/projects/046af3567a56461ea6c888b89aac4932 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:15:34.629947 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f4e736-f242-4cfb-ba86-d75c637b7f37 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:15:34.630264 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f4e736-f242-4cfb-ba86-d75c637b7f37 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:15:34.630542 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f4e736-f242-4cfb-ba86-d75c637b7f37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:15:34.651304 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-72f4e736-f242-4cfb-ba86-d75c637b7f37 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:15:34.652513 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-72f4e736-f242-4cfb-ba86-d75c637b7f37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:15:34.711484 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1265/2591] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:15:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:15:34.720115 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f71784-3550-47bf-8bde-b7558958e980 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:15:34.720396 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f71784-3550-47bf-8bde-b7558958e980 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:15:34.720671 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f71784-3550-47bf-8bde-b7558958e980 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:15:34.740493 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-97f71784-3550-47bf-8bde-b7558958e980 None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:15:34.741905 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-97f71784-3550-47bf-8bde-b7558958e980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:15:34.749695 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1327/2592] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:15:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:15:34.754740 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f4e736-f242-4cfb-ba86-d75c637b7f37 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:15:34.765346 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f4e736-f242-4cfb-ba86-d75c637b7f37 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:15:34.769906 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddbe8c5-8a7c-4ff4-9ae5-84bb9dae462b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:15:34.770526 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddbe8c5-8a7c-4ff4-9ae5-84bb9dae462b admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:15:34.770805 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddbe8c5-8a7c-4ff4-9ae5-84bb9dae462b admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:15:34.771077 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddbe8c5-8a7c-4ff4-9ae5-84bb9dae462b admin admin] PATH_INFO: `/v3/domains` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:15:34.772526 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddbe8c5-8a7c-4ff4-9ae5-84bb9dae462b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81439) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 13:15:34.772847 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddbe8c5-8a7c-4ff4-9ae5-84bb9dae462b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:15:34.774473 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddbe8c5-8a7c-4ff4-9ae5-84bb9dae462b admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:15:34.785615 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1266/2593] 10.222.0.17 () {58 vars in 1153 bytes} [Fri Oct 14 13:15:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 13:15:34.789842 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f71784-3550-47bf-8bde-b7558958e980 None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:15:34.798981 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f71784-3550-47bf-8bde-b7558958e980 None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:15:34.804150 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdffe8ad-69cf-44da-ac85-0870c6465e77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:15:34.804771 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdffe8ad-69cf-44da-ac85-0870c6465e77 admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:15:34.805047 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdffe8ad-69cf-44da-ac85-0870c6465e77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:15:34.805317 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdffe8ad-69cf-44da-ac85-0870c6465e77 admin admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:15:34.805935 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdffe8ad-69cf-44da-ac85-0870c6465e77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:15:34.807880 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdffe8ad-69cf-44da-ac85-0870c6465e77 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:15:34.837399 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1328/2594] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Oct 14 13:15:34 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:15:34.841688 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddbe8c5-8a7c-4ff4-9ae5-84bb9dae462b admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:15:34.852108 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddbe8c5-8a7c-4ff4-9ae5-84bb9dae462b admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:15:34.907633 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2772951a-391b-4567-b0f8-b6b716251968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:15:34.908265 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2772951a-391b-4567-b0f8-b6b716251968 admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:15:34.908568 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2772951a-391b-4567-b0f8-b6b716251968 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:15:34.908839 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2772951a-391b-4567-b0f8-b6b716251968 admin admin] PATH_INFO: `/v3/users` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:15:34.909467 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2772951a-391b-4567-b0f8-b6b716251968 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:15:34.911405 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2772951a-391b-4567-b0f8-b6b716251968 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:15:34.932426 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1267/2595] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Oct 14 13:15:34 2022] POST /identity/v3/users => generated 293 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:15:34.936603 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdffe8ad-69cf-44da-ac85-0870c6465e77 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:15:34.948070 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdffe8ad-69cf-44da-ac85-0870c6465e77 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:15:34.952770 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23b0599-ac09-4b2b-aa1b-3961c084eda9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:15:34.953360 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23b0599-ac09-4b2b-aa1b-3961c084eda9 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:15:34.953640 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23b0599-ac09-4b2b-aa1b-3961c084eda9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:15:34.953911 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23b0599-ac09-4b2b-aa1b-3961c084eda9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:15:34.954586 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23b0599-ac09-4b2b-aa1b-3961c084eda9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:15:34.956180 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23b0599-ac09-4b2b-aa1b-3961c084eda9 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:15:34.966662 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1329/2596] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:15:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 14 13:15:34.970441 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2772951a-391b-4567-b0f8-b6b716251968 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:15:34.980687 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2772951a-391b-4567-b0f8-b6b716251968 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:15:34.985427 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36187acf-6a2b-4f6a-808f-7ca303fbb908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:15:34.986011 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36187acf-6a2b-4f6a-808f-7ca303fbb908 admin admin] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:15:34.986331 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36187acf-6a2b-4f6a-808f-7ca303fbb908 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:15:34.986608 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36187acf-6a2b-4f6a-808f-7ca303fbb908 admin admin] PATH_INFO: `/v3/roles` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:15:34.987248 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36187acf-6a2b-4f6a-808f-7ca303fbb908 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:15:34.988844 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36187acf-6a2b-4f6a-808f-7ca303fbb908 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:15:34.990671 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:15:35.002228 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1268/2597] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:15:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:15:35.006817 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23b0599-ac09-4b2b-aa1b-3961c084eda9 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:15:35.016675 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23b0599-ac09-4b2b-aa1b-3961c084eda9 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:15:35.021335 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791acd07-d51c-4234-8be4-7cb9902c271f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:15:35.021976 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791acd07-d51c-4234-8be4-7cb9902c271f admin admin] REQUEST_METHOD: `PUT` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:15:35.022305 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791acd07-d51c-4234-8be4-7cb9902c271f admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:15:35.022587 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791acd07-d51c-4234-8be4-7cb9902c271f admin admin] PATH_INFO: `/v3/projects/1949743eedf34d5d9aff21207e6c70ef/users/539f10bc17df40a69e3ba6781ef67276/roles/5e8849303a75425b9eaa2681cc031af1` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:15:35.033467 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:15:35.038728 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791acd07-d51c-4234-8be4-7cb9902c271f admin admin] RBAC: Authorizing `identity:create_grant(project_id=1949743eedf34d5d9aff21207e6c70ef, user_id=539f10bc17df40a69e3ba6781ef67276, role_id=5e8849303a75425b9eaa2681cc031af1)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:15:35.042729 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791acd07-d51c-4234-8be4-7cb9902c271f admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:15:35.056220 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1330/2598] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Oct 14 13:15:35 2022] PUT /identity/v3/projects/1949743eedf34d5d9aff21207e6c70ef/users/539f10bc17df40a69e3ba6781ef67276/roles/5e8849303a75425b9eaa2681cc031af1 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:15:35.061239 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d57404-0c70-45ac-99fd-07ff7f2d9a9c None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:15:35.061581 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d57404-0c70-45ac-99fd-07ff7f2d9a9c None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:15:35.061876 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d57404-0c70-45ac-99fd-07ff7f2d9a9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:15:35.081061 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-84d57404-0c70-45ac-99fd-07ff7f2d9a9c None None] MFA Rules not processed for user `c832b4bdd0c849fb8bef8d4ac39a8dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:15:35.082284 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-84d57404-0c70-45ac-99fd-07ff7f2d9a9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:15:35.140432 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1269/2599] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:15:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:15:35.150235 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791acd07-d51c-4234-8be4-7cb9902c271f admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:15:35.151939 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-791acd07-d51c-4234-8be4-7cb9902c271f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:15:35.207287 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791acd07-d51c-4234-8be4-7cb9902c271f admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:15:35.211730 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7103d31-9162-47be-a5b3-ad589a7f3f3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d483292f3a4794848fcacfba5b107e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:15:35.212341 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7103d31-9162-47be-a5b3-ad589a7f3f3c service neutron] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:15:35.212623 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7103d31-9162-47be-a5b3-ad589a7f3f3c service neutron] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:15:35.212897 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7103d31-9162-47be-a5b3-ad589a7f3f3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:15:35.222051 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7103d31-9162-47be-a5b3-ad589a7f3f3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:15:35.223459 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7103d31-9162-47be-a5b3-ad589a7f3f3c service neutron] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:15:35.232964 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1331/2600] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:15:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:15:39.174385 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6ae97b-afc5-4778-a0ea-ce9404c23975 None None] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:15:39.174920 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6ae97b-afc5-4778-a0ea-ce9404c23975 None None] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:15:39.174920 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6ae97b-afc5-4778-a0ea-ce9404c23975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:15:39.207664 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.auth.core [None req-4c6ae97b-afc5-4778-a0ea-ce9404c23975 None None] MFA Rules not processed for user `539f10bc17df40a69e3ba6781ef67276`. Rule list: `[]` (Enabled: `True`). {{(pid=81439) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:15:39.209451 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-4c6ae97b-afc5-4778-a0ea-ce9404c23975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:15:39.279774 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1270/2601] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:15:39 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:15:39.284588 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7103d31-9162-47be-a5b3-ad589a7f3f3c service neutron] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:15:39.295328 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7103d31-9162-47be-a5b3-ad589a7f3f3c service neutron] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:15:39.300069 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b006b2-ea34-4b44-9abc-c74157de7a4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:15:39.300674 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b006b2-ea34-4b44-9abc-c74157de7a4f admin admin] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:15:39.300956 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b006b2-ea34-4b44-9abc-c74157de7a4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:15:39.301231 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b006b2-ea34-4b44-9abc-c74157de7a4f admin admin] PATH_INFO: `/v3/projects` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:15:39.301911 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b006b2-ea34-4b44-9abc-c74157de7a4f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:15:39.304576 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b006b2-ea34-4b44-9abc-c74157de7a4f admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:15:39.334394 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1332/2602] 10.222.0.17 () {60 vars in 1153 bytes} [Fri Oct 14 13:15:39 2022] POST /identity/v3/projects => generated 383 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 13:15:39.338973 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6ae97b-afc5-4778-a0ea-ce9404c23975 None None] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:15:39.351553 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6ae97b-afc5-4778-a0ea-ce9404c23975 None None] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:15:39.412909 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af449e7-8bd7-4bcd-bcb5-59b346a3d312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:15:39.413532 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af449e7-8bd7-4bcd-bcb5-59b346a3d312 admin admin] REQUEST_METHOD: `POST` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:15:39.413815 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af449e7-8bd7-4bcd-bcb5-59b346a3d312 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:15:39.414091 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af449e7-8bd7-4bcd-bcb5-59b346a3d312 admin admin] PATH_INFO: `/v3/users` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:15:39.414781 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af449e7-8bd7-4bcd-bcb5-59b346a3d312 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:15:39.416763 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af449e7-8bd7-4bcd-bcb5-59b346a3d312 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:15:39.440024 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1271/2603] 10.222.0.17 () {60 vars in 1144 bytes} [Fri Oct 14 13:15:39 2022] POST /identity/v3/users => generated 298 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 13:15:39.443979 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b006b2-ea34-4b44-9abc-c74157de7a4f admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:15:39.455171 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b006b2-ea34-4b44-9abc-c74157de7a4f admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:15:39.460836 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc5d153-2e19-4aac-8fc8-ce944273bf74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:15:39.461451 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc5d153-2e19-4aac-8fc8-ce944273bf74 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:15:39.461732 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc5d153-2e19-4aac-8fc8-ce944273bf74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:15:39.462008 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc5d153-2e19-4aac-8fc8-ce944273bf74 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:15:39.462678 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc5d153-2e19-4aac-8fc8-ce944273bf74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:15:39.464298 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc5d153-2e19-4aac-8fc8-ce944273bf74 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:15:39.476801 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1333/2604] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:15:39 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:15:39.481191 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af449e7-8bd7-4bcd-bcb5-59b346a3d312 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:15:39.492560 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af449e7-8bd7-4bcd-bcb5-59b346a3d312 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:15:39.497318 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cffb9c-ea0c-4047-a991-faf8bac65165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:15:39.497979 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cffb9c-ea0c-4047-a991-faf8bac65165 admin admin] REQUEST_METHOD: `PUT` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:15:39.498316 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cffb9c-ea0c-4047-a991-faf8bac65165 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:15:39.498576 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cffb9c-ea0c-4047-a991-faf8bac65165 admin admin] PATH_INFO: `/v3/projects/72bf57f40a6c481881574a37f4d22e11/users/2343387e67384a79964cf2d6e39e1188/roles/7f6e29e390bc41f7a9af17659a2e95d1` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:15:39.511957 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:15:39.515490 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cffb9c-ea0c-4047-a991-faf8bac65165 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72bf57f40a6c481881574a37f4d22e11, user_id=2343387e67384a79964cf2d6e39e1188, role_id=7f6e29e390bc41f7a9af17659a2e95d1)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:15:39.519136 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cffb9c-ea0c-4047-a991-faf8bac65165 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:15:39.533208 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1272/2605] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Oct 14 13:15:39 2022] PUT /identity/v3/projects/72bf57f40a6c481881574a37f4d22e11/users/2343387e67384a79964cf2d6e39e1188/roles/7f6e29e390bc41f7a9af17659a2e95d1 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:15:39.538070 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc5d153-2e19-4aac-8fc8-ce944273bf74 admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:15:39.549009 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc5d153-2e19-4aac-8fc8-ce944273bf74 admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:15:39.606582 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8359908-fa25-4a72-b583-89e6fead9505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:15:39.607182 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8359908-fa25-4a72-b583-89e6fead9505 admin admin] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:15:39.607458 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8359908-fa25-4a72-b583-89e6fead9505 admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:15:39.607727 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8359908-fa25-4a72-b583-89e6fead9505 admin admin] PATH_INFO: `/v3/roles` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:15:39.608357 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8359908-fa25-4a72-b583-89e6fead9505 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:15:39.609946 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8359908-fa25-4a72-b583-89e6fead9505 admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:15:39.620142 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1334/2606] 10.222.0.17 () {58 vars in 1122 bytes} [Fri Oct 14 13:15:39 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 13:15:39.624266 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cffb9c-ea0c-4047-a991-faf8bac65165 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:15:39.634476 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cffb9c-ea0c-4047-a991-faf8bac65165 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:15:39.638989 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db9b691-67e8-4929-9814-247535fcecb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:15:39.639627 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db9b691-67e8-4929-9814-247535fcecb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:15:39.639903 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db9b691-67e8-4929-9814-247535fcecb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:15:39.640174 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db9b691-67e8-4929-9814-247535fcecb8 admin admin] PATH_INFO: `/v3/projects/72bf57f40a6c481881574a37f4d22e11/users/2343387e67384a79964cf2d6e39e1188/roles/7f6e29e390bc41f7a9af17659a2e95d1` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:15:39.642108 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db9b691-67e8-4929-9814-247535fcecb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72bf57f40a6c481881574a37f4d22e11, user_id=2343387e67384a79964cf2d6e39e1188, role_id=7f6e29e390bc41f7a9af17659a2e95d1)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:15:39.644749 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db9b691-67e8-4929-9814-247535fcecb8 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:15:39.655509 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1273/2607] 10.222.0.17 () {60 vars in 1483 bytes} [Fri Oct 14 13:15:39 2022] PUT /identity/v3/projects/72bf57f40a6c481881574a37f4d22e11/users/2343387e67384a79964cf2d6e39e1188/roles/7f6e29e390bc41f7a9af17659a2e95d1 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:15:44.029813 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8364d288-190a-449c-be0a-fc6003538aec None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:15:44.030455 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8364d288-190a-449c-be0a-fc6003538aec None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:15:44.030799 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8364d288-190a-449c-be0a-fc6003538aec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:15:44.064761 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-8364d288-190a-449c-be0a-fc6003538aec None None] MFA Rules not processed for user `2343387e67384a79964cf2d6e39e1188`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:15:44.066108 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-8364d288-190a-449c-be0a-fc6003538aec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:15:44.132788 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:15:44.179217 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1335/2608] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:15:44 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:15:44.194889 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db9b691-67e8-4929-9814-247535fcecb8 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:15:44.196906 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-2db9b691-67e8-4929-9814-247535fcecb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:15:44.309887 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db9b691-67e8-4929-9814-247535fcecb8 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:15:44.313917 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b5ec4f-8f09-4f98-9bac-0943269bfbae service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0de24488ed54df29d8da344d76651d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:15:44.314637 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b5ec4f-8f09-4f98-9bac-0943269bfbae service glance] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:15:44.314921 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b5ec4f-8f09-4f98-9bac-0943269bfbae service glance] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:15:44.315197 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b5ec4f-8f09-4f98-9bac-0943269bfbae service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:15:44.378444 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b5ec4f-8f09-4f98-9bac-0943269bfbae service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:15:44.382166 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b5ec4f-8f09-4f98-9bac-0943269bfbae service glance] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:15:44.400388 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1274/2609] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:15:44 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:15:44.539369 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01963f9c-a798-4054-9dfb-49f466462040 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:15:44.539651 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01963f9c-a798-4054-9dfb-49f466462040 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:15:44.539924 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01963f9c-a798-4054-9dfb-49f466462040 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:15:44.595496 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-01963f9c-a798-4054-9dfb-49f466462040 None None] MFA Rules not processed for user `b83a5a78f3e7486293907cb3012c0ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:15:44.596683 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-01963f9c-a798-4054-9dfb-49f466462040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:15:44.698473 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1336/2610] 10.222.0.17 () {58 vars in 1009 bytes} [Fri Oct 14 13:15:44 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 13:15:44.749049 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b5ec4f-8f09-4f98-9bac-0943269bfbae service glance] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:15:44.750500 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-56b5ec4f-8f09-4f98-9bac-0943269bfbae service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:15:44.831832 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:15:44.847271 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b5ec4f-8f09-4f98-9bac-0943269bfbae service glance] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:15:44.852388 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb32880b-cbe9-495c-8a13-d09781a3e3ef service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c9fc57b1ec4d00b9f392877f277284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:15:44.852980 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb32880b-cbe9-495c-8a13-d09781a3e3ef service swift] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:15:44.853257 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb32880b-cbe9-495c-8a13-d09781a3e3ef service swift] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:15:44.853526 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb32880b-cbe9-495c-8a13-d09781a3e3ef service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:15:44.861773 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb32880b-cbe9-495c-8a13-d09781a3e3ef service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:15:44.863409 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb32880b-cbe9-495c-8a13-d09781a3e3ef service swift] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:15:44.872429 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1275/2611] 10.222.0.17 () {60 vars in 1384 bytes} [Fri Oct 14 13:15:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 14 13:15:53.402704 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fef4e83-c033-438e-8042-5c6756992159 None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:15:53.403218 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fef4e83-c033-438e-8042-5c6756992159 None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:15:53.403335 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fef4e83-c033-438e-8042-5c6756992159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:15:53.421944 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-2fef4e83-c033-438e-8042-5c6756992159 None None] MFA Rules not processed for user `539f10bc17df40a69e3ba6781ef67276`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:15:53.423189 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-2fef4e83-c033-438e-8042-5c6756992159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:15:53.430176 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1337/2612] 10.222.0.17 () {58 vars in 958 bytes} [Fri Oct 14 13:15:53 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:15:53.685812 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb32880b-cbe9-495c-8a13-d09781a3e3ef service swift] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:15:53.741796 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb32880b-cbe9-495c-8a13-d09781a3e3ef service swift] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:15:53.745392 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697160ab-0b72-49e9-9306-1e2787ad26ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d483292f3a4794848fcacfba5b107e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:15:53.746003 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697160ab-0b72-49e9-9306-1e2787ad26ff service neutron] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:15:53.746305 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697160ab-0b72-49e9-9306-1e2787ad26ff service neutron] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:15:53.746578 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697160ab-0b72-49e9-9306-1e2787ad26ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:15:53.748296 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-697160ab-0b72-49e9-9306-1e2787ad26ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:15:53.758361 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697160ab-0b72-49e9-9306-1e2787ad26ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:15:53.759785 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697160ab-0b72-49e9-9306-1e2787ad26ff service neutron] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:15:53.768572 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1276/2613] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:15:53 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:15:55.504359 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab0f558-eca5-4a9a-bbac-08183500cdaf None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:15:55.505621 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab0f558-eca5-4a9a-bbac-08183500cdaf None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:15:55.505621 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab0f558-eca5-4a9a-bbac-08183500cdaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:15:55.524548 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-fab0f558-eca5-4a9a-bbac-08183500cdaf None None] MFA Rules not processed for user `b83a5a78f3e7486293907cb3012c0ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:15:55.525745 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-fab0f558-eca5-4a9a-bbac-08183500cdaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:15:55.533085 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1338/2614] 10.222.0.17 () {58 vars in 1009 bytes} [Fri Oct 14 13:15:55 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:15:55.546109 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697160ab-0b72-49e9-9306-1e2787ad26ff service neutron] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:15:55.559241 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697160ab-0b72-49e9-9306-1e2787ad26ff service neutron] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:15:55.564291 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a84c17-6f94-4475-9776-6159fc018fc8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c9fc57b1ec4d00b9f392877f277284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:15:55.564904 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a84c17-6f94-4475-9776-6159fc018fc8 service swift] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:15:55.565207 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a84c17-6f94-4475-9776-6159fc018fc8 service swift] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:15:55.565480 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a84c17-6f94-4475-9776-6159fc018fc8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:15:55.574052 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a84c17-6f94-4475-9776-6159fc018fc8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:15:55.575654 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a84c17-6f94-4475-9776-6159fc018fc8 service swift] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:15:55.584270 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1277/2615] 10.222.0.17 () {60 vars in 1384 bytes} [Fri Oct 14 13:15:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 14 13:16:05.519587 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=55 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:16:05.580374 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=40 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:16:17.878507 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab0f558-eca5-4a9a-bbac-08183500cdaf None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:16:17.879940 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-fab0f558-eca5-4a9a-bbac-08183500cdaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:16:17.936259 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab0f558-eca5-4a9a-bbac-08183500cdaf None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:16:17.939846 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58e0a30-95ae-4163-bb55-136026e75ce6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c3c564b8c548e4beef1cbfba2ad343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:16:17.940447 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58e0a30-95ae-4163-bb55-136026e75ce6 service cinder] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:16:17.940727 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58e0a30-95ae-4163-bb55-136026e75ce6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:16:17.940998 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58e0a30-95ae-4163-bb55-136026e75ce6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:16:17.942747 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-e58e0a30-95ae-4163-bb55-136026e75ce6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:16:18.013187 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58e0a30-95ae-4163-bb55-136026e75ce6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:16:18.014654 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58e0a30-95ae-4163-bb55-136026e75ce6 service cinder] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:16:18.025636 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1339/2616] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:16:17 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:16:20.589939 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a84c17-6f94-4475-9776-6159fc018fc8 service swift] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:16:20.599307 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a84c17-6f94-4475-9776-6159fc018fc8 service swift] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:16:20.602917 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab583c0-cb26-4980-9470-db34d40e4910 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d483292f3a4794848fcacfba5b107e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:16:20.603496 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab583c0-cb26-4980-9470-db34d40e4910 service neutron] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:16:20.603777 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab583c0-cb26-4980-9470-db34d40e4910 service neutron] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:16:20.604069 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab583c0-cb26-4980-9470-db34d40e4910 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:16:20.605759 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-fab583c0-cb26-4980-9470-db34d40e4910 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:16:20.619654 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab583c0-cb26-4980-9470-db34d40e4910 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:16:20.621062 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab583c0-cb26-4980-9470-db34d40e4910 service neutron] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:16:20.632708 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1278/2617] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:16:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:16:20.760824 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58e0a30-95ae-4163-bb55-136026e75ce6 service cinder] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:16:20.770299 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58e0a30-95ae-4163-bb55-136026e75ce6 service cinder] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:16:20.773957 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f6bb27-db32-4099-ae50-a05131050661 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d483292f3a4794848fcacfba5b107e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:16:20.774575 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f6bb27-db32-4099-ae50-a05131050661 service neutron] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:16:20.774852 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f6bb27-db32-4099-ae50-a05131050661 service neutron] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:16:20.775145 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f6bb27-db32-4099-ae50-a05131050661 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:16:20.783782 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f6bb27-db32-4099-ae50-a05131050661 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:16:20.785200 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f6bb27-db32-4099-ae50-a05131050661 service neutron] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:16:20.794416 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1340/2618] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:16:20 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 14 13:16:22.342479 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab583c0-cb26-4980-9470-db34d40e4910 service neutron] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:16:22.343908 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-fab583c0-cb26-4980-9470-db34d40e4910 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:16:22.360721 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab583c0-cb26-4980-9470-db34d40e4910 service neutron] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:16:22.367225 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e56d806-fb68-4fd8-8d3f-96caa57726e8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '931f4e32c8764514b5efed31b0785be7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:16:22.367830 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e56d806-fb68-4fd8-8d3f-96caa57726e8 service nova] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:16:22.368117 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e56d806-fb68-4fd8-8d3f-96caa57726e8 service nova] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:16:22.368375 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e56d806-fb68-4fd8-8d3f-96caa57726e8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:16:22.370317 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-4e56d806-fb68-4fd8-8d3f-96caa57726e8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:16:22.383689 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e56d806-fb68-4fd8-8d3f-96caa57726e8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:16:22.385287 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e56d806-fb68-4fd8-8d3f-96caa57726e8 service nova] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:16:22.397363 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1279/2619] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:16:22 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:16:30.790459 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=60 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:16:32.392285 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=12 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:16:57.701032 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f6bb27-db32-4099-ae50-a05131050661 service neutron] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:16:57.702494 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-81f6bb27-db32-4099-ae50-a05131050661 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:16:57.713922 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f6bb27-db32-4099-ae50-a05131050661 service neutron] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:16:57.717513 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465ca95f-d5c5-4627-b096-72673c4da98b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d483292f3a4794848fcacfba5b107e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:16:57.718094 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465ca95f-d5c5-4627-b096-72673c4da98b service neutron] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:16:57.718393 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465ca95f-d5c5-4627-b096-72673c4da98b service neutron] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:16:57.718663 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465ca95f-d5c5-4627-b096-72673c4da98b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:16:57.720312 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-465ca95f-d5c5-4627-b096-72673c4da98b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:16:57.730225 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465ca95f-d5c5-4627-b096-72673c4da98b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:16:57.731672 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465ca95f-d5c5-4627-b096-72673c4da98b service neutron] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:16:57.739515 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1341/2620] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:16:57 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:17:07.735902 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=6 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:18:40.719466 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e56d806-fb68-4fd8-8d3f-96caa57726e8 service nova] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:18:40.720941 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-4e56d806-fb68-4fd8-8d3f-96caa57726e8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:18:40.745177 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e56d806-fb68-4fd8-8d3f-96caa57726e8 service nova] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:18:40.753949 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614a2879-5958-4223-ab11-9bfda06aa07f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '931f4e32c8764514b5efed31b0785be7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:18:40.755024 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614a2879-5958-4223-ab11-9bfda06aa07f service nova] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:18:40.755541 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614a2879-5958-4223-ab11-9bfda06aa07f service nova] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:18:40.756047 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614a2879-5958-4223-ab11-9bfda06aa07f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:18:40.758888 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-614a2879-5958-4223-ab11-9bfda06aa07f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:18:40.781537 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614a2879-5958-4223-ab11-9bfda06aa07f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:18:40.783728 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614a2879-5958-4223-ab11-9bfda06aa07f service nova] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:18:40.797961 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1280/2621] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:18:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:18:48.198030 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a20135-d4a1-45ca-bc00-8d77914a907a None None] REQUEST_METHOD: `POST` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:18:48.198582 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a20135-d4a1-45ca-bc00-8d77914a907a None None] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:18:48.198706 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a20135-d4a1-45ca-bc00-8d77914a907a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:18:48.220355 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.auth.core [None req-90a20135-d4a1-45ca-bc00-8d77914a907a None None] MFA Rules not processed for user `b83a5a78f3e7486293907cb3012c0ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=81438) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 13:18:48.221585 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-90a20135-d4a1-45ca-bc00-8d77914a907a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:18:48.229835 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1342/2622] 10.222.0.17 () {58 vars in 967 bytes} [Fri Oct 14 13:18:48 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 13:18:48.273356 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614a2879-5958-4223-ab11-9bfda06aa07f service nova] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:18:48.285661 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614a2879-5958-4223-ab11-9bfda06aa07f service nova] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:18:48.291000 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42553880-3ce2-49fa-8421-26926fe3bd8b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c9fc57b1ec4d00b9f392877f277284', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:18:48.291636 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42553880-3ce2-49fa-8421-26926fe3bd8b service swift] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:18:48.291945 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42553880-3ce2-49fa-8421-26926fe3bd8b service swift] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:18:48.292221 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42553880-3ce2-49fa-8421-26926fe3bd8b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:18:48.302334 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42553880-3ce2-49fa-8421-26926fe3bd8b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:18:48.305121 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42553880-3ce2-49fa-8421-26926fe3bd8b service swift] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:18:48.313785 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1281/2623] 10.222.0.17 () {60 vars in 1384 bytes} [Fri Oct 14 13:18:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 14 13:18:52.106211 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a20135-d4a1-45ca-bc00-8d77914a907a None None] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:18:52.107665 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-90a20135-d4a1-45ca-bc00-8d77914a907a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:18:52.210778 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a20135-d4a1-45ca-bc00-8d77914a907a None None] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:18:52.223553 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4ff63a-518d-45da-9f7b-2d32c57da5c4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a5e5c35ed8b4abc877ba8d8c490dacd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:18:52.224378 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4ff63a-518d-45da-9f7b-2d32c57da5c4 service placement] REQUEST_METHOD: `GET` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:18:52.224758 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4ff63a-518d-45da-9f7b-2d32c57da5c4 service placement] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:18:52.225126 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4ff63a-518d-45da-9f7b-2d32c57da5c4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:18:52.227490 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-dd4ff63a-518d-45da-9f7b-2d32c57da5c4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:18:52.248025 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4ff63a-518d-45da-9f7b-2d32c57da5c4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:18:52.250561 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4ff63a-518d-45da-9f7b-2d32c57da5c4 service placement] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:18:52.263542 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1343/2624] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:18:52 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 14 13:18:55.818338 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42553880-3ce2-49fa-8421-26926fe3bd8b service swift] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:18:55.896593 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42553880-3ce2-49fa-8421-26926fe3bd8b service swift] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:18:55.901298 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22230f1-dc5f-4ea1-88b4-cb9f8f7d1b27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:18:55.901981 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22230f1-dc5f-4ea1-88b4-cb9f8f7d1b27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:18:55.902254 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22230f1-dc5f-4ea1-88b4-cb9f8f7d1b27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:18:55.902534 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22230f1-dc5f-4ea1-88b4-cb9f8f7d1b27 admin admin] PATH_INFO: `/v3/users/539f10bc17df40a69e3ba6781ef67276` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:18:55.903743 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22230f1-dc5f-4ea1-88b4-cb9f8f7d1b27 admin admin] RBAC: Authorizing `identity:delete_user(user_id=539f10bc17df40a69e3ba6781ef67276)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:18:55.905682 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22230f1-dc5f-4ea1-88b4-cb9f8f7d1b27 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:18:55.962770 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-e22230f1-dc5f-4ea1-88b4-cb9f8f7d1b27 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '539f10bc17df40a69e3ba6781ef67276'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:18:55.969744 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-e22230f1-dc5f-4ea1-88b4-cb9f8f7d1b27 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '539f10bc17df40a69e3ba6781ef67276'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:18:55.970479 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-e22230f1-dc5f-4ea1-88b4-cb9f8f7d1b27 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '539f10bc17df40a69e3ba6781ef67276'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:18:55.979446 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-e22230f1-dc5f-4ea1-88b4-cb9f8f7d1b27 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '539f10bc17df40a69e3ba6781ef67276'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:18:55.994329 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-e22230f1-dc5f-4ea1-88b4-cb9f8f7d1b27 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '539f10bc17df40a69e3ba6781ef67276'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:18:56.000678 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1282/2625] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Oct 14 13:18:55 2022] DELETE /identity/v3/users/539f10bc17df40a69e3ba6781ef67276 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:18:56.207912 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4ff63a-518d-45da-9f7b-2d32c57da5c4 service placement] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:18:56.227128 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4ff63a-518d-45da-9f7b-2d32c57da5c4 service placement] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:18:56.309669 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680055c0-33ae-4117-baa4-bd983a41cb3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:18:56.310363 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680055c0-33ae-4117-baa4-bd983a41cb3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:18:56.310633 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680055c0-33ae-4117-baa4-bd983a41cb3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:18:56.310916 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680055c0-33ae-4117-baa4-bd983a41cb3d admin admin] PATH_INFO: `/v3/projects/1949743eedf34d5d9aff21207e6c70ef` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:18:56.312150 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680055c0-33ae-4117-baa4-bd983a41cb3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=1949743eedf34d5d9aff21207e6c70ef)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:18:56.314357 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680055c0-33ae-4117-baa4-bd983a41cb3d admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:18:56.383620 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-680055c0-33ae-4117-baa4-bd983a41cb3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1949743eedf34d5d9aff21207e6c70ef', 'request_id': 'req-680055c0-33ae-4117-baa4-bd983a41cb3d'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:18:56.392043 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-680055c0-33ae-4117-baa4-bd983a41cb3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1949743eedf34d5d9aff21207e6c70ef', 'request_id': 'req-680055c0-33ae-4117-baa4-bd983a41cb3d'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:18:56.399256 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-680055c0-33ae-4117-baa4-bd983a41cb3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1949743eedf34d5d9aff21207e6c70ef', 'request_id': 'req-680055c0-33ae-4117-baa4-bd983a41cb3d'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:18:56.414450 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-680055c0-33ae-4117-baa4-bd983a41cb3d admin admin] The token cache is being invalidate because project 1949743eedf34d5d9aff21207e6c70ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:18:56.414737 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-680055c0-33ae-4117-baa4-bd983a41cb3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:18:56.415379 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-680055c0-33ae-4117-baa4-bd983a41cb3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:18:56.416934 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1344/2626] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Oct 14 13:18:56 2022] DELETE /identity/v3/projects/1949743eedf34d5d9aff21207e6c70ef => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:18:56.421063 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22230f1-dc5f-4ea1-88b4-cb9f8f7d1b27 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:18:56.422527 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-e22230f1-dc5f-4ea1-88b4-cb9f8f7d1b27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:18:56.436920 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22230f1-dc5f-4ea1-88b4-cb9f8f7d1b27 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:18:56.490146 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:18:56.502708 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677b3e5c-7488-4207-b824-d234646473e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:18:56.503367 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677b3e5c-7488-4207-b824-d234646473e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:18:56.503650 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677b3e5c-7488-4207-b824-d234646473e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:18:56.503930 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677b3e5c-7488-4207-b824-d234646473e1 admin admin] PATH_INFO: `/v3/users/2343387e67384a79964cf2d6e39e1188` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:18:56.505122 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677b3e5c-7488-4207-b824-d234646473e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2343387e67384a79964cf2d6e39e1188)` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:18:56.507106 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677b3e5c-7488-4207-b824-d234646473e1 admin admin] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:18:56.567044 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-677b3e5c-7488-4207-b824-d234646473e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2343387e67384a79964cf2d6e39e1188'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:18:56.578945 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-677b3e5c-7488-4207-b824-d234646473e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2343387e67384a79964cf2d6e39e1188'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:18:56.579699 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-677b3e5c-7488-4207-b824-d234646473e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2343387e67384a79964cf2d6e39e1188'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:18:56.588866 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-677b3e5c-7488-4207-b824-d234646473e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2343387e67384a79964cf2d6e39e1188'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:18:56.602814 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.notifications [None req-677b3e5c-7488-4207-b824-d234646473e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2343387e67384a79964cf2d6e39e1188'} {{(pid=81439) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:18:56.608931 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1283/2627] 10.222.0.17 () {58 vars in 1224 bytes} [Fri Oct 14 13:18:56 2022] DELETE /identity/v3/users/2343387e67384a79964cf2d6e39e1188 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:18:56.798695 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680055c0-33ae-4117-baa4-bd983a41cb3d admin admin] Authenticating user token {{(pid=81438) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:18:56.800330 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.fernet_utils [None req-680055c0-33ae-4117-baa4-bd983a41cb3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81438) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:18:56.813745 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680055c0-33ae-4117-baa4-bd983a41cb3d admin admin] Validating token access rules against request {{(pid=81438) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:18:56.824827 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:18:56.889033 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fc8a4f-34fa-403a-ad2c-7de24cce13ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c832b4bdd0c849fb8bef8d4ac39a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd0b9855003d4ec7b5e5abb80be13578', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81438) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:18:56.892007 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fc8a4f-34fa-403a-ad2c-7de24cce13ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:18:56.892007 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fc8a4f-34fa-403a-ad2c-7de24cce13ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:18:56.892007 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fc8a4f-34fa-403a-ad2c-7de24cce13ac admin admin] PATH_INFO: `/v3/projects/72bf57f40a6c481881574a37f4d22e11` {{(pid=81438) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:18:56.892007 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fc8a4f-34fa-403a-ad2c-7de24cce13ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=72bf57f40a6c481881574a37f4d22e11)` {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:18:56.893244 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fc8a4f-34fa-403a-ad2c-7de24cce13ac admin admin] RBAC: Authorization granted {{(pid=81438) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:18:56.944091 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-11fc8a4f-34fa-403a-ad2c-7de24cce13ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72bf57f40a6c481881574a37f4d22e11', 'request_id': 'req-11fc8a4f-34fa-403a-ad2c-7de24cce13ac'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:18:56.949939 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-11fc8a4f-34fa-403a-ad2c-7de24cce13ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72bf57f40a6c481881574a37f4d22e11', 'request_id': 'req-11fc8a4f-34fa-403a-ad2c-7de24cce13ac'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:18:56.957532 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-11fc8a4f-34fa-403a-ad2c-7de24cce13ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72bf57f40a6c481881574a37f4d22e11', 'request_id': 'req-11fc8a4f-34fa-403a-ad2c-7de24cce13ac'} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:18:56.973978 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-11fc8a4f-34fa-403a-ad2c-7de24cce13ac admin admin] The token cache is being invalidate because project 72bf57f40a6c481881574a37f4d22e11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81438) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 13:18:56.974389 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-11fc8a4f-34fa-403a-ad2c-7de24cce13ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:18:56.975035 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG keystone.notifications [None req-11fc8a4f-34fa-403a-ad2c-7de24cce13ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81438) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 13:18:56.976567 dv-cinder-820994-7-smb devstack@keystone.service[81438]: [pid: 81438|app: 0|req: 1345/2628] 10.222.0.17 () {58 vars in 1233 bytes} [Fri Oct 14 13:18:56 2022] DELETE /identity/v3/projects/72bf57f40a6c481881574a37f4d22e11 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 13:19:06.605202 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=29,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:19:06.970525 dv-cinder-820994-7-smb devstack@keystone.service[81438]: DEBUG dbcounter [-] [81438] Writing DB stats keystone:SELECT=45,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:20:02.933792 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677b3e5c-7488-4207-b824-d234646473e1 admin admin] Authenticating user token {{(pid=81439) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 13:20:02.935222 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-677b3e5c-7488-4207-b824-d234646473e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:20:03.075126 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677b3e5c-7488-4207-b824-d234646473e1 admin admin] Validating token access rules against request {{(pid=81439) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 13:20:03.135657 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d36013-756e-48c8-8104-b3d2116db20f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a5e5c35ed8b4abc877ba8d8c490dacd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2486e73d493b40e18d9d988744993854', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81439) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 13:20:03.136254 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d36013-756e-48c8-8104-b3d2116db20f service placement] REQUEST_METHOD: `GET` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 13:20:03.136531 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d36013-756e-48c8-8104-b3d2116db20f service placement] SCRIPT_NAME: `/identity` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 13:20:03.136798 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d36013-756e-48c8-8104-b3d2116db20f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81439) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 13:20:03.138568 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.fernet_utils [None req-55d36013-756e-48c8-8104-b3d2116db20f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81439) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 13:20:03.149722 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d36013-756e-48c8-8104-b3d2116db20f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 13:20:03.151432 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d36013-756e-48c8-8104-b3d2116db20f service placement] RBAC: Authorization granted {{(pid=81439) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 13:20:03.161540 dv-cinder-820994-7-smb devstack@keystone.service[81439]: [pid: 81439|app: 0|req: 1284/2629] 10.222.0.17 () {60 vars in 1365 bytes} [Fri Oct 14 13:20:02 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 13:20:13.157155 dv-cinder-820994-7-smb devstack@keystone.service[81439]: DEBUG dbcounter [-] [81439] Writing DB stats keystone:SELECT=89 {{(pid=81439) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}